ShenzhenTencent’s 770-billion-parameter Hy4 can now be downloaded and modified.
The Apache 2.0 licence permits commercial use and modification by anyone.
Its mixture-of-experts design activates 49 billion parameters per token, with a context window near 1 million tokens.
Tencent says Hy4 beats its preview at long-context tasks, and no outside benchmark is cited.
How each outlet framed it
- TechNode
- details Hy4's 770B-parameter MoE backbone (49B active), its 1M-token context and Apache 2.0 license, with vLLM and SGLang deployment support
Sources: TechNode