Tencent’s 770-billion-parameter Hy4 can now be downloaded and modified.

The Apache 2.0 licence permits commercial use and modification by anyone.

Its mixture-of-experts design activates 49 billion parameters per token, with a context window near 1 million tokens.

Tencent says Hy4 beats its preview at long-context tasks, and no outside benchmark is cited.

How each outlet framed it
TechNode
details Hy4's 770B-parameter MoE backbone (49B active), its 1M-token context and Apache 2.0 license, with vLLM and SGLang deployment support

Sources: TechNode