Tencent Releases Hy3: An Open 295B Mixture-of-Experts (MoE) Model with 21B Active Parameters and 256K Context
Tencent’s Hy team released Hy3. Hy3 is a 295B-parameter Mixture-of-Experts (MoE) model. It activates only 21B parameters per token. The weights ship under the Apache License 2.0. Hy3 is aimed at reasoning, agentic workflows, and long-context tasks. What is Hy3? Hy3’s architecture contains a sparse MoE with 192 experts and top-8 routing. Only 8 experts fire per token, so compute stays low. The model also uses a Multi-Token Prediction (MTP) layer. MTP predicts several tokens
Hy3 is an open-source language model with 295 billion total parameters that only activates 21 billion parameters per token, using a sparse mixture-of-experts architecture designed for reasoning tasks, agent workflows, and processing long documents up to 256,000 tokens. The model incorporates a multi-token prediction layer for faster decoding and includes training focused on production reliability, including improvements to tool calling stability, reduction of hallucinations, and better tracking of multi-turn conversations. Performance benchmarks show Hy3 scores 78.0 on coding tests and 90.4 on reasoning tasks, with blind testing indicating advantages over competing models in frontend development and infrastructure work. The weights are released under the Apache License 2.0 and can be deployed using vLLM or SGLang, with a free trial available through OpenRouter.
Explainer: What Is a Mixture of Experts Model and Why Does It Use Fewer Resources?
One short email a day with the stories that matter. Free. Unsubscribe with one click.
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on Maven
Anthropic releases new Mythos and Fable models amid RSI concerns
Anthropic says the new models "show improvements in areas like coding, reasoning, and vision," as well as in communicating more clearly with users.
Also reported by The Verge, SiliconANGLE and MarkTechPost
Runway’s Praxis-1 world action model for robotics is now available
Praxis-1 builds on Runway’s work as a founding member of the Cosmos Coalition, advancing open world models for physical AI. | Source: Runway Runway AI Inc. yesterday released Praxis-1, its world action model for robotics. The model is now available to developers with open weights under the Apache 2.0 license. Runway first announced Praxis-1 in September with launch partners including Noble Machines, Standard Bots, and Ultra. Since then, these companies have been running the model on their own ha
Google releases Gemini 4 Carbon with agent ‘swarm’ feature
Google is rolling out its latest AI model, Gemini 4 Carbon, to the general public after releasing it to a select group of "cybersecurity defenders" two weeks ago. Google claims Carbon is its "strongest model" yet, and capable of competing with the very best systems from Anthropic and OpenAI. Google says Gemini 4 Carbon "pushes the frontier even further" than Argon, referring to the company's other frontier model that launched only last month. The company said Argon will likely
Gemini 4 Carbon is now available
The latest version aims to deliver improved performance while reducing the computational resources and energy required for AI operations.
Google Launches Gemini Decisions API With Gemini Decision 1 at $0.10/M Tokens
Google has launched the Gemini Decisions API, powered by a new model, Gemini Decision 1 (gemini-decision-1). The Gemini Decisions API does not generate text. It scores up to 1,000 typed questions against one shared input and returns calibrated probabilities. For developers, this targets the small branching calls inside agents: routing, policy checks, tool selection and grading. Google prices it at $0.10 per 1M input tokens, with zero output tokens billed. TL;DR Size: Context is 262,144 t
Also reported by SiliconANGLE
Introducing AlphaProof Code: a breakthrough in verifying complex software at depth
AlphaProof Code agents wrote three million lines of proofs in Lean to verify Signal’s core encryption.