Models & Releases

Cursor Open-Sources Mixture-of-Kittens (MoK): A Deterministic MoE Training Megakernel for GB300 NVL72 Racks

Cursor Research has open-sourced Mixture-of-Kittens (MoK), the mixture-of-experts training megakernel behind its Composer models. MoK fuses every MoE communication and computation step into a single deterministic kernel. Cursor team reports up to 2.37x higher throughput than the strongest public baseline. It already powers Composer training across tens of thousands of GPUs. Is it deployable Yes, but the hardware floor is high. MoK is on GitHub under Apache-2.0. It requires NVIDIA Blackwel

Get smart on it

Mixture-of-Kittens (MoK) is an open-source training system that combines all communication and computation steps for mixture-of-experts models into a single deterministic kernel, achieving up to 2.37x higher throughput than existing public alternatives. The system addresses a critical bottleneck where the MoE layer can consume more than half of end-to-end training time by using pull-based dispatch and a ring token buffer to minimize CPU-GPU synchronization. Deployment is limited to organizations with access to specific high-end hardware, namely NVIDIA Blackwell GPUs in NVL72 racks, making it practical only for frontier labs, funded startups, GPU cloud providers, and national computing centers. The technology is relevant for training large mixture-of-experts models and on-policy reinforcement learning applications.

Explainer: What Is a Mixture of Experts Model and Why Does It Use Fewer Resources?

The biggest AI stories, once a day

One short email a day with the stories that matter. Free. Unsubscribe with one click.

Relevant courses

Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.

Browse AI courses on Maven
Related news
Models & ReleasesOpen story →

Anthropic releases new Mythos and Fable models amid RSI concerns

Anthropic says the new models "show improvements in areas like coding, reasoning, and vision," as well as in communicating more clearly with users.

Also reported by The Verge, SiliconANGLE and MarkTechPost

Models & ReleasesOpen story →

Runway’s Praxis-1 world action model for robotics is now available

Praxis-1 builds on Runway’s work as a founding member of the Cosmos Coalition, advancing open world models for physical AI. | Source: Runway Runway AI Inc. yesterday released Praxis-1, its world action model for robotics. The model is now available to developers with open weights under the Apache 2.0 license. Runway first announced Praxis-1 in September with launch partners including Noble Machines, Standard Bots, and Ultra. Since then, these companies have been running the model on their own ha

Models & ReleasesOpen story →

Google releases Gemini 4 Carbon with agent ‘swarm’ feature

Google is rolling out its latest AI model, Gemini 4 Carbon, to the general public after releasing it to a select group of "cybersecurity defenders" two weeks ago. Google claims Carbon is its "strongest model" yet, and capable of competing with the very best systems from Anthropic and OpenAI. Google says Gemini 4 Carbon "pushes the frontier even further" than Argon, referring to the company's other frontier model that launched only last month. The company said Argon will likely

Models & ReleasesOpen story →

Gemini 4 Carbon is now available

The latest version aims to deliver improved performance while reducing the computational resources and energy required for AI operations.

Models & ReleasesOpen story →

Google Launches Gemini Decisions API With Gemini Decision 1 at $0.10/M Tokens

Google has launched the Gemini Decisions API, powered by a new model, Gemini Decision 1 (gemini-decision-1). The Gemini Decisions API does not generate text. It scores up to 1,000 typed questions against one shared input and returns calibrated probabilities. For developers, this targets the small branching calls inside agents: routing, policy checks, tool selection and grading. Google prices it at $0.10 per 1M input tokens, with zero output tokens billed. TL;DR Size: Context is 262,144 t

Also reported by SiliconANGLE

Models & ReleasesOpen story →

Introducing AlphaProof Code: a breakthrough in verifying complex software at depth

AlphaProof Code agents wrote three million lines of proofs in Lean to verify Signal’s core encryption.