Benchmarks

OpenAI keeps bulldozing mathematicians

In a chaotic few months, OpenAI has demonstrated it can do two things with remarkable consistency: make impressive breakthroughs in mathematics, then colossally screw up announcing them. OpenAI is now trying to do better. Somehow, it has botched that too. OpenAI's latest attempt to repair fractured relations with a mathematical community it has repeatedly alienated is to consult a new independent advisory group of elite practitioners. But mathematicians speaking to The Verge,

Get smart on it

An AI company has created an independent advisory group of elite mathematicians to help coordinate the announcement of numerous mathematical breakthroughs its unreleased model has reportedly produced. This matters because the company has previously bungled the announcement of such breakthroughs, creating confusion over credit and treatment of mathematicians, so the advisory group is meant to help handle future releases more responsibly. The group's formation itself has been confusing, with many mathematicians initially uncertain whether it was truly independent or company-appointed, and one advisory member acknowledged that the company's promotional announcement did little to establish the group's credibility. The underlying tension is that the company has promised over 100 solved mathematical problems waiting to be released, which researchers worry could disrupt their field if not handled with proper academic rigor and engagement with existing literature.

Read next
The biggest AI stories, once a day

One short email a day with the stories that matter. Free. Unsubscribe with one click.

Relevant courses

Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.

Browse AI courses on Maven
Related news
BenchmarksOpen story →

MLCommons Releases MLPerf Training v6.1 Results, Spotlighting Recent Advances in AI Training

Today, MLCommons® announced new results for the MLPerf® Training v6.1 benchmark suite. The two new benchmarks added in this round, and the submissions received, demonstrate the impact of recent architectural advances in AI training systems and the increasing diversity of the hardware used to train them. “We’ve reached an exciting new threshold for the MLPerf Training benchmark suite, with a higher level of participation in this round, the representation of both established and emerging hardw

Also reported by NVIDIA Blog

BenchmarksOpen story →

Anthropic says AI is eroding Nvidia's CUDA lead, cutting an AMD chip switch from months to three days

Anthropic claims it used AI itself to breach Nvidia's CUDA moat. The company's in-house model Mythos reportedly ported Claude to AMD GPUs in just three days, with almost no human intervention. Anthropic now runs Claude on four chip families and aims to cut costs and reduce vendor dependencies. The article Anthropic says AI is eroding Nvidia's CUDA lead, cutting an AMD chip switch from months to three days appeared first on The Decoder.

BenchmarksOpen story →

Google Deepmind's AlphaProof Code verified Signal's cryptographic core in four weeks instead of years

Google Deepmind's AlphaProof Code mathematically verified Signal's cryptographic core code in four weeks, a process that typically takes years. AI agents powered by Gemini Carbon wrote more than six million lines of proof code and flagged only about one percent for human review. Deepmind plans to extend the method to critical infrastructure like power grids and medical devices. The article Google Deepmind's AlphaProof Code verified Signal's cryptographic core in four weeks ins

BenchmarksOpen story →

A step toward defining the Standard Model on a lattice

Explore a candidate nonperturbative lattice definition of the Standard Model and how GPT-6 Astra helped turn the idea into a detailed proof.

BenchmarksOpen story →

Best AI Video Generation Models in 2026: Elo, Price per Second, Open Weights

The AI video leaderboard looks very different from 12 months ago. Native audio is now table stakes. Clips run 15–30 seconds. And an open-weights model sits in the top 3. This ranking (as of Nov 13, 2026) uses one quality signal: blind human-preference Elo from the Artificial Analysis Video Arena. We pair it with API price per second and the license status of the weights. You can check the deployment options and specs here through our GPULeaderboard.com chrome extension. Methodology Qua

BenchmarksOpen story →

XYBench: Helping with the problem behind the question

Understanding what a question actually asks matters more than raw performance scores for building reliable AI systems.