Update: Gemini 4 Carbon takes first place on MathArena and knocks GPT-6.1 Sol off the top, but cost about 15 times more under the test settings
Researcher Jasper Dekoninck announced on X on Friday (11/13) that, “for the first time in a very long time”, a non-OpenAI model leads the math ranking: Google’s Gemini 4 Carbon overtook GPT-6.1 Sol, and Anthropic’s Claude Fable 5.2 came second. According to The Decoder, Carbon’s most common failure was exceeding the time limit, and the model almost never gives up on a task; in one case it ran a script for more than 11 hours without checking on its progress. With the reasoning settings used in the test, Carbon and Fable 5.2 cost roughly 15 and 40 times as much as GPT-6.1 Sol, respectively.