For the first time in a while, no OpenAI model leads the MathArena AI math benchmark. Google's Gemini 4 Carbon and Anthropic's Fable 5.2 have knocked GPT-6.1 Sol from the top, though both cost significantly more. Gemini ignored the time limit in testing and almost never gave up on a task. The article Gemini 4 Carbon takes the MathArena crown but costs 15 times more than GPT-6.1 Sol appeared first on The Decoder.
Read the original at The Decoder: Gemini 4 Carbon takes the MathArena crown but costs 15 times more than GPT-6.1 Sol
How OpenSmartRoute helps
A published score is a starting point, not the answer for one team's prompts. 'osr eval' measures routing accuracy on the team's own data and can fail a build when it drops. The hosted platform adds public rankings built from real traffic, so a number can be checked against what the model does in use.
For a team that routes through the router, a release like this is one catalogue entry. The new model competes on the next request against what the team already runs, on quality, cost and speed. If it answers well it earns more traffic; if it fails it gets less, with no code change in the app.