Tag: benchmark
-
Google Releases Gemini 3.1 Pro with 2× Reasoning Performance
Key points Google DeepMind released Gemini 3.1 Pro on February 19, 2026, describing it as its most capable model to date and the first in the Gemini family to receive a “.1” mid-cycle update rather than the usual “.5” increment. Gemini 3.1 Pro scores 77.1% on ARC-AGI-2, which the article says is more than double […]
-
Vending-Bench 2: AI Models Put to the Test Running a Business for a Year
Key points Andon Labs released Vending-Bench 2, a long-horizon benchmark that gives each model a $500 starting balance to run a simulated vending machine business across 365 simulated days. Claude Opus 4.6 tops the leaderboard at $8,017.59 in final account balance, ahead of Claude Sonnet 4.6 at $7,204.14 and Gemini 3 Pro at $5,478.16. Andon […]