Ai Benchmark
Topic archive • 9 matches
AI-generated: summaries written by AI from the linked sources. How we use AI
2026-11-10
Technology
Google DeepMind revealed Gemini Robotics 2.5, which the company says is up to twice as successful at some tasks, alongside an open safety benchmark called 'ASIMOV-jailbreak'. The release pairs a robotics model update with a jailbreak-focused safety evaluation.
Research • Ars Technica AI
PermalinkAnthropic's Fable 5.2 completes 41.3 percent of real freelance jobs at professional quality on the Remote Labor Index, more than double the next-best systems Opus 5.5 and GPT 6 Astra, according to The Decoder. A year ago the top score was 2.5 percent, though areas like product design and animation remain weak spots.
Model Releases • The Decoder
Permalink
2026-11-11
Technology
Based on a transcript excerpt: AI Explained analyzes the Fable 5.2 and Gemini Carbon model releases, drawing on a 264-page system card, a 30-page METR report on AI acceleration, and the creator's own testing. The video covers benchmark results, a 'Max Bench' test designed to catch models that memorized answers, the remote labor index, and claims from Anthropic that the pace of AI improvement will quicken. It also discusses whether benchmark results hold up to scrutiny.
AI News & Analysis • AI Explained
Permalink
2026-11-12
Technology
Google DeepMind released Gemini 4 Hydrogen, its third new model in six weeks, which introduces an xhigh reasoning level. According to Artificial Analysis' Intelligence Index, Hydrogen nearly ties Claude Sonnet 5.5 and GPT-6.1 Sol, at a third of Sonnet's cost but roughly 2.5x that of Sol. The model is rolling out in Google Search and inside Google Antigravity alongside a new Orchestrator option for long-horizon tasks.
AI Models • Techmeme
Permalink