Skip to content

Ai Benchmark

Topic archive • 9 matches

AI-generated: summaries written by AI from the linked sources. How we use AI

Back to home • GEO summary endpoint

2026-11-10

Technology

  • Google DeepMind revealed Gemini Robotics 2.5, which the company says is up to twice as successful at some tasks, alongside an open safety benchmark called 'ASIMOV-jailbreak'. The release pairs a robotics model update with a jailbreak-focused safety evaluation.

    Research • Ars Technica AI

    Permalink
  • Anthropic's Fable 5.2 completes 41.3 percent of real freelance jobs at professional quality on the Remote Labor Index, more than double the next-best systems Opus 5.5 and GPT 6 Astra, according to The Decoder. A year ago the top score was 2.5 percent, though areas like product design and animation remain weak spots.

    Model Releases • The Decoder

    Permalink

2026-11-11

Technology

  • Based on a transcript excerpt: AI Explained analyzes the Fable 5.2 and Gemini Carbon model releases, drawing on a 264-page system card, a 30-page METR report on AI acceleration, and the creator's own testing. The video covers benchmark results, a 'Max Bench' test designed to catch models that memorized answers, the remote labor index, and claims from Anthropic that the pace of AI improvement will quicken. It also discusses whether benchmark results hold up to scrutiny.

    AI News & Analysis • AI Explained

    Permalink

2026-11-12

Technology

  • Google DeepMind released Gemini 4 Hydrogen, its third new model in six weeks, which introduces an xhigh reasoning level. According to Artificial Analysis' Intelligence Index, Hydrogen nearly ties Claude Sonnet 5.5 and GPT-6.1 Sol, at a third of Sonnet's cost but roughly 2.5x that of Sol. The model is rolling out in Google Search and inside Google Antigravity alongside a new Orchestrator option for long-horizon tasks.

    AI Models • Techmeme

    Permalink