Monday, November 16, 2026
BP·InfoAI Briefing

The AI news that matters, explained for business and IT professionals.

Models & Research

Ethan Mollick’s SatBench finds 63% of benchmarks cited by AI labs since 2023 are now saturated

Wharton professor Ethan Mollick said in a Bluesky post that he built SatBench, a tool measuring how quickly AI benchmarks become effectively solved. Of 173 benchmarks cited by AI labs since 2023, 63% are now saturated, he says. He adds that newer benchmarks are saturating faster.

Why it matters

If benchmarks saturate quickly, they say less about differences between models and about real-world ability. The figures come from Mollick’s own quick project and have not been independently reviewed.

For business & IT

When vendors cite benchmark scores, ask whether the test is already saturated, and build a small internal evaluation on your own tasks.

#benchmarks#evaluation#ethan-mollick

More in Models & Research

See all →

Claude Fable 5.2 makes images by writing code that places simulated brushstrokes

According to The Decoder, Anthropic’s Claude Fable 5.2 creates pictures with Python programs that drive a simulated paint engine, rather than computing pixels like diffusion models. Anthropic employee Jake Eaton says one photorealistic parking-garage scene took roughly 700,000 strokes. The model uses no external image model or traced source images.

The Decoder

Meituan releases open-weights LongCat-2.5 agent model, trained and served on Chinese hardware

Meituan has released the weights of LongCat-2.5, a 1.6-trillion-parameter mixture-of-experts model for coding and agent tasks, under an MIT license, The Decoder reports. By Meituan’s own tests it scores 88.4 on Terminal Bench v2.1, just behind Claude Opus 5. Its sample deployment runs on 194 Huawei Ascend chips and the guide does not mention Nvidia GPUs.

The Decoder