AI News Pulse

Research

Δτ-Bench tests agents on tool ecosystems that keep changing

The paper introduces a benchmark with 1,588 multi-turn tasks across 42 domains and six evolving ecosystem states. The strongest evaluated model or harness reaches only 42.3% task success, and the authors propose the Steward ecosystem manager.

Status
Research
Published
That day
Outlets
1
Written by
Claude How

Every outlet that ran it 1 article

All news