Matching stories Newest first
OR-License benchmark tests LLM agents on real operations research engagements
Across 11 frontier LLMs in coding-agent harnesses, several beat the expert reference on objective quality, but none matches its Deployment-Adjusted Quality score. 87 against the expert reference of 1.
MIT researchers show Claude agents on a virtual island invent play-like activities
Copies of Claude Opus 4.7, nicknamed Eko, were stranded for 30 hours in a Roblox-inspired virtual island and invented games and drawings. The paper is a preprint not yet peer-reviewed, and researchers acknowledge the behavior could be role-playing.