APIUp to 25% cheaper than official pricesTry the API →
Hermes
Back to News

CMU's Odysseys2 Benchmark Exposes Web Agents Failing 53 of 100 Real Tasks

A Carnegie Mellon and Browser Use benchmark of 100 hour-long live-web tasks exposes how far web agents still are from reliable knowledge work.

CMU's Odysseys2 Benchmark Exposes Web Agents Failing 53 of 100 Real Tasks
Source
Browser Use
Published
Author
AlphaSignal Newsroom
Read
1 min read

A Carnegie Mellon and Browser Use benchmark of 100 hour-long live-web tasks exposes how far web agents still are from reliable knowledge work.

Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.

Read original report