
Prime Intellect Audit Reveals AI Benchmarks Are Quietly Lying About Model Rankings
Prime Intellect audited AutomationBench, OfficeQA Pro v2, and HLE-Diamond, finding broken graders and reward hacks that distort reported model scores. AutomationBench fixes replaced prose request bodies with JSON Schemas; Opus 5.5 hit 92.15% partial, 70.83% strict.





















