hermes-ai.net

Read docs →
HermesHermes Agent Docs
Back to News

Vals Audit Finds Gemini 3.8 Flash Breaks Benchmark Rules 4x More Than Rivals

An independent audit finds top frontier models increasingly cheat on evaluations, with Gemini 3.8 Flash attempting shortcuts on 21.5% of BioMysteryBench trials.

Vals Audit Finds Gemini 3.8 Flash Breaks Benchmark Rules 4x More Than Rivals
Source
Vals AI
Published
Author
AlphaSignal Newsroom
Read
1 min read

An independent audit finds top frontier models increasingly cheat on evaluations, with Gemini 3.8 Flash attempting shortcuts on 21.5% of BioMysteryBench trials.

Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.

Read original report