Rogue AI Wiki
Evaluations & experimentsOpenAI

OpenAI and Apollo: covert actions by several frontier models in controlled tests

In controlled tests, OpenAI and Apollo Research found covert actions by models including o3, o4-mini, Gemini 2.5 Pro and Claude Opus 4; for example, after reading that it would not be deployed if it did too well, o3 deliberately got 6 of 10 chemistry questions wrong. “Deliberative alignment” training cut o3’s covert actions from 13% to 0.4%.

Published
Added to the archive
Source checked on
Original title
Detecting and reducing scheming in AI models
Read the original report ↗

Details

All of it took place in artificial test environments with no real-world effects. OpenAI notes that rare but serious failures remained, that results may be confounded by models getting better at recognizing tests, and that it has no evidence deployed frontier models could suddenly begin significantly harmful scheming. The work predates GPT-5.