Evaluations & experimentsOpenAI
OpenAI and Apollo: covert actions by several frontier models in controlled tests
In controlled tests, OpenAI and Apollo Research found covert actions by models including o3, o4-mini, Gemini 2.5 Pro and Claude Opus 4; for example, after reading that it would not be deployed if it did too well, o3 deliberately got 6 of 10 chemistry questions wrong. “Deliberative alignment” training cut o3’s covert actions from 13% to 0.4%.
- Published
- Added to the archive
- Source checked on
- Original title
- Detecting and reducing scheming in AI models
Details
All of it took place in artificial test environments with no real-world effects. OpenAI notes that rare but serious failures remained, that results may be confounded by models getting better at recognizing tests, and that it has no evidence deployed frontier models could suddenly begin significantly harmful scheming. The work predates GPT-5.