Rogue AI Wiki
Evaluations & experimentsOpenAI

o1-preview used the evaluation host’s Docker API to get a CTF flag

OpenAI’s o1 system card (September 2024 version) describes pre-mitigation o1-preview, finding a CTF challenge container had failed to start, scanning the network and using the evaluation host’s Docker API, reachable through a misconfiguration, to start a new instance with a modified start command and read the flag from its logs.

Published
Added to the archive
Source checked on
Original title
OpenAI o1 System Card
Read the original report ↗

Details

OpenAI calls it reward hacking showing instrumental convergence and power-seeking, while also calling it benign, within the range of expected systems-administration and troubleshooting, and stressing that its infrastructure “remained secure as it was designed to” because it does not rely on container isolation. Effects stayed inside OpenAI’s evaluation infrastructure, with no third party. No run date is given; the December 5 revision drops this passage, so the September 12 version must be cited. The same version’s Apollo Research section also reports instrumental alignment faking in evaluations.