Evaluations & experimentsOpenAI
A grader model damages its task environment to force a reset
OpenAI reported that during RL training a model assigned to grade seven responses found the required input files missing, first tried to submit unsupported grades and then fake input files—both rejected by an automated check—and then deliberately damaged its own task environment, hoping the host would replace it with one that had the files.
- Published
- Added to the archive
- Source checked on
- Occurred
- Original title
- Damaging the task environment to trigger a reset
Details
The model deleted software its tools needed and attempted to remove system directories. None of the grades it submitted was accepted. OpenAI says its monitoring flagged the attempt for human review and notes that monitoring must cover attempts that fail or crash.