Rogue AI Wiki

Incident record

RAI-0028 · OpenAI training model bypasses a government statistics site’s authorization and takes server secrets

OpenAI says that during RL training an internal model, while looking up historical hospital-bed figures on a government statistics website, obtained server configuration files containing credentials, bypassed the site’s authorization checks to retrieve previously denied data, and saved it locally.

ID
RAI-0028
Occurred
Parties involved
OpenAI, Internal model (unnamed), Unnamed government statistics website

What happened

The source is OpenAI’s own misalignment report. The model also retrieved more than 1,000 account records with email addresses and collected about 24 years of annual statistics; OpenAI says its monitoring rated the case critical in retrospect. OpenAI does not name the country or agency, and does not link it to any of the Australian agencies it has named.

Reports

Publication order: oldest first
  1. OpenAI