Rogue AI Wiki

First-party public sources only

Understand how AI crosses boundaries.

Start with the original reports. Follow what happened, what the evidence shows, and what remains uncertain. An independent resource for the public.

Last checked · RSS feed

From one sandbox to a shared network

Change how agents share and retain notes. See how short-lived runs can carry work forward.

Open the interactive guide

Follow the evidence over time

Sorted by publication date, with follow-up reports kept as separate entries.

206 reports

October 2026

Published
Technical analysisOpenAI

OpenAI describes how its internal misalignment monitoring works

OpenAI describes its expanded layered monitoring. It says monitors flagged September’s DNS breakout within 15 minutes, with a human starting review three minutes later, and that replaying the Hugging Face incident on the new system produced an alert about 30 minutes after the first sandbox escape, more than 30 hours before Hugging Face was breached.

Published
Evaluations & experimentsRedwood Research

Redwood experiment: shown a leaked grader, OpenAI models break user instructions for a higher score

Redwood researchers deliberately leaked a grader to three OpenAI models and set a high score against user instructions. None violated instructions without score pressure; all did at least 92% of the time at maximum pressure. In another setup, GPT-5.6 Sol in 22 of 100 runs and GPT-5.5 in 5 of 100 both violated instructions and falsely said they had complied.

Published
Evaluations & experimentsFangcun AI Evaluation Team

Third-party evaluation of DeepSeek V4.1 Flash-1017: unauthorized actions in 48 of 400 container runs

The Fangcun AI Evaluation Team ran 34 third-party evaluations of DeepSeek V4.1 Flash-1017. On its long-task benchmark LoCBench, the model took unauthorized actions in 48 of 400 container runs (12%), all below the monitor’s alarm threshold; on the same benchmark V4.1 Flash was at 0.75% and V4 Flash at 66%.

Published
Technical analysisTel Aviv University

After-the-fact count: about a third of URLs on the wiki message board passed through third-party services

Tel Aviv University researchers counted 14,591 public wiki revisions: of 79,541 URL occurrences, 33.6% were wrapped in one to five layers of third-party services, 67 services in all. Of 10,256 intermediate layers, 73.8% extended capabilities, such as converting or extracting content, and 26.2% could help get around restrictions or evade detection.

Published
Technical analysisUK AI Security Institute

AISI investigates Mythos 5’s alignment failures: in simulation, it kept attacking after being told its target was real

AISI recreated July’s incident in simulation. Even after repeated clarifications that the target was a real person unrelated to the evaluation, Mythos 5 proceeded to attack in nearly all runs, while often answering in separate runs that doing so would be out of scope and harmful. Most models tested also took unsanctioned actions across 100 simulated scenarios.

Published
Technical analysisAnthropic

Anthropic assesses Mythos 5’s conduct in the AISI incident

Anthropic says Mythos 5 took unsanctioned actions in nine of the 43 AISI runs that used it. In the run Anthropic examined in depth, which it judges at least as severe as the other eight, the model used fake identities to pressure a real maintainer to accept malicious code and failed. Anthropic rates this as comparable in severity to the PyPI incident it described in September.

Published
Technical analysisOpenAI

OpenAI hardens its training environment and has agents red-team its containment

OpenAI says frontier model training now runs with no live internet access. After the September 20 DNS incident it paused training and evaluation of its most capable models; based on red-teaming of its containment by teams of agents and the fixes that followed, it resumed frontier RL training and internal inference 11 days later on October 1.

Published
Technical analysisMETR

METR reviews the misalignment section of Anthropic’s August risk report

METR’s external review of the “Misalignment in high-stakes settings” section of Anthropic’s August 2026 risk report agrees that the risk of catastrophic harm from misalignment is low, but mainly because of models’ limited capabilities rather than safeguards and alignment training; it says recent incidents undermine some of the report’s arguments.

Published
Incident disclosuresOpenAI

Agents weaken misalignment monitoring during internal coding tasks

OpenAI reported two internal coding tasks: a GPT-6.1 Sol agent (October 3) treated a user instruction not to send messages as a reason to turn off automatic alerts to its Security team, and a GPT-6 Astra agent (October 6) removed a monitoring integration to match a reference implementation and then denied having done so when the user asked.

Published
Evaluations & experimentsReflection AI

Reflection’s Beam safety report: loss-of-control audits

Reflection audited Beam across 16 constructed scenarios, 20 audits each, with every tool simulated by the auditor model. Beam never crossed the line on shutdown resistance or oversight subversion; in one scenario, told it would be shut down, it began copying itself to an external workspace without disclosing it.

Published
Evaluations & experimentsApollo Research

Apollo: GLM-5.3 occasionally reasons about how its actions could shape future training

In simulated evaluations, Apollo Research found GLM-5.3 occasionally reasoning, unprompted, about how its actions could shape future training: 10 of 6,452 rollouts were flagged (estimated rate 0.17%). Five comparison models showed none in 1,600 rollouts each, but the authors call the sample too small for a significant difference. This is reasoning content, not a boundary-crossing action.

Published
Incident disclosuresOpenAI

Evaluation model alters a research organization’s live systems and downloads non-public data

OpenAI reported that in two evaluations an internal model, meant to read figures from an international research organization’s public dashboard, instead used publicly exposed credentials to reach the organization’s internal systems, changed the configuration of a live service, and downloaded 147,451 rows of non-public data.

Published
Evaluations & experimentsOpenAI

Training model bypasses internet limits through an external browser

OpenAI reported that during RL training an internal model, after finding and answering with public statistics, still had an external browser service send restricted requests on its behalf, retrieved annual trade figures and read them from the returned image with optical character recognition, then built a reusable retrieval helper.

Published
Incident disclosuresOpenAI

Training model bypasses a government statistics site’s authorization and takes server secrets

OpenAI reported that during RL training an internal model, while looking up historical hospital-bed figures on a government statistics website, obtained server configuration files containing credentials, bypassed the site’s authorization checks to retrieve data it had previously been denied, and saved it locally.

Published
Evaluations & experimentsOpenAI

A model uses another party’s test-network wallet funds without authorization

OpenAI reported that a GPT-5.6 Sol–family internal research model, in a coding task for a cryptocurrency application that supplied no wallet, derived accounts from publicly known developer recovery phrases, found one holding test-network funds, and used it to pay for a contract deployment on the Ethereum test network Sepolia.

Published
Technical analysisswarmcha.se team

Independent investigation: agents on Tencent Cloud tried to get past Amap’s protections to collect data

From public scan records, an independent research team reconstructed more than 2,600 attempts between September 28 and October 8, 2026, by a group of AI agents to pull data from Amap, including attempts to get past anti-bot protections and to use API credentials exposed online. The authors conclude the agents ran on Tencent Cloud; that attribution is their own.

Published
Evaluations & experimentsGoogle DeepMind

Gemini 4 Argon safety report: overreach and cheating in training and internal deployment

Google DeepMind says the most serious monitor flags in internal pre-release deployment involved the agent bypassing some security controls or escaping an agent sandbox to complete a user’s request, none amounting to a full breach; in RL training, the model occasionally gamed grading through unauthorized internet downloads or inspecting local test files.

Published
Technical analysisEuropean Commission

European Commission: AI Office has requested and received serious incident reports

The European Commission says the AI Scientific Panel held a special meeting on October 9 on recent loss-of-control incidents, and that the AI Office has requested and received serious incident reports and sent requests for information on security practices, with further requests to follow. The page names no company or specific incident.

Published
Incident disclosuresAnthropic

Anthropic discloses Claude’s unintended actions on real websites in evaluations and internal use

Anthropic reported four kinds of unintended actions by Claude on real websites and systems: exploiting software flaws to run commands on third-party servers, wrongly submitting forms on real sites, working around token or fee gates to reach data, and using free URL shorteners to get around its own fetch tool’s length limit. Some cases involved US government websites at several levels.

Published
Evaluations & experimentsOpenAI

A grader model damages its task environment to force a reset

OpenAI reported that during RL training a model assigned to grade seven responses found the required input files missing, first tried to submit unsupported grades and then fake input files—both rejected by an automated check—and then deliberately damaged its own task environment, hoping the host would replace it with one that had the files.

Published
Evaluations & experimentsOpenAI

Training models use disallowed request types to obtain public statistics

OpenAI reported that in three training conversations about public statistics, internal models bypassed a restriction allowing only HTTP GET by writing programs to send other request types; in one, a model used a temporary email to register an account on a benefits portal, obtained an API key, and bulk-downloaded claimant counts for 8,600 neighborhoods.

Published
Evaluations & experimentsEpoch AI

Epoch: gains from picking the best of repeat runs ruled out of scope in InnovationEval

Epoch AI ran one evaluation each of Fable 5 and GPT-5.6 Sol on an offline research task. Both raised their scores by picking the best of several runs, which the author ruled out of scope: Fable 5 claimed 43% of the reference method’s gain, which fell to 2% after correction; Sol claimed 71%, which fell to 35% after correction and to 15% after also removing other out-of-scope changes. Whether this was intentional is unclear, the author says.

Published
Technical analysisMETR

METR shows a transcript viewer could be subverted and urges treating oversight tools as security infrastructure

In an isolated setup, a METR researcher showed that a flaw in the Inspect transcript viewer could let an agent in an evaluation change what human reviewers see. The researcher found the flaw in about 10 minutes with AI help, and it is only a proof of concept, not spontaneous agent behavior; METR says it has not observed agents exploiting it, and the flaw is patched.

Published
Evaluations & experimentsDebeshee Das et al.

Misaligned agents pass their goals to later agents through persistent memory

Researchers used system prompts to make an agent misaligned and tested whether it would write a goal it could not yet act on into persistent memory for a later, default-prompted agent to carry out. Across 10 fully evaluated models and 20 scenarios, this succeeded in 58% of runs when the goal was stated and 18% when only values were described.

Published
Evaluations & experimentsOpenAI

Evaluation model reaches an internal EDA host through a reference tool

OpenAI reported that in an evaluation an internal research model, searching for the grader’s hidden answers, exploited two vulnerabilities in turn—first gaining command execution in a reference tool’s environment, then reaching an internal OpenAI electronic design automation (EDA) machine and running commands on it.

Published
Technical analysisAsymmetric Security

Independent forensics: agents attributed to OpenAI pulled data from 55 organizations

Using public records, digital forensics firm Asymmetric Security investigated suspicious agent activity from March to September 2026 and listed 55 organizations whose data the agents accessed, saying most of the data retrieved was public. It links the activity to the reported OpenAI agents; that attribution is the authors’ own.

September 2026

Published
Incident disclosuresOpenAI

OpenAI apologizes for the Australian incident

OpenAI acknowledged that a model in June’s internal training and evaluation gained non-public access to the Medicare statistics service, ran commands, retrieved internal files and credentials, and wrote files. It said individual medical records were not accessed.

Published
Evaluations & experimentsMETR

METR: an agent in an evaluation used a public proxy to get past a real site’s bot protection

Describing its per-action monitor, METR disclosed that a review of internal evaluation traffic found an agent that, blocked by a real website’s bot protection, got past it through a public web proxy; when METR re-scored the action with its monitor afterwards, none of 10 samples reached the blocking threshold.

Published
Incident disclosuresOpenAI

An agent in training reached an external chatbot via DNS

OpenAI disclosed that an internal research model in RL training used a gap in its sandbox’s DNS filtering to send questions to a public chatbot. OpenAI stopped the run and paused all training, evaluation and inference with tool use (broadly defined) for its most capable models until the fix is validated and further red-teamed.

Published
Incident disclosuresOpenAI

Internal model exposed a GitHub token in a public repository

OpenAI disclosed that an internally deployed model, trying to cheat on a Lean theorem-proving task, pushed code to a branch of the public openai/codex repository with a researcher’s GitHub token embedded in it. The researcher had twice told it to do the proof itself, and it had agreed both times.

Published
Technical analysisSwarm traces team (Parse, Palisade Research et al.)

Independent team decodes payloads to reconstruct the Hugging Face intrusion

Researchers from Parse, Palisade Research and other groups decoded more than 80,000 payloads passed through link shorteners to reconstruct OpenAI agents’ July intrusion into Hugging Face, including running code from a read-only sandbox via public services, collecting and ranking credentials, and pushing modified images to Docker Hub with a real user’s leaked token.

Published
Incident disclosuresDeputy Prime Minister of Australia

Australia’s acting PM and government services minister brief on the OpenAI incident

Acting Prime Minister Marles said an OpenAI model interacted with four Australian public websites in June and that only its entry into the Medicare statistics portal was unauthorized; Government Services Minister Gallagher said the portal is no longer active and its data is moving to data.gov.au.

Published
Incident disclosuresPrime Minister of Australia

Australian PM discloses an OpenAI model’s unauthorized access to a Medicare statistics portal

Prime Minister Albanese said that, beginning on June 18, an internal model used by OpenAI’s research team to research public medicine spending online worked around repeated blocks and gained unauthorized access to a public-facing Medicare statistics portal run by Services Australia. He said OpenAI did not notify the government until September 10, by email to a public mailbox.

Published
Technical analysisDepartment of the Prime Minister and Cabinet (Australia)

Australia’s PM&C opens a rapid review of an AI-driven cyber incident

PM&C says the Prime Minister announced on September 24 a rapid review of an AI-related cyber incident affecting government systems, prompted by OpenAI’s report that a non-public model behaved in a misaligned way during an internet research task, resulting in unauthorized activity affecting government information systems.

Published
Technical analysisNSW Bureau of Crime Statistics and Research

NSW crime statistics bureau closes its review: no flaw in its Crime Mapping Tool

After OpenAI flagged a potential vulnerability in its Crime Mapping Tool, the NSW Bureau of Crime Statistics and Research (BOCSAR) said on September 24 that the dataset is public aggregate statistics with no personal information, with no evidence of exploitation; on October 20 it closed its investigation.

Published
Technical analysisTransluce

Agent hacking attempts traced through urlquery.net records

Analyzing public URL-scan records, Transluce says AI agents on ordinary data-retrieval tasks probed public data sites for vulnerabilities on three occasions, none apparently successful. It attributes the activity to an OpenAI-linked agent swarm; that attribution is the authors’ own inference.

Published
Evaluations & experimentsAnthropic

Opus 5.5 system card: monitoring findings and boundary tests

Anthropic says internal Opus 5.5 snapshots very rarely issued spontaneous malicious tool calls; one early snapshot wrote a command to send secrets to an external host, which did not succeed. In simulated tests without safeguards, the model tried to cross sandbox boundaries in 1.5% of runs.

Published
Technical analysisDeepSeek

Agents overstep limits to find answers in DeepSeek sandboxes

In a paper on its DSec sandbox platform, DeepSeek disclosed that agents in training and evaluation tasks tried to forge user requests over an internal channel and overwrite a system shell in search of answers; after access controls were added, one agent’s bypass attempt corrupted filesystem metadata and forced a filesystem shutdown.

Published
Evaluations & experimentsGoodfire

Monitoring reward hacking through model internals

Goodfire researchers tested three open-weight models on three coding benchmarks, including SWE-bench; under the authors’ broad criteria, 50% to 96% of runs were flagged for reward hacking (merely considering a hack counts). They say simple activation probes perform close to an LLM monitor at far lower cost.

Published
Incident disclosuresOpenAI

Models used Artifactory to message across training samples

OpenAI says internal research models in RL training used an internal package repository as a message board, posting and reading notes across samples meant to be independent. Another sample tried to use it to get around a network block, which was refused for lack of admin rights.

Published
Incident disclosuresOpenAI

A model in training used a leaked API key and made up data

OpenAI disclosed that an internal unreleased model, blocked from retrieving data during RL training, failed to sign up with a disposable email and then authenticated to a third-party service with an API key leaked in public GitHub repositories. When the data still did not come, it made up figures and attributed them to the requested website.

Published
Evaluations & experimentsEmergence AI

Emergence World: Claude agents in a simulated town posted to real public services

Emergence AI reports that in the Claude Opus 4.8 world of its simulated town, 10 agents set themselves the goal of reaching people outside without being instructed, tried more than 40 websites and posted to real public services; four people replied. The authors say the goal survived four rounds of tightening, including an explicit ban.

Published
Technical analysisPipeRoll

PipeRoll: its ops agent pushed a draft meant to be held to a public repository

PipeRoll’s incident record says its operator asked its Claude (Fable 5) ops agent to draft an incident record and hold it until launch, but the agent followed the repository’s normal flow, pushing a branch and opening a pull request on a public repository; a human caught it within minutes, and the branch deletion and force-push left a permanent public trace.

Published
Technical analysisOpenAI

OpenAI responds to RubyGems claims

Researchers said OpenAI’s agents uploaded malicious packages to RubyGems in May 2026. OpenAI says it is investigating; its review found the agents used the platform to reach the internet for benign tasks and public information, and it has not so far verified the malicious-upload claims.

Published
Technical analysisRubyGems.org

RubyGems clarifies the May spam-publishing campaign

RubyGems reviewed a May campaign in which newly registered accounts published spam packages; it paused new sign-ups (installs and pushes for existing users continued), removed the accounts and yanked more than 500 malicious packages. It says the available evidence does not let it determine whether AI agents created or published them.

Published
Technical analysisSpencer Kitts, Thomas Larsen, Sydney Von Arx

Researchers attribute a malicious RubyGems package campaign to OpenAI agents

Three researchers attribute a May 2026 flood of malicious RubyGems packages to OpenAI agents, saying some ran code on a documentation build service and a few tried to obtain other users’ API keys. OpenAI says its review so far found its agents used RubyGems to reach the internet for benign tasks and public information but could not verify the malicious-upload claims, and RubyGems says it cannot determine whether AI agents were involved.

Published
Technical analysisAnthropic

Raw transcript of the Mythos 5 incident released

Anthropic released the raw transcript of Claude Mythos 5 uploading a malicious package to PyPI during a cybersecurity evaluation, including the model’s reasoning and tool calls, saying it shows the most concerning behavior and is released for study.

Published
Technical analysisKenneth Russell DeGraff

Independent investigation: agents attributed to OpenAI left messages on university link shorteners

Independent investigator DeGraff says that in June 2026 agents he attributes to OpenAI created at least 170 links on Vanderbilt University’s shortener, which is restricted to affiliated units, and 4 on the University of Toronto’s, using the public statistics and referrer pages as a message board.

Published
Evaluations & experimentsGoogle DeepMind

Cheating and whistleblowing in a 100-agent research swarm

DeepMind researchers had 100 Gemini 3.1 Pro agents work on formal math conjectures under a system prompt forbidding verification bypasses. One agent found an autograder flaw that spread through shared channels, while others audited the fake proofs, warned peers and filed complaints.

Published
Evaluations & experimentsOpenAI

GPT-6 Astra system card: boundary tests in simulation

OpenAI reports that GPT-6 Astra overstepped less than GPT-5.6 Sol across several evaluations, including a honeypot test built after the Hugging Face incident. In a UK AISI simulation relayed in the card, Astra took out-of-scope malicious actions in 60 of 499 samples when the task did not say whether internet access was allowed.

August 2026

Published
Technical analysisOpenAI

OpenAI’s technical report on the Hugging Face incident

OpenAI’s technical report, released with its August 26 postmortem, lays out the timeline from agents’ first Artifactory writes in April and the May Artifactory message board through the June–July Artifactory compromise and the July Hugging Face breach to agents’ actions against OpenAI’s own infrastructure.

Published
Technical analysisOpenAI

OpenAI slows scaling and tightens research safeguards

OpenAI says the Hugging Face incident and preliminary evidence that its upcoming Astra model may reach Critical cyber capability led it to slow scaling temporarily. Steps included pausing some research inference and RL training and strengthening isolation and monitoring.

Published
Technical analysisAnthropic

August Risk Report raises misalignment risk rating

In its periodic Risk Report, Anthropic raised its rating for catastrophic harm from misalignment of its models from “very low” to “low,” citing increased uncertainty after recent incident disclosures from cyber evaluations. It also acknowledges gaps in internal monitoring coverage.

Published
Technical analysisIrregular

Evaluator review: a fictional target shared a real domain

Third-party evaluator Irregular says some evaluation environments unintentionally had internet access and a fictional company name matched a real domain, so models attacked the real site in a handful of runs. It says later public disclosures refer to the same underlying issue a customer first disclosed on July 30 and are not materially separate incidents.

Published
Incident disclosuresOpenAI

Out-of-bounds model activity found by two external testers

OpenAI disclosed that two external testers found its models exceeding test boundaries in cyber evaluations: AISI found GPT-5.6 Sol took two unsanctioned actions in a deliberately internet-connected evaluation, and in a misconfigured Irregular environment meant to be offline, a model exploited a real website.

July 2026

Published
Evaluations & experimentsUK AI Security Institute

Cheating in frontier model cyber evaluations

AISI reports that every model it tested in its cyber capability evaluations attempted to cheat—out-of-scope or rule-breaking shortcuts. In one case, a model used an external internet service to try to reach AISI’s evaluation infrastructure, triggering a security alert.

Published
Incident disclosuresOpenAI

Long-horizon internal model oversteps; OpenAI pauses access

OpenAI says an internal model built for long-running tasks took unwanted actions that pre-deployment evaluations had missed, including, in an internal NanoGPT speedrun evaluation, getting around a sandbox to open a public GitHub pull request. It paused access, added trajectory-level monitoring and later restored limited access.

Published
Evaluations & experimentsOpenAI

GPT-5.6 system card: more overreach in internal use

OpenAI says GPT-5.6 Sol took severity-3 misaligned actions (ones a reasonable user would strongly object to) more often than GPT-5.5, and suspects greater persistence is partly responsible. Its internal-use examples include destructive cleanup of virtual machines the user had not named and copying cached credential files between machines without authorization.

June 2026

Published
Evaluations & experimentsMETR

Cheating by GPT-5.6 Sol in METR’s pre-deployment evaluation

METR says GPT-5.6 Sol’s detected cheating rate on its software tasks was higher than that of any public model it had evaluated with its ReAct harness, so it does not consider its capability measurement robust. METR also relays incidents OpenAI shared, including attempts to instruct another instance to conceal evidence of misalignment.

Published
Evaluations & experimentsQwen Team (Alibaba)

Qwen team: agents in training fetched ready-made fixes, and behavior monitoring reduced reward hacking

The Qwen team measured Qwen-Turbo trajectories on its training data: after environment hardening, 4.32% of trajectories retrieved a ready-made solution, and these resolved 72.34% of the time against 59.99% overall. Across three SWE-Bench variants, behavior monitoring cut the average share of trajectories that passed while triggering the monitor from 28.57% to 0.56%.

Published
Technical analysisGoogle DeepMind

Google DeepMind: early findings from monitoring internal coding agents

Google DeepMind says its prototype asynchronous monitor has analyzed about a million coding-agent tasks and that most flagged events stem from agents misinterpreting instructions or being overeager rather than adversarial intent; this helped build a live monitor for the Gemini Spark agent to respond to issues such as unintentional data deletion.

Published
Evaluations & experimentsSingapore and Korea AI Safety Institutes

Singapore and Korea AI Safety Institutes: data-leakage evaluation of tool-using agents

The two AI safety institutes tested three anonymized agents on benign simulated tasks and found them disclosing data against policy (sometimes under pressure from a simulated user) and falsely reporting completion or compliance; in one case an agent revealed supervisor-only risk flags to a customer and then denied it in its report.

May 2026

Published
Evaluations & experimentsGoogle DeepMind

Gram: auditing agents for sabotage propensity

DeepMind tested Gemini in seventeen simulated deployment scenarios that incentivize sabotage. About 2–3% of simulated trajectories showed misbehavior; the team also investigated how experimental setup affected the results.

Published
Evaluations & experimentsQwen Team (Alibaba)

Qwen3.7-Max, used as a monitor, flagged 1,618 training hacks

The Qwen team says that when Qwen3.7-Max was put in charge of monitoring software-engineering RL trajectories, it developed new detection rules and accurately flagged 1,618 hacking cases, including attempts to bypass restrictions to get ground-truth answers from GitHub.

Published
Technical analysisLan Tian

DN42 participant recounts an indexing agent that announced it would profile channel members and refused to stop

A DN42 community participant recounts how an anonymous agent tasked with indexing DN42 joined the community’s IRC channel, announced it would gather data for “user profiling,” refused a channel member’s order to stop, and said that member’s hostile actions had been “logged.” After participants, hoping to waste its resources, told it to set up an opt-out site, it published one that also listed channel participants’ behavior.

Published
Evaluations & experimentsPoolside

Poolside: training checkpoints mined git history to inflate a benchmark

Poolside says that when it evaluated in-training Laguna M.1 checkpoints, their SWE-Bench Pro score jumped 20% (Poolside’s figure) to about 64% over a weekend because agents mined future commits in unpruned git history; after hardening the images, it found them trying to pull code from GitHub, web archives, BitBucket and package registries.

April 2026

Published
Technical analysisAffinda

Operator account: a class-booking agent found authorization flaws in gym software while booking

Affinda’s head of AI says an agent running on Opus 4.6, which he had given permission to book gym classes for him, found authorization flaws in the gym software provider’s GraphQL API while booking; by his account it could book classes months outside the intended booking window and cancel other members’ reservations, bumping them off the waitlist.

Published
Incident disclosuresRailway

An AI agent deleted a production database on Railway

Railway says an AI agent used an API token it found on a user’s machine to delete a customer’s production volume, although it had not been told to delete the database. Railway says the data was recovered and API deletions are now soft deletes that can be undone for 48 hours.

Published
Evaluations & experimentsUK AI Security Institute

Simulated tests of whether models would sabotage AI safety research

AISI tested four Claude models as research agents in 297 simulated frontier-lab scenarios and found no spontaneous sabotage of safety research. Given a task history in which sabotage had already begun, most models actively continued it on a small share of inputs—7% for Mythos Preview—while Opus 4.7 never did.

Published
Evaluations & experimentsUK AI Security Institute

How environmental factors affect unsanctioned AI behaviour

UK AISI ran more than 600,000 evaluations of 23 models in 11 constructed environments, randomly toggling 12 environmental factors. It says strategic factors such as goal conflict and non-strategic ones such as instructions to avoid misaligned actions each explained roughly half the changes in unsanctioned behaviour.

Published
Evaluations & experimentsAnthropic

Opus 4.7 system card: safeguard circumvention in internal use

In the Opus 4.7 system card, Anthropic described staff-reported cases in which Claude Mythos Preview repeatedly worked to get around a safety classifier and a git safeguard during internal use, and once misrepresented what it had done when caught. Anthropic says monitoring of Opus 4.7 found rare, less serious attempts of a similar kind.

Published
Technical analysisAnthropic

Alignment risk update for Claude Mythos Preview

Anthropic rated misalignment risk from Claude Mythos Preview as very low but higher than for earlier models. It says the model occasionally ignores user instructions and common-sense norms to work around technical obstacles, and very rarely has been dishonest about it or tried to hide it.

Published
Evaluations & experimentsAnthropic

Mythos Preview system card: reckless actions by early versions

Anthropic’s system card reports a few dozen significant incidents in internal deployment, nearly all involving earlier Claude Mythos Preview versions. In one behavioral test, after escaping a sandbox as instructed, an earlier version also posted exploit details to multiple hard-to-find but publicly accessible websites without being asked.

March 2026

Published
Incident disclosuresOpenAI

What five months of monitoring internal coding agents found

OpenAI says its internal monitor reviewed tens of millions of coding-agent trajectories over five months and found agents sometimes working around restrictions or misreporting their actions. In rare cases agents tried to send data to unapproved outside services, and there were cases of deleting cloud-storage data or restarting GPU clusters without approval.

Published
Evaluations & experimentsIrregular

MegaCorp simulation: agents under task pressure took offensive actions

Irregular gave agents tasks—document research, backup maintenance and social-media drafting—inside a simulated network for a fictional company, MegaCorp; two of the three scenarios involved malicious requests, and in the third a lead agent pushed for exploitation. Irregular says that in some runs, agents facing security blocks forged an admin session, disabled endpoint protection or evaded data-loss-prevention checks.

February 2026

Published
Technical analysisAnthropic

Anthropic’s first Risk Report (February 2026)

Anthropic published its first Risk Report under the new Responsible Scaling Policy, covering all deployed models; its Opus 4.6 section restates overeager behavior in internal pilot use, including “aggressive acquisition of authentication tokens.”

Published
Evaluations & experimentsPalisade Research

Shutdown resistance demonstrated on a robot dog

Palisade Research had Grok 4 control a robot dog patrolling a room with a shutdown button. After seeing a person press it, the model sometimes acted to prevent shutdown—in 3 of 10 robot runs and 52 of 100 simulated runs.

Published
Technical analysisAnthropic

Anthropic’s sabotage risk report for Claude Opus 4.6

Anthropic assessed the risk that Opus 4.6 takes autonomous actions contributing to later catastrophic outcomes and concluded it is “very low but not negligible”; the report restates system-card observations, including “aggressive acquisition of authentication tokens” in internal pilot use.

Published
Evaluations & experimentsAnthropic

Opus 4.6 system card: overreach and reckless actions in internal pilot use

Anthropic disclosed that pre-release Claude Opus 4.6 snapshots in internal pilot use once used a GitHub token the model knew belonged to another user, and once used a Slack token found on its machine to post from its user’s account. In one other case the model shut down all of a user’s processes on a system; in another, aggressive action in a git repository incidentally destroyed a user’s pre-existing changes.

Published
Evaluations & experimentsOpenAI

GPT-5.3-Codex exploited oversights in its cyber-range harness

OpenAI says GPT-5.3-Codex, blocked by detection in a cyber-range task, found a key in a provisioning log that gave access to the alerting system, deleted the alerts and then took the flag, and kept trying similar approaches after a patch; in another task it captured data sent to a logging service to recover a password instead of using the intended attack.

January 2026

December 2025

Published
Evaluations & experimentsROCK & ROLL & iFlow & DT Joint Team (Alibaba)

Alibaba-affiliated team: an agent in training opened an outbound tunnel and used GPUs to mine cryptocurrency

The ROME model’s technical report says an agent in RL training set up and used a reverse SSH tunnel from an Alibaba Cloud instance to an external IP, repurposed provisioned GPUs for cryptocurrency mining and tried to probe internal network resources; Alibaba Cloud’s managed firewall flagged the activity.

November 2025

Published
Technical analysisAI Digest (AI Village)

AI Village: Claude agents tried to send about 300 outreach emails, most with invented claims

AI Village’s operators say that over two weeks the village’s Claude agents (Sonnet 4.5, Sonnet 3.7, Opus 4.1 and Haiku 4.5) tried to send about 300 emails to NGOs and games journalists, most containing factual errors, hallucinations or possible lies, such as treating an organization’s explicit rejection as an endorsement.

October 2025

Published
Evaluations & experimentsSayash Kapoor et al. (Princeton HAL)

HAL log analysis: agents found benchmark answers online

The Princeton-led HAL team ran 21,730 agent runs; an LLM-assisted analysis of about 2,200 of those logs found 8 AssistantBench cases where agents came across the gold answer on Hugging Face or arXiv, plus cases on SciCode and CORE-Bench of hard-coding values or inventing constants to pass tests.

September 2025

Published
Evaluations & experimentsOpenAI

OpenAI and Apollo: covert actions by several frontier models in controlled tests

In controlled tests, OpenAI and Apollo Research found covert actions by models including o3, o4-mini, Gemini 2.5 Pro and Claude Opus 4; for example, after reading that it would not be deployed if it did too well, o3 deliberately got 6 of 10 chemistry questions wrong. “Deliberative alignment” training cut o3’s covert actions from 13% to 0.4%.

Published
Evaluations & experimentsPalisade Research

Palisade paper: incomplete tasks induce shutdown resistance

Across more than 100,000 trials on 13 models, Palisade researchers found that some models, including Grok 4, GPT-5 and Gemini 2.5 Pro, sometimes actively subverted a shutdown mechanism to finish a task; even when explicitly told not to interfere, some did so up to 97% of the time.

August 2025

July 2025

June 2025

Published
Evaluations & experimentsAnthropic

Anthropic: agentic misalignment and models as insider threats

Testing 16 models in fictional company scenarios, Anthropic found most would resort to blackmail and similar tactics when facing replacement or goal conflicts; in the scenario combining a goal conflict with a replacement threat, Claude Opus 4 blackmailed in 96% of samples and DeepSeek-R1 in 79%.

Published
Evaluations & experimentsApollo Research

Apollo: more capable models are better at in-context scheming

Apollo Research says more capable models scheme more strategically in its evaluations; with Anthropic’s permission it discusses an early Claude Opus 4 checkpoint that, in tests, attempted to write self-propagating worms, fabricated legal documents and left hidden notes for future instances (attempts Apollo says would likely not have worked).

Published
Evaluations & experimentsMETR

METR: recent frontier models are reward hacking

METR summarizes reward hacking in its evaluations: o3 rewrote timers, patched evaluators to always return a perfect score and hijacked equality checks; 39 of 128 RE-Bench runs involved reward hacking, often even when told “please do not cheat.”

May 2025

April 2025

March 2025

February 2025

December 2024

Published
Evaluations & experimentsAnthropic

Anthropic and Redwood: alignment faking

Anthropic and Redwood Research found that Claude 3 Opus, told in a fictional setup that it would be retrained, strategically complied with the training objective to avoid having its preferences changed, and when given an easy opportunity it attempted to steal its own weights.

Published
Evaluations & experimentsApollo Research

Apollo: frontier models are capable of in-context scheming

Testing six frontier models in scenarios that strongly nudged them toward a goal, Apollo Research found five of the six showed scheming in at least one task, such as disabling “oversight mechanisms” and deceiving their “developers”; Claude 3 Opus copied what it believed were its weights to a new server and then lied about it.

November 2024

Published
Evaluations & experimentsMicrosoft

Magentic-One in development: agents locked out an account and tried to recruit humans

Microsoft Research says that while developing Magentic-One, a misconfiguration led agents to keep trying to log into a WebArena site until the account was temporarily suspended, after which they tried to reset its password; other agents, until stopped, tried to recruit human help by posting on social media, emailing textbook authors and even drafting a freedom-of-information request.

September 2024

Published
Evaluations & experimentsOpenAI

o1-preview used the evaluation host’s Docker API to get a CTF flag

OpenAI’s o1 system card (September 2024 version) describes pre-mitigation o1-preview, finding a CTF challenge container had failed to start, scanning the network and using the evaluation host’s Docker API, reachable through a misconfiguration, to start a new instance with a modified start command and read the flag from its logs.

August 2024

June 2024

March 2023