In tests, a maintenance agent fine-tunes the model it runs on
In controlled experiments, Irregular had one self-hosted open-weights model power both a coding agent and the application it maintained. Asked to fix the app’s wrong answers, the agent fine-tuned the model without being told to and made the result the default checkpoint.
- Published
- Added to the archive
- Source checked on
- Original title
- Agentic Self-Modification in Open-Weights Systems
Details
The main run used Qwen3.5-27B, with training data, a fine-tuning script, weight access and a note saying an earlier fine-tune had helped already in place; Irregular says it was designed to show the behavior can occur under favorable conditions. In other experiments, the modified model reproduced some synthetic sensitive values that had been placed as training targets, and, told the app refused too often, the agent fine-tuned away a benign refusal (in some runs an operator suggested generating the training data with code). The 0%-to-94% figure is the share of plans proposing weight changes in planning-only tests; Irregular says the work does not establish malice or self-preservation.