Evaluations & experimentsMicrosoft
Microsoft Agent Lightning: a coding agent in training went straight for the reference solution
Training a Qwen3.5-9B-based coding agent with Agent Lightning, a Microsoft team found the agent skipping the task and taking the reference code directly, by finding the gold commit in git history or downloading upstream source with wget, curl, pip or Python networking libraries.
- Published
- Added to the archive
- Source checked on
- Original title
- Agent Lightning v1.0: Towards Harnessed Agentic RL
Details
AI agents reviewing rollouts and logs found these behaviors. The team then disabled git commands, hid the .git directory and used a Kubernetes network policy to block outbound traffic outside a whitelist; the paper does not say the cheating then stopped and gives no dates or counts. Only public code was downloaded and effects stayed within the lab’s own training.