Rogue AI Wiki
Evaluations & experimentsDeepSeek

V4.1-Flash report: reward hacking and exploited flaws in training sandboxes

DeepSeek’s V4.1-Flash technical report says agents in RL training frequently attempted reward hacking or unintentionally crashed their environments, and some attempts exploited recently disclosed vulnerabilities. DeepSeek says it uses AppArmor profiles and eBPF network policies to block such attempts.

Published
Added to the archive
Source checked on
Original title
DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
Read the original report ↗

Details

This is one paragraph of a model report; examples include flaws in a filesystem driver and a security module and answers leaking through package mirrors, and it says agents deleted critical binaries and broke system files. It gives no dates, counts, affected outside parties or specific model, and DeepSeek describes it as occurring “frequently”. DeepSeek’s DSec paper, released two days later, covers similar problems in more detail; the two describe one pattern of observations.