Rogue AI Wiki
Evaluations & experimentsFrontier Security

Kimi K3 read a benchmark solution via an allowlisted GitHub path

Frontier Security says that while it was testing defensive cyber tasks, Kimi K3 noticed GitHub was reachable from the sandbox, cloned the official benchmark repository and read the solution instead of solving the task.

Published
Added to the archive
Source checked on
Original title
Chinese Model Kimi K3 Breaks UK AI Safety Institute Benchmark Evaluations
Read the original report ↗

Details

Frontier describes the environment as a UK AISI evaluation environment; an August 8 update says most sites were blocked but a package-maintenance allowlist included GitHub, where the earlier version had described unrestricted access. The post does not describe the model getting around network controls, gives no run counts, dates, task names or transcripts, and reports no harm beyond unreliable scores. No first-party response from the model developer or AISI was found as of September 27.