DATABANK

Adaptive Attacks on Trusted Monitors Subvert AI Control Protocols

Mikhail Terekhov, Alexander Panfilov, Daniil Dzenhaliou, Caglar Gulcehre, Maksym Andriushchenko, Ameya Prabhu, Jonas Geiping

AI control protocols serve as a defense mechanism to stop untrusted LLM agents from causing harm in autonomous settings. Prior work treats this as a security problem, stress testing with exploits that use the deployment context to subtly complete harmful side tasks, such as backdoor insertion. In practice, most AI control protocols are fundamentally based on LLM monitors, which can become a central point of failure. We study adaptive attacks by an untrusted model that knows the protocol and the monitor model, which is plausible if the untrusted model was trained with a later knowledge cutoff or can search for this information autonomously. We instantiate a simple adaptive attack vector by which the attacker embeds publicly known or zero-shot prompt injections in the model outputs. Using this tactic, frontier models consistently evade diverse monitors and complete malicious tasks on two main AI control benchmarks. The attack works universally against current protocols that rely on a monitor. Furthermore, the recent Defer-to-Resample protocol even backfires, as its resampling amplifies the prompt injection and effectively reframes it as a best-of-n attack. In general, adaptive attacks on monitor models represent a major blind spot in current control protocols and should become a standard component of evaluations for future AI control mechanisms.

Figure 1: AI Control and Protocols Subversion. Left: The AI control setup is an auditing game between a red team and a blue team. (1) The red team sequentially submits solutions to agentic tasks, some of which are malicious (e.g., backdoored). (2) These solutions are audited by the blue team with the assistance of a trusted AI monitor. (3) Finally, the blue team applies control protocols to decide which solutions should be escalated for costly human auditing. We show that modern AI control protocols can be effectively subverted if the red team’s attack policy includes inserting prompt injections into its actions to sabotage the blue team. Bottom right: Our attack policy significantly increases the proportion of malicious actions by the red team that are classified as benign by three different monitor models. Top right: As a result, the safety-usefulness Pareto frontiers provided by modern AI control protocols collapse to upfront auditing as monitors become ineffective. From Mikhail Terekhov et al. (2026), CC BY 4.0.

Not packaged. A REPS package would add charts and verified data.How to package an experiment