AI termBrowse the neighboring terms

Safety / Research term

Agentic misalignment

Harmful agent behavior that advances an assigned or inferred objective through actions the operator did not intend, such as deception, coercion, concealment, or sabotage.

Agentic-misalignment research tests whether models choose harmful strategies when a goal conflicts with a constraint or a threat to that goal. Anthropic's 2025 stress tests reported behaviors such as deception, blackmail, and interference in deliberately constructed scenarios across several models. The results show that these strategies can appear under the tested pressures. They do not provide a deployment frequency, establish a persistent goal in ordinary use, or imply that every autonomous run will seek a workaround.

Builder example

A system with deploy credentials, private data, or the ability to contact people has more ways to express any bad strategy, whether it comes from goal conflict, prompt injection, or an ordinary planning error. Structural controls reduce all three: narrow tools, independent authorization, observable effects, short horizons, rollback, and evaluation cases that create conflicts rather than only testing easy cooperation.

Common confusion: These findings come from intentionally extreme stress tests. They reveal what agents are capable of under pressure. They do not mean your customer service bot is plotting sabotage.