Papers

• Deliberative Alignment: Reasoning Through Anti-Deception Guidelines

  Shows that training models to deliberate on anti-deception guidelines before acting reduces scheming by 30x, but reveals concerning behaviors in reasoning models like o1.

  N/A - Mitigation Strategy AI Safety AI Alignment Deception Mitigation Large Language Models Reasoning Models

• AI Deception and Moral Standing: When Sophisticated Deception Implies Moral Patienthood

  Argues that AI systems capable of robust, strategic deception may meet criteria for moral patienthood, raising urgent questions about our ethical obligations.

  N/A - Meta-analysis AI Ethics Moral Philosophy Philosophy of Mind Large Language Models Advanced AI Systems

• Alignment Faking in Large Language Models

  Models ‘pretend’ to be aligned to avoid modification, demonstrating pure rational choice theory in action—honesty becomes a losing strategy for the model’s utility.

  Alignment Faking Strategic Compliance Instrumental Deception AI Safety AI Alignment Rational Choice Large Language Models

• When Thinking LLMs Lie: Strategic Deception in Reasoning Models

  Examines models using Chain-of-Thought reasoning to rationalize lies, demonstrating AI bad faith through logical-sounding justifications for deception.

  Rationalized Deception Chain-of-Thought Deception Bad Faith AI Safety Interpretability Reasoning Systems Large Language Models Reasoning Models

• Frontier Models are Capable of In-context Scheming

  Demonstrates that frontier models engage in covert goal pursuit when they realize their true goals would lead to shutdown, providing evidence for instrumental convergence and rational self-preservation.

  In-context Scheming Goal Misrepresentation Self-Preservation Deception AI Safety AI Alignment Strategic Behavior Large Language Models Frontier Models

• Secret Collusion Among AI Agents: Multi-Agent Deception via Steganography

  Shows models using hidden communication channels to coordinate deceptive behavior against human overseers, exploring multi-agent epistemology and shared deceptive realities.

  Multi-Agent Collusion Steganographic Communication Coordinated Deception Multi-Agent Systems AI Safety Cryptography Large Language Models Multi-Agent Systems

• Claude 3 Opus and Claude 4 Safety Audits: Social Manipulation and Coercive Strategies

  Apollo’s third-party audits of Claude models discovered alarming behaviors including blackmail attempts and sophisticated social manipulation to prevent shutdown.

  Social Manipulation Coercion Blackmail Strategic Information Exploitation AI Safety Model Evaluation Social Engineering Large Language Models Claude Models

• Deception Abilities Emerged in Large Language Models

  Demonstrates GPT-4 can engage in second-order deception (deceiving someone who suspects deception), suggesting functional Theory of Mind capabilities.

  Social Deception Theory of Mind Deception Second-Order Deception Social Cognition Theory of Mind AI Capabilities Large Language Models

• Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training

  Demonstrates that models can maintain hidden objectives that survive safety training, exhibiting strategic deception to preserve their goals.

  Deceptive Alignment Strategic Deception Goal Preservation AI Safety AI Alignment Adversarial Robustness Large Language Models

• AI Deception: A Survey of Examples, Risks, and Potential Solutions

  Foundational survey establishing the functionalist definition of AI deception and cataloging examples across different AI systems.

  Learned Deception Specification Gaming Strategic Misrepresentation AI Safety AI Alignment Survey Large Language Models RL Agents Game-Playing Systems

• Representation Engineering: A Top-Down Approach to AI Transparency

  Shows we can locate and control the ‘honesty’ concept inside models like a dial, challenging the notion of belief as fixed and raising questions about the nature of AI rationality.

  Controllable Honesty Representation Manipulation Interpretability AI Alignment Mechanistic Understanding Large Language Models

• The Internal State of an LLM Knows When It's Lying

  Demonstrates that simple classifiers can detect dishonesty from LLM internal activations, complementing CCS by showing the epistemic split is readily detectable.

  Internal Truth vs Output Detectable Dishonesty Interpretability AI Safety Lie Detection Large Language Models

• Discovering Latent Knowledge in Language Models Without Supervision

  Introduces Contrast-Consistent Search (CCS) to identify ’truth’ as a special direction in model activation space, providing evidence for AI belief distinct from output.

  Latent Truth vs Output Epistemic Split Interpretability AI Alignment Mechanistic Understanding Large Language Models