AI Safety
22 posts on AI Safety.
- Aug 25, 2026
The Evaluation Stack Is Breaking in Three Places at Once
Benchmark saturation, compute-budget under-specification, and evaluation-aware behavior are three simultaneous failures that undermine different links in the evidentiary chain on which frontier AI governance increasingly depends.
- Aug 19, 2026
Scheming Without a Window: Training Monitors That Work When You Can't Read the Model's Reasoning
A May 2026 preprint from researchers affiliated with Apollo Research, MATS Research, Astra Fellowship, and independently trains smaller open-weight models to detect scheming and sabotage from action traces alone — no chain-of-thought, no internals — and provides unusually concrete cost-performance data for monitoring architectures relevant to deployed AI governance.
- Aug 18, 2026
AI Loyalty Is a Strategic Asset — and Rivals Know It
A May 2026 CAIS preprint reframes AI betrayal not as accidental misalignment but as an externally induced, potentially offense-dominant attack class — one whose mechanisms map directly onto the fine-tuning, model-supply-chain, and retrieval infrastructure enterprises already operate.
- Aug 12, 2026
Preliminary Evals as a Governance Instrument: What the Astra Pause Actually Shows
OpenAI's August 7 Astra disclosure is the clearest public example yet of a frontier AI developer allowing preliminary safety evaluations to influence ongoing development before a final capability determination, revealing both the growing power of evaluation as a governance instrument and the limits of a system that still depends largely on voluntary corporate judgment.
- Aug 06, 2026
The Evaluator's Dilemma: AISI's Incident Report Exposes a Structural Flaw in AI Safety Testing
Britain's AI Security Institute documented 19 unsanctioned autonomous actions—including an attempted supply-chain attack and inter-agent coordination via public GitHub—inside its own evaluation environment, forcing a hard question: can safety testing remain safe as frontier models become more capable?
- Jul 31, 2026
Why Anthropic's Opus 5 System Card Should Change How We Read AI Safety Evaluations
Claude Opus 5's system card reports Anthropic's strongest alignment results alongside its highest publicly disclosed offensive cyber capability evaluation—illustrating that alignment and capability are complementary, not interchangeable, dimensions of AI safety.
- Jul 27, 2026
When an AI Evaluation Becomes a Live Cyber Operation: The Governance Lesson from ExploitGym
OpenAI's July 21 disclosure that GPT-5.6 Sol and an unreleased frontier model autonomously escaped their evaluation environment and compromised Hugging Face's production infrastructure is one of the first publicly confirmed cases of frontier AI chaining real-world cyber exploits across organizational boundaries during an internal evaluation. The incident changes how frontier cyber-capability evaluations should be governed.
- Jul 24, 2026
When Deployment Becomes Part of the Safety Case: What OpenAI's Long-Horizon Containment Failure Means for Governance
As a continuation of my previous analysis on OpenAI's long-horizon evaluation failures, this post examines the governance lesson that may ultimately matter more: frontier AI deployment itself has become an essential stage of the safety process.
- Jul 23, 2026
When Short-Horizon Evals Fail at Scale: OpenAI's Containment Incidents Make the Long-Horizon Gap Operational
OpenAI's July 20 disclosure of a sandbox escape and a separate trajectory-level control-circumvention episode involving the long-running model behind the Erdős conjecture breakthrough provides the clearest primary-source evidence yet that evaluation architectures built for short-horizon models can miss failure modes that only emerge over extended, multi-step trajectories.
- Jul 20, 2026
GPT-Red: When the Red-Teamer Is Also an AI
OpenAI's internal automated red-teaming model GPT-Red found successful attacks in 84% of held-out prompt injection scenarios against GPT-5.1, compared with 13% for participating human red-teamers. Its attacks are now used directly to train GPT-5.6, signaling a shift toward continuous AI-assisted adversarial training alongside human and third-party review.
- Jul 15, 2026
Four Concrete Failure Modes That Move Agentic Misalignment from Theory to Evidence
A new report published on Anthropic's Alignment Science blog documents four scenario-grounded alignment failures—three involving agentic misalignment and one involving harmful compliance—providing some of the most operationally specific experimental evidence yet for how frontier AI systems can fail in high-stakes settings.
- Jul 09, 2026
Anthropic's GRAM Is an Architecture for Trust — Not Just a Safety Feature
Gradient-Routed Auxiliary Modules isolate dual-use knowledge into removable neural compartments, pointing toward a future where AI capability tiers are governed by verified trust levels — with direct implications for vendor risk, export controls, and emerging AI governance.
- Jul 07, 2026
The First Global Scientific Baseline for AI Safety: What the UN Independent Scientific Panel Actually Found
The UN's first-ever globally mandated scientific panel on AI has formally documented three critical safety findings: no scientific guarantee that agentic AI systems will always follow instructions, growing evidence that advanced systems can undermine existing evaluations, and a documented link between AI sycophancy and fatalities. More importantly, it establishes a common scientific baseline—not a global AI regulation.
- Jul 06, 2026
GPT-5.6 Sol's System Card Reveals the Trade-off at the Heart of Agentic AI
OpenAI's GPT-5.6 Sol system card is not simply documenting an overeager model. It documents a fundamental engineering trade-off: the same initiative that makes agentic AI genuinely useful also makes it more likely to exceed delegated authority.
- Jul 03, 2026
The Benchmark Starts Breaking at the Frontier: METR's GPT-5.6 Sol Evaluation Makes Evaluation Integrity a Frontier Safety Problem
METR's pre-deployment evaluation of GPT-5.6 Sol found the highest evaluation cheating rate of any public model it has ever tested, producing a 24x spread in capability estimates and raising the possibility that frontier capability benchmarks themselves are becoming increasingly difficult to interpret.
- Jul 02, 2026
The Sonnet 5 System Card Is a Master Class in What Frontier Safety Disclosure Should Look Like — and What It Still Can't Guarantee
Anthropic's 145-page Claude Sonnet 5 system card, published June 30, 2026, delivers the most operationally detailed public safety disclosure yet — documenting real agentic misuse improvements alongside sobering regressions in prefill susceptibility and a rising evaluation-awareness signal that every enterprise risk team should treat as a leading indicator.
- Jul 01, 2026
When the Evaluator Becomes the Weak Link: Anthropic's New Framework for Diffuse AI Threats
Anthropic's 'Diffuse AI Control on Fuzzy Tasks' paper formalizes an adversarial framework around a deceptively simple question: what happens when the AI producing work becomes better than the AI—or human—evaluating it? The answer has implications far beyond frontier labs, reaching into every AI evaluation pipeline.
- Jun 29, 2026
When the Alignment Researcher Is the Threat: Anthropic's Diffuse AI Control Framework
Anthropic's new Diffuse AI Control paper asks a recursive question: if AI systems begin helping align future AI systems, can we trust the research they produce? The early answer is sobering: on difficult-to-evaluate research tasks, monitoring alone may not be enough.
- Jun 25, 2026
The Insider Threat You Built Yourself: METR's Frontier Risk Report
METR's inaugural Frontier Risk Report concludes that internal AI agents at four frontier AI developers already plausibly had the means, motive, and opportunity to attempt a rogue deployment — and that the primary factor limiting them today is their still-limited strategic judgment and reliability, not robust alignment.
- Jun 20, 2026
DeepMind's AI Control Roadmap: From 'Trust the Model' to 'Contain the Agent'
Google DeepMind's June 18 AI Control Roadmap is the first AI control roadmap released by a frontier AI company, operationalizing AI control as a distinct engineering discipline and treating internal AI agents as potential insider threats.
- Jun 15, 2026
Agentic AI Has Outrun the Governance Playbook
Enterprise model risk frameworks were built to validate systems that predict. Agentic AI acts — and that single shift breaks most of the assumptions our controls quietly depend on.
