Forethought

Research on how to navigate the transition to a world with superintelligent AI systems

Reducing Risk in AI Safety Through Expanding Capacity.

Building Frontier AI Governance Capacity in Africa (Pilot Phase)

A pilot to build policy and technical capacity for governing high-risk AI systems in Africa

Alignment as epistemic system governance under compression

We reframe the alignment problem as the problem of governing meaning and intent when they cannot be fully expressed.

Boundary-Mediated Models of LLM Hallucination and Alignment

A mechanistic, testable framework explaining LLM failure modes via boundary writes and attractor dynamics

Protocol-Level Interaction Risk Assessment and Mitigation (UIVP)

A bounded protocol audit and implementation-ready mitigation for intent ambiguity and escalation in deployed LLM systems.

TimeAlign v2: contamination-aware evals for small models (16GB GPUs)

Reusable, low-compute benchmarking that detects data leakage, outputs “contamination cards,” and improves calibration reporting.

From Nobel Signatures to Binding Red Lines: The 2026 Diplomatic Sprint

Leveraging 12 Nobel signatories to harmonize lab safety thresholds and secure an international agreement during the 2026 diplomatic window.

Formal Certification Technologies for AI Safety

Developing the software infrastructure to make AI systems safe, with formal guarantees

Runway till January: Amplify's funding ask to market EA & AI Safety 

Help us solve the talent and funding bottleneck for EA and AIS.

Retroactive: Presenting a poster at the ICML technical AI governance workshop

Operating Capital for AI Safety Evaluation Infrastructure

Enabling rapid deployment of specialized engineering teams for critical AI safety evaluation projects worldwide

Disentangling Political Bias from Epistemic Integrity in AI Systems

An Integrative Framework for Auditing Political Preferences and Truth-Seeking in AI Systems

Guaranteed Safe AI Seminars 2026

Seminars on quantitative/guaranteed AI safety (formal methods, verification, mech-interp), with recordings, debates, and the guaranteedsafe.ai community hub.

The Deal of the Century (for AI)

Persuading a critical mass of key potential influencers of Trump's AI policy to champion a bold, timely and proper US-China-led global AI treaty

Inspect Evals

Funding to cover our expenses for 3 months during unexpected shortfall

How to mobilize people on AI risk: experimental message testing

Experimental message testing and historical analysis of tech movements to identify how to effectively mobilize people around AI safety and governance

Fund a Fellow for the Cooperative AI Research Fellowship!

A 3-month fellowship in Cape Town, connecting a global cohort of talent to top mentors at MIT, Oxford, CMU, and Google DeepMind

Tarbell Center for AI Journalism

$200k in 1:1 matched funding to support reporting on AI.

When Safety Testing Costs More Than Model Training

Multi-agent AI security testing that reduces evaluation costs by 10-20x without sacrificing detection quality