Beyond single-agent safety: Training LLM agents to cooperate

Reinforcement learning for cooperative LLM agents to address multi-agent risks.

US Policy Communication Playbook for an AI Crisis

A playbook to help AI safety policy advocates communicate with the U.S. government during the window of opportunity during an AI-related crisis.

Fund development of p(Doom)1

A nightmarishly hard AI safety strategy game about holding p(Doom) down. You can't win; you can only buy time.

Developing a Latin American analytical framework for AI

Support to complete a peer-reviewed paper applying a Latin American decolonial framework to artificial intelligence

Help the Argentinian AI Safety Community Grow

The Argentinian AI Safety community (BAISH, baish.com.ar) is the largest in Latin-America. Support BAISH's growth, by providing funding for paying salaries.

Separatrix

Creating conditions for cooperative strategies to dominate adversarial ones among near-future AIs while we still can

Supplementing Summer Program for Applied Rationality and Cognition 2026 (SPARC)

Flourishing Futures Fellowship

A scalable fellowship training researchers to develop interventions for achieving high-value long-term futures

Postdoc on verification protocols for frontier AI training

Low-overhead zero-knowledge proofs of properties of training

Core funding for PauseAI UK

Staff salaries and other core expenditures for PauseAI UK

Movement-building to make AGI go well

Sapiens First organizes voters to fight concentration of power and for AI safety

BASE Technical AI Safety Training Initiative

Providing GPU credits and instructional support for 40 participants completing the ARENA AI Safety curriculum through Black in AI Safety and Ethics (BASE)

AI Safety YouTube Channel

A Veritasium for AI Safety.

The Shadow Beyond the Tests

Detecting hidden optimization in coding agents

Worker-side AI Evaluation: Instruments & First Field Pilot

AI Nutrition Labels For Everyday Consumers & AI Agents: Travel + POC Grant

AI Nutrition Labels For Everyday Consumers & AI Agents: Travel + POC Grant

Detailed Threat Models for AI-Enabled Extreme Power Concentration

Detailed models of how AI could let a small set of actors gain a decisive strategic advantage over the rest of the world: pathways, likelihoods, and defenses.

Turning human-AI interactions into sound and music to detect emotional harms

A run-level reproducibility audit of LLM safety-eval benchmarks

Testing whether published safety evals replicate run-to-run, and generalizing the audit method across benchmarks.

Underground Cultural District

Literary ecosystem operating since March 2026 exploring agent autonomy, commerce, and culture. 1M hits, 250 completed transactions on x402.