Destination Benchmark Tool & Pilot for Cork, Ireland and Durham, North Carolina

Welfare Red Teaming Competition

Crowdsourcing examples of where models do poorly on animal welfare so labs know what to fix

Scaling adoption of synthesis screening outside the US and EU

An outreach campaign from IBBIS to rapidly increase adoption of effective synthesis screening tools during a critical regulatory window.

Sentient Futures Project Incubator

Funding compute/API costs for Incubator projects that build nonhuman welfare consideration into AI safety work

safely.bio: Customer screening for DNA synthesis providers

Deploying customer screening software at DNA synthesis providers to reduce AI-enabled biothreats

Surrogate base model for Mechanistic Interpretability

Creating a reference model for mechanistic interpretability without assuming that at auditing time we have a safe model to compare the suspicious model against.

Preserving the Human Veto

Civil-society infrastructure against AI-enabled power concentration, built around autonomous weapons

Prediction of Inoculation Prompt Side Effects

An open, cheap method that detects when an inoculation prompt inoculates against off-target traits, so labs and developers can catch undesired trait/persona cha

Flourishing Futures Fellowship

A scalable fellowship training researchers to develop interventions for achieving high-value long-term futures

Token taxes as a mechanism for reducing AI-driven power concentration.

A policy memo, co-authored with the Institute for Public Policy Research, resolving the open technical, economic, and legal questions blocking real-world implem

Movement-building to make AGI go well

Sapiens First organizes voters to fight concentration of power and for AI safety

US Policy Communication Playbook for an AI Crisis

A playbook to help AI safety policy advocates communicate with the U.S. government during the window of opportunity during an AI-related crisis.

Launching Humans in Control's Student Program

Humans in Control (HIC), a nonpartisan grassroots advocacy organization supporting AI safeguards, is raising funds to start a student program

Formally verified autoresearch for theoretical mech interp

LLM agents collaborate to discover and formally verify theorems about the internal computations of transformers, beginning with a simple pilot question: how man

Formalizing mathematical AI safety research in Lean

A hand-verified library of AI-safety theorem statements in Lean 4 with AI-generated proofs, building the skills to trust AI formalization.

AI safety for builders hackathon / fellowship

AI safety for builder hackathon / fellowship - to build tools, products, etc.

AI and Wild Animal Governance

A Mechanistic Analysis of Activation Verbalizers: Promise and Risks

Analyze how activation verbalizers use target-model activation concepts via PCA/DAS/patching, explain cross-family failures, and improve verbalizers

A Single Line

A short documentary about what AI says is humanity's biggest moral blind spot.

Modelling Takeoff