Flourishing Futures Fellowship

A scalable fellowship training researchers to develop interventions for achieving high-value long-term futures

Movement-building to make AGI go well

Sapiens First organizes voters to fight concentration of power and for AI safety

Modelling Takeoff

Mechanistic estimation of highly out-of-distribution behaviors

Discrete/Symbolic Language Modeling

Making sure that the code AI pushes to the internet is safe and bug-free

Building LemmaScript, a verification toolchain for TypeScript

Core funding for PauseAI UK

Staff salaries and other core expenditures for PauseAI UK

Interpreting Latent Reasoning Models with Natural Language Autoencoders

Creating a better way to compile to transformer architectures

Theoretical research of inductive reasoning building on LTA

Testing failure modes of debate-style AI control schemes

Development time for next film project

Debate training on LLMs as a reward-hacking mitigation

AFFINE Event-Prep

Runway for the core staff to design the program, find mentors and get funding

Alignment Target Analysis