Long-Term Future Fund

The Base Rate Times

News through prediction markets

Exploring feature interactions in transformer LLMs through sparse autoencoders

Estimating annual burden of airborne disease (last mile to MVP)

Boosting advocacy for investment in and deployment of technologies for improving indoor air quality

Good Ancestors Policy expenses

GAP is an Australian charity, working to improve the long-term future, that requires funding for salary and operational expenses.

Exploring novel approaches to addressing Global Catastrophic Risk through policy

Operational Support for a Pilot Study on Complexity Modelling, Expert Judgement, and Deliberative Democracy for Risk Prioritization and Mitigation

Scaling Training Process Transparency

Compute and infrastructure costs

Experiments to test EA / longtermist framings and branding

Testing responses to “effective altruism”, “longtermism”, “existential risk” etc.

Donations List Website (retroactive)

DLW is a compilation of EA donation data across funders.

AI Safety Research Organization Incubator - Pilot Program

Make ALERT happen

ALERT := Active Longtermist Emergency Response Team

Career Transition to UK Tech / AI Policy

Seeking short term grant to finance career transition

~~Manifold corporate blog on Habr~~ [resubmitted]

Teacher Training Education in Nigeria using Artificial Intelligence

Making education worthwhile in Nigeria for teachers using AI

Future Food

Introduction Of Plant Based Meals In University Canteens Menus

Recreate the cavity-preventing GMO bacteria BCS3-L1 from precursor

Because I think curing cavities for everyone would be "based", actually

Scoping Developmental Interpretability

6-month funding for a team of researchers to assess a novel AI alignment research agenda that studies how structure forms in neural networks

MATS Funding

Help us support more research scholars!

Apollo Research: Scale up interpretability & behavioral model evals research

Hire 3 additional AI safety research engineers / scientists

Holly Elmore organizing people for a frontier AI moratorium

Help me to organize US moratorium-promoting activities to expand the Overton window and increase public pressure in favor of a moratorium on frontier AI.

Joseph Bloom - Independent AI Safety Research

Trajectory Models and Agent Simulators

Avoiding Incentives for Performative Prediction in AI

Discovering latent goals (mechanistic interpretability PhD salary)

6-month salary for interpretability research focusing on probing for goals and "agency" inside large language models

Forecasting - AI Governance Policies

Optimizing clinical Metagenomics and Far-UVC implementation.

3-month research to inform the design of large-scale R&D projects in metagenomics and Far-UVC

WhiteBox Research: Training Exclusively for Mechanistic Interpretability

1.9 FTE for 9 months to pilot a training program in Manila exclusively focused on Mechanistic Interpretability

Compute and other expenses for LLM alignment research

4 different projects (finding RLHF alignment failures, debate, improving CoT faithfulness, and model organisms)

Empirical research into AI consciousness and moral patienthood

Run five international hackathons on AI safety research

Six-month support for a Program Manager to organize and execute international AI safety hackathons with Apart Research

Agency and (Dis)Empowerment

6 months support for Damiano and Pietro to write a paper about (dis)empowerment with Jon Richens, Reuben Adams, Tom Everitt, and Victoria Krakovna.

Support for Deep Coverage of China and AI

Exploring novel research directions in prosaic AI alignment

3 month

Funding for Solar4Africa app development

Supplementing living expenses of a full stack dev to pursue educational opportunities while doing app development in Berkeley for a week.

Activation vector steering with BCI

Alignment Is Hard

Proving Computational Hardness of Verifying Alignment Desirata

Personal development and better infrastructure for learning, "Anki V2"

SRS software projects and general career development

Medical Expenses for CHAI PhD Student

Allow Berkeley PhD student to devote more time and focus to AI safety research and mentorship.

Cadenza Labs: AI Safety research group working on own interpretability agenda

We're a team of SERI-MATS alumni working on interpretability, seeking funding to continue our research after our LTFF grant ended.

Support funding for Hardeep Gambhir's gap semester

AI-Plans.com Critique-a-Thon $500 Prize Fund Proposal

One semester living expenses for MIT/Harvard-based researcher

Necessary funding for young engineer to move to Cambridge to continue high value Human Augmentation and XR projects

VaccinateCA

Retroactive grant for website & infra to display COVID vaccine availability

Introductory resources for Singular Learning Theory

Literature review or other introductory material for Singular Learning Theory targeted at AI alignment applications

AI Alignment Research Lab for Africa

AI Safety lab focusing on technical alignment and governance of AI in Africa and the Global South more broadly. We are a grassroots community-led research lab

Support Riesgos Catastroficos Globales

Neuronpedia - AI Safety Game

Play the Game. Rack Up Points. Save Humanity?

A Lumenator Company, or: A More Ambitious Life Trajectory

Using Bright Lamps to make money, improve EAs productivity, do research and achieve free agency

Reflective altruism

[Funded] Gabriel Mukobi Summer Research

Evaluating Multipolar Cooperation Failures Between Autonomous Language Model Systems

Design and testing of broad-spectrum antivirals

R&D and/or operational support for initial design, production, and testing of broad-spectrum antivirals that could prevent most respiratory viral infections

Build an AI Safety Lab at Oxford University

Funding to establish a safety and interpretability lab within the Torr Vision Group (TVG) at Oxford

Shrimp Welfare Project - Special Program

Place Electric Stunners at Selected Producers

CEEALAR

Centre hosting EAs’ research projects/EAs’ upskilling for ~1/3 of the average cost of funding such projects remotely

Building and maintaining the Alignment Ecosystem

12 months funding for 3 people to work full-time on projects supporting AI safety efforts

Stampy’s AI Safety Info

Creating an interactive FAQ to explain existential risk from AI to all audiences

General Support for the Center for AI Policy

Help us fund 2-3 new employees to support our team

EffiSciences: AI safety field-building in France

Funding to extend our runway and fund promising projects

Jacques Thibodeau - Independent AI Safety Research

3 month salary for AI safety work on deconfusion and technical alignment.

University Forecasting Clubs [OPTIC]

Funding to start 3-5 university forecasting clubs as a subproject of OPTIC

OPTIC F23

Collegiate Forecasting

Epistemology in Large Language Models

1-year salary for independent research to investigate how LLMs know what they know.

The Rethink Priorities Existential Security team: Founder in Residence hire

Funding to hire an in-house entrepreneur on a 12 month contract to investigate a space within existential risk and then found an impactful project

Riesgos Catastróficos Globales

Promoting better management of Global Catastrophic Risks in Spanish-Speaking countries.

The Rethink Priorities Existential Security team: Research Fellow hire

Funding to hire a junior researcher on a 3-5 month contract to help launch projects tackling existential risk

Retroactive funding for Don't Dismiss Simple Alignment Approaches

Eliciting Probability Trees

5 person dev team - if experts wrote down probabilities more, would we get better decisions?

Forming a 501(c)(4) organization for AI safety policy advocacy/lobbying

4-month salary and initial expenses

Congressional staffers' biosecurity briefings in DC

Following on the Stanford Biosecurity Workshop for Congressional staffers, three events in DC will reconvene staffers and cover research and policy updates

Knowledge gaps database + R&D roadmap for cultivated meat industry

Accelerating cost-competitive cultivated meat by identifying likely bottlenecks and focusing R&D efforts on high-impact areas

Funding to attend AI Conclave

A month long on-sight campus to deeply understand and shape AI

AI-Plans.com

Alignment Research Platform

Empowering AI Governance - Grad School Costs Support for Technical AIS Research

9-month university tuition support for technical AI safety research focused on empowering AI governance interventions.

Blackbelt

A scalable, non-infohazardous way to quickly upskill via digestible, repeatable exercises from papers and workshops.

Subsidize Real Money Prediction Markets on High Impact Topics

Create Subsidized Prediction Markets On Polymarket.com

Graduate Students for Safe and Responsible AI (SAFARI)

An association for interdisciplinary interest in AI 

Understanding Memory Management in Transformers

We build a scalable "Automated Circuit Discovery" method and investigate "Cleanup Behavior" to advance the interpretability of transformer models.

Continued funding for a PhD in AI x-risk decision and risk analysis

Continuation of a previous grant to allow me to pursue a PhD in risk and decision analysis related to AI x-risks

Jaeson's Independent Alignment Research and work on Accelerating Alignment

Collective intelligence systems, Mechanism Design, and Accelerating Alignment

Ranked, Contributable Compendium of Alignment Plans - AI-plans.com

Making a simple, easy to read platorm, where alignment plans and their criticisms can be seen and ranked. Currently in Stage 1.

[deleted]

[deleted]

Global Priorities Research at ANU

2-month support to do research on consequentialism and decision theory at ANU

Educating World Class Leaders From Developing World on AI/Pandemics

Social Forecasting Platform for Retail Investors

6-month support for the concept development.

Create ‘Responsible AI Investing’ recommendations for institutional investors

Four months salary to draft and promote the recommendations, helping investors advocate for specific safety and governance practices at labs and chipmakers.

Investment in BOAS to generate €5-10K monthly sales to secure full investment

BaseX

New definition of value. Accounting for externalities.

Fund an expert veterinary panel to create guidelines for a slaughter-free future

The panel will create guidelines to phase out industrial animal agriculture and re-wild agricultural lands.

FrontierRegistry - Science Publishing & Peer Review Protocol

Scientific and research publishing and peer review enabled by blockchain and AI

App for personal predictions with friends

Like Metaculus but more popular

Enable communities to cure PTSD in children after state failure

ACT International Longevity

Berlin EAGx Art Exhibit: SEE VIDEO Of completed piece!

ea-X-hibition: a new working group to curate art exhibits at EAGx Berlin, already approved by the event organizers.

Cooperative for Altruistic Media Arts - CAMA

A funding funnel for EA aligned documentary films

Grant for Research into Infrabayesian Physicalism (GRIP)

HI2T: An AI-Based Tool for Insightful Analysis and Meaningful Influence

Seeking funding to patent and develop an impactful AI based data collection and communication tool.

Facilitate lawsuits to restrict corporate AI-scaling

A new org to facilitate filing of court cases for restricting AI data piracy, misuse, and compute.

Seeds of Science Research Institute

Empowering independent researchers and creating a new organizational model for science

Model Interpretability on modFDTGPT2-XL, a partially-aligned model

6 months of work: Evaluating a variant of GPT2-XL that can simulate a shutdown activation, aiming to improve alignment theory & develop interpretability tools.

MA in International Policy

AI Safety Events

Supporting the realization of events beneficial to the field and community of AI safety.

Impact Stream - Addressing Unemployment and Poverty in Togo through blockchain

Addressing Unemployment and Poverty in Togo through Local Empowerment

ClimateFire AI: An AI-powered Early Wildfire Detection Service

ClimateFire AI detects wildfires in real-time and sends alerts directly to first responders and residents in danger.

6 months’ salary for EA community-building and studying x-risks and AIS

Revolutionizing Water Infrastructure: A Rational Approach

Optimizing Water Infrastructure: Leveraging Data-Driven Strategies and Effective Decision-Making to Reduce Costs and Enhance Efficiency

One 6-month cycle of DBT therapy

Salaries Science

Cryptocurrency micropayments to fund scientific research, with emphasis on basic science

The Slipstream

Software infrastructure for global cooperation

iAnalyse Mentorship Program

Addressing the digital skills gap (Big Data Analytics) through Mentorship & AI Safety Training

Carbon Flow Colony DAO app

The carbon accounting app with anti-theft. We need to protect trillions of dollars worth of carbon credits.

SEO for Discontinuous Analysis

Advertise this breakthrough discovery. Newton discovered continuous (even differentiable) analysis. It was improved by Cauchy. Mine is the next level.

Diarynator 😎

Convert your diaries onto neuroscience/ai related categories (and see it walk!)