Manifund foxManifund
Home
Login
About
People
Categories
Newsletter
HomeAboutPeopleCategoriesLoginCreate
header image

Technical AI safety

10 proposals
49 active projects
$2.53M
Grants125Impact certificates20

Seeking funding

robertzk avatar

Robert Krzyzanowski

Unprompted Unfaithful Chain of Thought Dataset Project

Technical AI safety
2
1
$2K/$2K
agusmartinez92 avatar

Agustín Martinez Suñé

SafePlanBench: evaluating a Guaranteed Safe AI Approach for LLM-based Agents

Seeking funding to develop and evaluate a new benchmark for systematically assesing safety of LLM-based agents

Technical AI safetyAI governance
1
0
$0/$14K
rguerreschi avatar

Rufo guerreschi

Coalition for a Baruch Plan for AI

Catalyzing a uniquely bold, timely and effective treaty-making process for AI

Technical AI safetyAI governanceGlobal catastrophic risks
1
0
$0/$25K
midfieldai avatar

Abhinav singh

AI Safety & Security workshop with Adversarial Simulation labs

Workshop focused on AI Security attacks and defense use-cases through a Capture-the-flag style Adversarial simulation labs.

Technical AI safetyAI governance
1
0
$0/$20K
remmelt avatar

Remmelt Ellen

11th edition of AI Safety Camp

Cost-efficiently support new careers and new organisations in AI Safety.

Technical AI safetyAI governance
17
13
$680/$300K
sableye avatar

Jay Luong

Help me to attend a spring school on AI that I am coorganising

Travel/Accommodation support for a lead coorganiser of the Ethos+Tékhnē spring school

Science & technologyTechnical AI safetyAI governanceGlobal catastrophic risks
2
0
$0/$1K
🍓

James Lucassen

More Detailed Cyber Kill Chain For AI Control Evaluation

Extending an AI control evaluation to include vulnerability discovery, weaponization, and payload creation

Technical AI safety
3
2
$6K/$6K
🍓

James Lucassen

LLM Approximation to Pass@K

Technical AI safety
3
4
$2K/$3K
🦑

Epoch AI

Pilot for new benchmark by Epoch AI

For tracking and predicting future AI progress to AGI

Technical AI safetyAI governance
2
2
$200K
Arkose avatar

Arkose

Arkose

AI safety outreach to experienced machine learning professionals

Science & technologyTechnical AI safetyGlobal catastrophic risks
4
0
$10/$383K
Mikolaj-Kniejski avatar

Mikolaj Kniejski

Shallow review of cost-effectivness of technical AI safety orgs

Do ACE-style cost-effectivness analysis of technical AI safety orgs.

Technical AI safetyAI governance
3
7
$1.3K/$3K
iarcuschin avatar

Iván Arcuschin Moreno

Mechanistic Interpretability research for unfaithful chain-of-thought (1 month)

Iván and Jett are seeking funding to research unfaithful chain-of-thought, under Arthur Conmy's mentorship, for a month before the start of MATS.

Technical AI safety
2
2
$11K
michaeltrazzi avatar

Michaël Rubens Trazzi

Finishing The SB-1047 Documentary

How California became ground zero in the global debate over who gets to shape humanity's most powerful technology

Science & technologyTechnical AI safetyAI governance
13
9
$67.6K
ampdot avatar

ampdot

Act I: Exploring emergent behavior from multi-AI, multi-human interaction

Community exploring and predicting potential risks and opportunities arising from a future that involves many independently controlled AI systems

Technical AI safetyEA Community ChoiceForecastingGlobal catastrophic risks
27
98
$67.8K
Piotr avatar

Piotr Zaborszczyk

AI safety fieldbuilding in Warsaw, Poland (funding for 1 semester)

Reach the university that trained close to 20% of OpenAI early employees

Technical AI safetyGlobal catastrophic risks
5
5
$10K
JorgenLjones avatar

Jørgen Ljønes

80,000 Hours

We provide research and support to help people move into careers that effectively tackle the world’s most pressing problems.

Technical AI safetyAI governanceBiosecurityEA Community ChoiceEA communityGlobal catastrophic risks
12
13
$4.92K
habryka avatar

Oliver Habryka

Lightcone Infrastructure

Funding for LessWrong.com, the AI Alignment Forum, Lighthaven and other Lightcone Projects

Science & technologyTechnical AI safetyAI governanceEA Community ChoiceEA communityForecastingGlobal catastrophic risks
35
28
$80.9K

Unfunded Projects

orpheus avatar

Orpheus Lummis

Horizon Events 2025

Non-profit facilitating progress in AI safety R&D through events

Technical AI safetyGlobal catastrophic risks
6
6
$0
Gautier-DUcurtil avatar

Gautier Ducurtil

Launching an AI safety org at a top French coding school + funding my studies

I need to focus myself on my studies and on creating AI Safety projects without having to take a dead-end job to fund them.

Science & technologyTechnical AI safetyAI governance
1
0
$0
Apart avatar

Apart Research

Apart Research: Research and Talent Acceleration

Support the growth of an international AI safety research and talent program

Science & technologyTechnical AI safetyAI governanceEA communityGlobal catastrophic risks
6
1
$0