AI Security Startup Accelerator Batch #2

Funding 5–10 AI security startups through Seldon’s second SF cohort.

From Nobel Signatures to Binding Red Lines: The 2026 Diplomatic Sprint

Leveraging 12 Nobel signatories to harmonize lab safety thresholds and secure an international agreement during the 2026 diplomatic window.

Evaluating Model Attack Selection and Offensive Cyber Horizons

Measuring attack selection as an emergent capability, and extending offensive cyber time horizons to newer models and benchmarks

Progress Studies YouTube Channel

Project B2-Boop: Gamifying Instrumental Convergence & Reward Hacking

A virtual pet simulator that teaches reinforcement learning failures through simple and fun interactions.

Course Buyouts to Work on AI Forecasting, Evals

Retroactive: Presenting a poster at the ICML technical AI governance workshop

Formal Certification Technologies for AI Safety

Developing the software infrastructure to make AI systems safe, with formal guarantees

FloraForge: Aesthetic Gene Editing in Petunias

A modular gene-editing platform for engineering new pigment patterns in ornamental plants, starting with a vein-pattern rescue line in petunias.

Visa fee support for Australian researcher to join a fellowship with Anthropic

Runway till January: Amplify's funding ask to market EA & AI Safety 

Help us solve the talent and funding bottleneck for EA and AIS.

CaML - AGI alignment to nonhumans

Training AI to generalize compassion for all sentient beings using pretraining-style interventions as a more robust alternative to instruction tuning

Fund thebes' model tinkering

Research, tutorial writing, and open-source libraries & tools for experimenting with language models

Operating Capital for AI Safety Evaluation Infrastructure

Enabling rapid deployment of specialized engineering teams for critical AI safety evaluation projects worldwide

Screwworm Free Future: Seizing the Eradication Window

Accelerate eradication of the New World Screwworm from South America via research, coordination, and advocacy around safe development of gene-drives

Good Ancestors (Australia)

Advocate for Australian policies that safeguard against global catastrophic risks – including pandemics, AI risks, and catastrophic disasters.

SDCPNs for AI Safety

Developing correct-by-construction world models for verification of frontier AI

Software to detect data fabrication

Continue developing ‘copy-paste-detective’ - a software that detects signs of data fabrication in scientific research - and run it against 20,000 publicly available Excel datasets.

Disentangling Political Bias from Epistemic Integrity in AI Systems

An Integrative Framework for Auditing Political Preferences and Truth-Seeking in AI Systems

More End Kidney Deaths campaigning

Continue leading a national campaign to pass the End Kidney Deaths Act (H.R. 2687), a bill projected to save 100,000 lives and $37B in taxpayer costs over the next decade.