Project summary

Note: ChatGPT and, to a larger extent, Claude were used to revise and edit drafts over several iterations and contributed to arguments, categorisations and literature checks. The Abstract is referencing the current state of the draft to show what we are currently focusing on.

Abstract

Intelligence is assumed to help an agent build an accurate understanding of the world and make wise decisions. Evolutionary dynamics such as diversification of traits and recursive selection pressures indicate limitations to how globally intelligent, insightful and moral (i.e. compassionate) agents can become while maintaining overall high levels of influence.

Causes of limited cognition and kinds of failure, such as false beliefs, are explored together with the selection mechanisms that produce them.

The analysis is applied to humans, other animals and trained AI systems, and potential consequences are discussed. Neither cognitively enhanced humans nor more capable AI systems are expected to reach evaluative judgement free of the distortions of the process that produced them. Mitigation potential might be limited in effectiveness and scope, especially across long timelines.

https://compassionate-future.org/how-evolution-restricts-intelligence-insight-wisdom-and-compassion/

What are this project's goals? How will you achieve them?

The goal is to contribute with foundational insights to serve suffering focused AI alignment work.

With the research I want to

1. Map out which selection mechanisms produce which kinds of cognitive and evaluative failures

2. Assesses how far mitigation can go, given that an agent trying to change selection processes is itself affected by evolutionary pressures.

Method:

1. literature synthesis across evolutionary biology, cognitive science and AI alignment;

2. Publishing results for critique and dialogue, followed by revision after feedback from researchers and the suffering focused community.
   

How will this funding be used?

• Sustain the CFI (my) working infrastructure

• Research and writing time investment

• Conference contributions: travel cost and accommodation

Who is on your team? What's your track record on similar projects?

Ruth Seleo (me), founder of the Compassionate Future Initiative (CFI), a suffering-focused nonprofit.

• Founded CFI and have run it largely alone, covering strategy, research, communications and technical work.

• Organised the Compassionate Future Summits 2025 and 2026.

What are the most likely causes and outcomes if this project fails?

Slower progress, lower quality work and less reach.

How much money have you raised in the last 12 months, and from where?

0$ relevant for this specific project.