I currently work on economic theory and alignment at the UK AI Security Institute (AISI), where we funded Principled Agents through the Alignment Project. I'm writing here in a personal capacity.

The alignment problem needs formal work (linked with empirical evidence) to progress. Economic theory is currently an under-researched avenue for understanding incentives and model behaviour, particularly in a way that will stay relevant for future, more capable models.

Rubi is one of a small number of people making progress in this area. He has been working seriously on alignment for a long time, and combines rigorous conceptual thinking in economics with a strong understanding of and engagement with the AI safety community. High-context work at this intersection is rare. I know Rubi well and rate his research and his agenda very highly. I would like to see this work fully funded, and a lot more investment in this kind of research.