“Help us find founders for new AI safety projects” by lukeprog

In the past 10 years, Coefficient Giving (formerly Open Philanthropy) has funded dozens of projects doing important work related to AI safety / navigating transformative AI. And yet, perhaps most activities that would improve expected outcomes from transformative AI have no significant project pushing them forward, let alone multiple.

This is mainly because we and other funders in the space don't receive promising applications for most desirable activities, and so massive gaps in the ecosystem remain, for example: [[1]]

• Policy development, advising, and advocacy in many important but currently neglected countries.
• Projects to develop and advocate for better model specifications.
• Projects to fill key gaps in AI infosecurity, e.g. software to allow the ~entire frontier AI model development and deployment workflow to run in a confidential computing environment, or router software that would improve companies' ability to detect and block weight exfiltration attempts.
• Projects developing and deploying new tools for detecting and monitoring dangerous AI behaviors in the wild.
• Projects to build better de-escalation mechanisms for companies and countries, a la Catalink.
• Projects to build a more robust incident tracking and reporting ecosystem.
• Projects to build and promote new [...]

The original text contained 1 footnote which was omitted from this narration.

---

First published:
December 4th, 2025

Source:
https://www.lesswrong.com/posts/uKfvwT3PjwZhAtcjW/help-us-find-founders-for-new-ai-safety-projects

---

Narrated by TYPE III AUDIO.