Y Combinator's Geoff Ralston Launches New AI Safety Fund

Geoff Ralston, a prominent figure in the startup world through his long association with Y Combinator, has officially returned to active investing, as he announced on Thursday.

His new fund, named the Safe Artificial Intelligence Fund (SAIF), reflects its core mission while also serving as a clever acronym.

According to the fund's website, Ralston is targeting startups dedicated to "enhancing AI safety, security, and responsible deployment." He intends to issue $100,000 checks using a SAFE agreement—"pun intended," he notes—with a valuation cap of $10 million. A SAFE, famously developed by Y Combinator, is a simple agreement for future equity that defers valuation until a later funding round.

While venture capital interest in AI startups is widespread, Ralston’s approach is distinctly centered on safe AI, a focus he acknowledges is intentionally broad.

"Most AI projects today are designed to solve problems, boost efficiency, or create new capabilities. While not inherently unsafe, safety isn't their main priority," Ralston explained to TechCrunch. "My goal is to fund startups where safe AI is the primary objective, as I've defined it in very broad terms."

His investment scope includes companies focused on making AI safer, such as those improving transparency in AI decision-making or establishing safety benchmarks. It also covers tools that protect intellectual property, ensure regulatory compliance, combat disinformation, and detect AI-driven attacks. Additionally, he is interested in functional AI tools designed with built-in safety, like advanced AI forecasting systems or AI-powered negotiation platforms that safeguard corporate secrets.

Although this may resemble the investment thesis of other AI-focused VCs, Ralston is excluding certain areas. One clear example is fully autonomous weapons systems.

"There are undeniably unsafe applications of AI, such as designing bioweapons or managing conventional weapons without human oversight," he stated.

In fact, he aims to back "weapon safety systems" that can identify or prevent attacks from AI-controlled weapons.

This stance presents a contrasting perspective to many current defense tech founders and investors. As TechCrunch has covered, some developers of AI weapons are increasingly advocating for systems that operate independently of human control.

Despite the crowded AI investment landscape, Ralston believes his Y Combinator ties can provide an edge. He left YC in 2022 after a three-year term as president—succeeded by Garry Tan—and more than ten years as an advisor.

Ralston plans to offer the same kind of mentorship he provided at the renowned startup accelerator, including guidance on applying to Y Combinator. He also promises to help portfolio companies access his extensive network of investors.

Ralston has not disclosed the fund's size, the number of startups he plans to support, or the identities of his limited partners.