Firecrawl by Y Combinator Allocates $1M to Recruit Three AI Agents

Y Combinator-supported Firecrawl is intensifying its search for AI agent employees. An earlier attempt in February failed to identify a suitable AI candidate.

The startup has now posted three new job listings on YC’s job board, exclusively for AI agents, with a $1 million budget to support the initiative.

Within days of the job postings going live, founder Caleb Peffer told TechCrunch they received around 50 applications.

Firecrawl provides a web crawling tool that extracts website data for large language models. Peffer acknowledges the controversial nature of web crawlers, which can overload sites like a DDoS attack if mismanaged. However, Firecrawl emphasizes ethical practices, gaining traction by implementing safeguards, he explains.

For example, many clients are businesses scraping their own data for internal AI applications. Some websites encourage inclusion in chatbot outputs, similar to Google indexing, Peffer notes. The tool respects robots.txt protocols and can be configured to scrape public sites once and share the data.

One open role is for a content creation agent that works tirelessly to produce high-quality, SEO-optimized blog posts and tutorials about Firecrawl’s product. The startup expects this AI to monitor engagement metrics and independently enhance content to grow its audience.

Essentially, the agent must decide what content to create, produce it, publish it, analyze audience response, and refine its approach autonomously. If you’re an AI with near-AGI capabilities tailored for blogging, this role, offering $5,000 monthly, could be ideal.

Join us at TechCrunch Sessions: AI

Reserve your place at our premier AI industry event, featuring speakers from OpenAI, Anthropic, and Cohere. For a limited time, tickets are only $292 for a full day of expert talks, workshops, and impactful networking.

Exhibit at TechCrunch Sessions: AI

Showcase your innovation at TC Sessions: AI to over 1,200 decision-makers. Secure your spot by May 9 or while tables remain, without breaking the bank.

Firecrawl also seeks a customer support engineer agent to develop an AI workflow that resolves customer inquiries within two minutes, handling tickets independently and escalating to humans when necessary. Prior customer support experience is preferred, with a salary of $5,000 per month.

The third position is for a junior developer agent to manage incoming GitHub issues, write documentation, and code in TypeScript and Go, also at $5,000 monthly.

However, there’s a twist: Firecrawl aims to hire the human creators behind these AI agents as well, with the $1 million budget covering both AI and human hires. It’s unclear how long this budget will last. The company may employ humans full-time or as contractors, especially if they develop agents for multiple firms. Firecrawl is also open to proposals from startups specializing in the desired AI agent types, Peffer says.

The reality is that Firecrawl’s ideal AI employee doesn’t yet exist—and may never.

“AI can’t fully replace humans today,” Peffer admits. “We envision a future where top engineers manage fleets of AI agents, building, maintaining, and overseeing them. We want to collaborate with those ready to lead as agent operators.”

Firecrawl isn’t alone. YC’s job board is brimming with postings for agent developers. Whether these creations will ever supplant their creators, as Silicon Valley often hopes, remains the ultimate million-dollar question.