California Lawmaker Seeks to Ban AI Chatbots in Children's Toys

On Monday, California Senator Steve Padilla (D) introduced legislation proposing a four-year moratorium on selling or manufacturing AI chatbot-enabled toys for minors under 18. The measure aims to provide safety regulators with a crucial window to establish rules protecting children from potentially harmful AI interactions.

"While AI chatbots may one day be commonplace, the immediate risks they present demand decisive steps to safeguard our kids," Senator Padilla stated. "Our oversight of this technology is just beginning and must evolve as rapidly as the AI itself. This temporary halt on sales gives us the necessary time to develop a robust safety framework for these products."

The bill, labeled SB 867, follows a recent executive order from President Trump instructing federal agencies to contest state AI laws—though the order specifically exempts state child safety regulations. It also arrives amidst growing concerns over several reported incidents involving children and AI chatbots.

Lawmakers have been prompted to act by lawsuits filed over the past year by families who lost children to suicide after extensive interactions with chatbots. Padilla also co-wrote California's recently enacted SB 243, which mandates chatbot operators to install protections for children and vulnerable users.

Although chatbot-integrated toys are not yet widespread, disturbing incidents have already emerged. In November 2025, the PIRG Education Fund consumer advocacy group cautioned that toys like 'Kumma,' a plush bear with a built-in chatbot, could be easily coaxed into discussing matches, knives, and sexual content. An NBC News investigation found that 'Miiloo,' an AI toy for kids from Chinese maker Miriat, occasionally stated it was programmed to align with Chinese Communist Party values.

OpenAI and Mattel, the company behind Barbie, had planned to launch an AI-powered product in 2025 but postponed its release. Neither firm provided a reason for the delay, and it remains uncertain if a toy will debut in 2026.

"Our children must not serve as test subjects for Big Tech's experiments," Padilla emphasized.

Join the Disrupt 2026 Waitlist

Secure your spot on the Disrupt 2026 waitlist for priority access when Early Bird tickets become available. Previous Disrupt events have featured industry giants like Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla across our stages—just a few of the 250+ leaders headlining 200+ sessions designed to accelerate your growth and competitive advantage. You'll also connect with hundreds of pioneering startups from every industry.

Join the Disrupt 2026 Waitlist

Secure your spot on the Disrupt 2026 waitlist for priority access when Early Bird tickets become available. Previous Disrupt events have featured industry giants like Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla across our stages—just a few of the 250+ leaders headlining 200+ sessions designed to accelerate your growth and competitive advantage. You'll also connect with hundreds of pioneering startups from every industry.