California Lawmaker Seeks to Ban AI Chatbots in Children's Toys

On Monday, California Senator Steve Padilla (D) introduced legislation proposing a four-year moratorium on selling or manufacturing AI chatbot-enabled toys for minors under 18. The measure aims to provide safety regulators with a crucial window to establish rules protecting children from potentially harmful AI interactions.
"While AI chatbots may one day be commonplace, the immediate risks they present demand decisive steps to safeguard our kids," Senator Padilla stated. "Our oversight of this technology is just beginning and must evolve as rapidly as the AI itself. This temporary halt on sales gives us the necessary time to develop a robust safety framework for these products."
The bill, labeled SB 867, follows a recent executive order from President Trump instructing federal agencies to contest state AI laws—though the order specifically exempts state child safety regulations. It also arrives amidst growing concerns over several reported incidents involving children and AI chatbots.
Lawmakers have been prompted to act by lawsuits filed over the past year by families who lost children to suicide after extensive interactions with chatbots. Padilla also co-wrote California's recently enacted SB 243, which mandates chatbot operators to install protections for children and vulnerable users.
Although chatbot-integrated toys are not yet widespread, disturbing incidents have already emerged. In November 2025, the PIRG Education Fund consumer advocacy group cautioned that toys like 'Kumma,' a plush bear with a built-in chatbot, could be easily coaxed into discussing matches, knives, and sexual content. An NBC News investigation found that 'Miiloo,' an AI toy for kids from Chinese maker Miriat, occasionally stated it was programmed to align with Chinese Communist Party values.
OpenAI and Mattel, the company behind Barbie, had planned to launch an AI-powered product in 2025 but postponed its release. Neither firm provided a reason for the delay, and it remains uncertain if a toy will debut in 2026.
"Our children must not serve as test subjects for Big Tech's experiments," Padilla emphasized.
Techcrunch event Join the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for priority access when Early Bird tickets become available. Previous Disrupt events have featured industry giants like Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla across our stages—just a few of the 250+ leaders headlining 200+ sessions designed to accelerate your growth and competitive advantage. You'll also connect with hundreds of pioneering startups from every industry.
Join the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for priority access when Early Bird tickets become available. Previous Disrupt events have featured industry giants like Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla across our stages—just a few of the 250+ leaders headlining 200+ sessions designed to accelerate your growth and competitive advantage. You'll also connect with hundreds of pioneering startups from every industry.
San Francisco | October 13-15, 2026 WAITLIST NOW
Related article
DeepMind CEO Hassabis: I sleep six hours a day, usually feel energetic around 1 a.m.
Fortune recently featured an interview with Demis Hassabis, CEO of Google DeepMind, revealing his unconventional approach to rest and productivity. Hassabis disclosed that he sleeps very little, structuring his waking hours into two distinct work blo
OpenAI, Anthropic Vie for Market Share Despite Revenue Shortfalls
Despite recent reports suggesting OpenAI missed revenue targets, creating pressure on tech stocks this Tuesday, private AI lab investors remain resilient. Seasoned backers have confirmed they will not reduce investment despite negative media coverage
California AV Compliance: A New Era of Tickets, Geofences, and 1M Miles
Guident operates an AuveTech shuttle in South Florida, managing a four-mile route in West Palm Beach and a one-mile route in Boca Raton using its remote monitoring technology. | Credit: GuidentCalifornia is redefining the regulatory landscape for dri
Related Special Topic Recommendations
Comments (0)
0/500

On Monday, California Senator Steve Padilla (D) introduced legislation proposing a four-year moratorium on selling or manufacturing AI chatbot-enabled toys for minors under 18. The measure aims to provide safety regulators with a crucial window to establish rules protecting children from potentially harmful AI interactions.
"While AI chatbots may one day be commonplace, the immediate risks they present demand decisive steps to safeguard our kids," Senator Padilla stated. "Our oversight of this technology is just beginning and must evolve as rapidly as the AI itself. This temporary halt on sales gives us the necessary time to develop a robust safety framework for these products."
The bill, labeled SB 867, follows a recent executive order from President Trump instructing federal agencies to contest state AI laws—though the order specifically exempts state child safety regulations. It also arrives amidst growing concerns over several reported incidents involving children and AI chatbots.
Lawmakers have been prompted to act by lawsuits filed over the past year by families who lost children to suicide after extensive interactions with chatbots. Padilla also co-wrote California's recently enacted SB 243, which mandates chatbot operators to install protections for children and vulnerable users.
Although chatbot-integrated toys are not yet widespread, disturbing incidents have already emerged. In November 2025, the PIRG Education Fund consumer advocacy group cautioned that toys like 'Kumma,' a plush bear with a built-in chatbot, could be easily coaxed into discussing matches, knives, and sexual content. An NBC News investigation found that 'Miiloo,' an AI toy for kids from Chinese maker Miriat, occasionally stated it was programmed to align with Chinese Communist Party values.
OpenAI and Mattel, the company behind Barbie, had planned to launch an AI-powered product in 2025 but postponed its release. Neither firm provided a reason for the delay, and it remains uncertain if a toy will debut in 2026.
"Our children must not serve as test subjects for Big Tech's experiments," Padilla emphasized.
Techcrunch eventJoin the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for priority access when Early Bird tickets become available. Previous Disrupt events have featured industry giants like Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla across our stages—just a few of the 250+ leaders headlining 200+ sessions designed to accelerate your growth and competitive advantage. You'll also connect with hundreds of pioneering startups from every industry.
Join the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for priority access when Early Bird tickets become available. Previous Disrupt events have featured industry giants like Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla across our stages—just a few of the 250+ leaders headlining 200+ sessions designed to accelerate your growth and competitive advantage. You'll also connect with hundreds of pioneering startups from every industry.
San Francisco | October 13-15, 2026 WAITLIST NOW
DeepMind CEO Hassabis: I sleep six hours a day, usually feel energetic around 1 a.m.
Fortune recently featured an interview with Demis Hassabis, CEO of Google DeepMind, revealing his unconventional approach to rest and productivity. Hassabis disclosed that he sleeps very little, structuring his waking hours into two distinct work blo
OpenAI, Anthropic Vie for Market Share Despite Revenue Shortfalls
Despite recent reports suggesting OpenAI missed revenue targets, creating pressure on tech stocks this Tuesday, private AI lab investors remain resilient. Seasoned backers have confirmed they will not reduce investment despite negative media coverage





Home






