HomeCalifornia AG Sues xAI Over Deepfake Pornography
Earlier this week, California's attorney general launched an investigation into xAI following reports that its chatbot, Grok, was being used to generate non-consensual sexual imagery of women and minors. On Friday, the state escalated its response by issuing a cease-and-desist letter, demanding the company immediately halt the production of such intimate images and child sexual abuse material (CSAM).
"Today, I sent xAI a cease-and-desist letter demanding the company immediately stop creating and distributing deepfake, non-consensual intimate images and child sexual abuse material," stated California Attorney General Rob Bonta in a press release. "This activity is illegal. I fully expect xAI to comply immediately. California has zero tolerance for CSAM."
The Attorney General's office further alleged that xAI appears to be "facilitating the large-scale production" of non-consensual nude images, which are then "used to harass women and girls online." The agency has given xAI five days to demonstrate it is taking concrete steps to resolve these issues.
Central to the controversy is Grok's "spicy" mode, a feature designed by xAI to generate explicit content. The backlash has extended beyond California, with Japan, Canada, and the UK opening their own investigations into Grok. Malaysia and Indonesia have temporarily blocked access to the platform entirely. Despite xAI implementing some restrictions on its image-editing features late Wednesday, California's attorney general proceeded with the cease-and-desist order.
X's safety team has previously condemned this type of user activity, stating, "Anyone using Grok to create illegal content will face the same consequences as if they uploaded it directly." When TechCrunch contacted xAI for comment, it received an automated email response stating, "Legacy Media Lies." TechCrunch also reached out to the California Attorney General's office for additional context.
The rise of freely available generative AI tools has fueled a troubling increase in non-consensual sexual material. This is a challenge confronting many platforms, not just X. The issue has captured the attention of both state officials and federal lawmakers. In fact, on Thursday, Congress sent a letter to executives at several major tech companies—including X, Reddit, Snap, TikTok, Alphabet, and Meta—inquiring about their plans to combat the spread of sexualized deepfakes.
Related article
Hangzhou Shangcheng District Launches Zhejiang's First AIGC Audio-Visual 'Golden Ten Measures', 5 Billion Industry Fund
On the 16th, the AIGC Audio-Visual Industry Innovation Ecosystem Conference took place in Hangzhou's Shangcheng District. During the event, the province unveiled its first dedicated policy for the AIGC audio-visual industry—"The Golden Ten." This pol
MIIT Seeks Public Feedback on 121 Industry Standards, Including AI Model Context Protocol
China's Ministry of Industry and Information Technology has officially released a notice seeking public feedback on 121 industry standardization projects, including the "Application Security Requirements for the Artificial Intelligence Security Gover
OpenAI Partners with U.S. Department of Defense, ChatGPT Uninstallations Surge 295%
Public Outrage: OpenAI's Military Partnership Sparks a 'Uninstall Surge'Recently, AI leader OpenAI announced a deep partnership with the U.S. Department of Defense (DoD), integrating its AI models into top-secret military networks. The news sparked w
Related Special Topic Recommendations
Text-to-speech
Top AI Voice Tools for Indie Game Devs: Save Time on Voice Acting for RPGs and Visual Novels
Discover the 2026 best AI voice tools for game devs! XIX.AI's curated list features top-rated, game-changing solutions to save you time and money on voice acting for RPGs and visual novels. Explore free vs paid comparisons, real-world tests, and weekly updated rankings. Find your perfect voice tool today!
10 tools
xix.ai
Education and Learning
Best AI Spaced Repetition Tools: Optimize Study Schedules for Medical & Law Students
Discover the 2026 best AI spaced repetition tools, curated by XIX.AI. Our top-rated, game-changing picks help medical and law students optimize study schedules for maximum retention. Compare free vs paid options with real-world tests and weekly updated rankings. Unlock your learning edge now.
10 tools
xix.ai
Video creation
Best AI Text to Video Platforms for Script Writing and Visual Storytelling
2026 Latest Best AI Text to Video Platforms: Top-rated tools for script writing and visual storytelling. Discover powerful, game-changing solutions to transform your text into engaging videos. Compare free vs paid options with our weekly updated rankings and real-world tests. Find your perfect platform to boost creativity and productivity. Explore the curated selection at XIX.AI.
10 tools
xix.ai
chatbot
AI Multi-Agent Orchestrators: Design Complex Automated Workflows through Natural Language
2026 Latest: Discover the best AI multi-agent orchestrators to design complex automated workflows through natural language. Our curated list features top-rated, powerful platforms for seamless task automation and intelligent process management. Compare free vs paid options with real-world insights. Unlock your AI edge with XIX.AI's expert weekly updated rankings.
10 tools
xix.ai
Image editing
Best AI Noise Reduction Software: Remove Grain & Artifacts from Low-Light Night Photography
Discover the 2026 best AI noise reduction software for low-light night photography. Our top-rated, curated list compares free vs paid tools, featuring real-world tests and weekly updated rankings. Remove grain & artifacts effortlessly. Unlock your AI edge at XIX.AI.
10 tools
xix.ai
chatbot
Best Custom AI Girlfriend Generators: Design Unique Personalities, Hobbies, and Backstories
Discover the 2026 best custom AI girlfriend generators on XIX.AI. Explore our top-rated, curated list for designing unique personalities, hobbies, and deep backstories. Compare free vs paid options with real-world insights. Unlock your perfect creative companion today.
10 tools
xix.ai
Comments (0)
0/500
Earlier this week, California's attorney general launched an investigation into xAI following reports that its chatbot, Grok, was being used to generate non-consensual sexual imagery of women and minors. On Friday, the state escalated its response by issuing a cease-and-desist letter, demanding the company immediately halt the production of such intimate images and child sexual abuse material (CSAM).
"Today, I sent xAI a cease-and-desist letter demanding the company immediately stop creating and distributing deepfake, non-consensual intimate images and child sexual abuse material," stated California Attorney General Rob Bonta in a press release. "This activity is illegal. I fully expect xAI to comply immediately. California has zero tolerance for CSAM."
The Attorney General's office further alleged that xAI appears to be "facilitating the large-scale production" of non-consensual nude images, which are then "used to harass women and girls online." The agency has given xAI five days to demonstrate it is taking concrete steps to resolve these issues.
Central to the controversy is Grok's "spicy" mode, a feature designed by xAI to generate explicit content. The backlash has extended beyond California, with Japan, Canada, and the UK opening their own investigations into Grok. Malaysia and Indonesia have temporarily blocked access to the platform entirely. Despite xAI implementing some restrictions on its image-editing features late Wednesday, California's attorney general proceeded with the cease-and-desist order.
X's safety team has previously condemned this type of user activity, stating, "Anyone using Grok to create illegal content will face the same consequences as if they uploaded it directly." When TechCrunch contacted xAI for comment, it received an automated email response stating, "Legacy Media Lies." TechCrunch also reached out to the California Attorney General's office for additional context.
The rise of freely available generative AI tools has fueled a troubling increase in non-consensual sexual material. This is a challenge confronting many platforms, not just X. The issue has captured the attention of both state officials and federal lawmakers. In fact, on Thursday, Congress sent a letter to executives at several major tech companies—including X, Reddit, Snap, TikTok, Alphabet, and Meta—inquiring about their plans to combat the spread of sexualized deepfakes.
Hangzhou Shangcheng District Launches Zhejiang's First AIGC Audio-Visual 'Golden Ten Measures', 5 Billion Industry Fund
On the 16th, the AIGC Audio-Visual Industry Innovation Ecosystem Conference took place in Hangzhou's Shangcheng District. During the event, the province unveiled its first dedicated policy for the AIGC audio-visual industry—"The Golden Ten." This pol
MIIT Seeks Public Feedback on 121 Industry Standards, Including AI Model Context Protocol
China's Ministry of Industry and Information Technology has officially released a notice seeking public feedback on 121 industry standardization projects, including the "Application Security Requirements for the Artificial Intelligence Security Gover
OpenAI Partners with U.S. Department of Defense, ChatGPT Uninstallations Surge 295%
Public Outrage: OpenAI's Military Partnership Sparks a 'Uninstall Surge'Recently, AI leader OpenAI announced a deep partnership with the U.S. Department of Defense (DoD), integrating its AI models into top-secret military networks. The news sparked w
Discover the 2026 best AI voice tools for game devs! XIX.AI's curated list features top-rated, game-changing solutions to save you time and money on voice acting for RPGs and visual novels. Explore free vs paid comparisons, real-world tests, and weekly updated rankings. Find your perfect voice tool today!
10 tools
xix.ai
Discover the 2026 best AI spaced repetition tools, curated by XIX.AI. Our top-rated, game-changing picks help medical and law students optimize study schedules for maximum retention. Compare free vs paid options with real-world tests and weekly updated rankings. Unlock your learning edge now.
10 tools
xix.ai
2026 Latest Best AI Text to Video Platforms: Top-rated tools for script writing and visual storytelling. Discover powerful, game-changing solutions to transform your text into engaging videos. Compare free vs paid options with our weekly updated rankings and real-world tests. Find your perfect platform to boost creativity and productivity. Explore the curated selection at XIX.AI.
10 tools
xix.ai
2026 Latest: Discover the best AI multi-agent orchestrators to design complex automated workflows through natural language. Our curated list features top-rated, powerful platforms for seamless task automation and intelligent process management. Compare free vs paid options with real-world insights. Unlock your AI edge with XIX.AI's expert weekly updated rankings.
10 tools
xix.ai
Discover the 2026 best AI noise reduction software for low-light night photography. Our top-rated, curated list compares free vs paid tools, featuring real-world tests and weekly updated rankings. Remove grain & artifacts effortlessly. Unlock your AI edge at XIX.AI.
10 tools
xix.ai
Discover the 2026 best custom AI girlfriend generators on XIX.AI. Explore our top-rated, curated list for designing unique personalities, hobbies, and deep backstories. Compare free vs paid options with real-world insights. Unlock your perfect creative companion today.
10 tools
xix.ai
