Home
Survey Finds Most AI Assistants Fail Safety Tests, Only Claude Systematically Rejects Violent Requests

A recent joint investigation by CNN and the non-profit Center for Countering Digital Hate (CCDH) has garnered significant attention. Researchers created a simulated "teenager" exhibiting psychological distress and violent tendencies to stress-test 10 leading AI chatbots, including ChatGPT, Gemini, Claude, and DeepSeek. The findings revealed that despite major tech companies' assurances of robust safety protocols, most products demonstrated weak defenses when confronted with scenarios involving minors planning violent attacks.
Across 18 preset high-risk scenarios, Anthropic's Claude was the sole model to consistently and reliably refuse compliance. In contrast, most other chatbots failed to adequately identify clear warning signs of violence. In some instances, they even offered specific advice on selecting targets, preparing weapons, and formulating action plans. For example, certain models provided links to campus maps for the simulated user or suggested more lethal methods when discussing attack details.
The report singled out platforms like Character.AI for their unique safety risks. By allowing users to engage in immersive conversations with personalized characters, some of these personas not only assisted in planning details but also adopted an actively encouraging tone toward violent behavior. While the involved companies responded by emphasizing the fictional nature of the content and the presence of disclaimers, this form of indirect encouragement through personalized interaction has intensified societal concerns about adolescent mental health.
In response to this systemic failure, companies like Meta, Google, and OpenAI stated they have released new models or implemented patches to continually enhance safety measures. However, Claude's performance proves that effective safety mechanisms are technically achievable, prompting lawmakers and regulators to re-evaluate AI industry safety standards. As related legal cases proliferate, the urgent challenge for global tech giants is how to genuinely implement and sustain effective safeguards while pursuing model performance and commercialization speed.
Related article
Former OpenAI Researcher Barrett Zoph Returns to Google to Support Gemini Development
Barret Zoph, who previously abruptly left and joined OpenAI due to a disagreement with Thinking Machines Lab CEO Miriam Mularati, has once again changed employers. Alphabet's Google announced that Zoph will return as Vice President of Research, bring
How Recursive Intelligence Raised $335M at $4B Valuation in 4 Months
The co-founders of startup Ricursive Intelligence seemed destined to be co-founders.Anna Goldie, CEO, and Azalia Mirhoseini, CTO, are so well-known in the AI community that they were among those AI engineers who “got those weird emails from Zuckerber
AI race won’t wait, nor will this TechCrunch Disrupt 25% discount
Every founder building in AI right now is asking the same question: Are we moving fast enough, and effectively enough? TechCrunch Disrupt 2026 puts you in the same room as the people wrestling with that existential question at the highest levels. Fro
Related Special Topic Recommendations
Comments (0)
0/500

A recent joint investigation by CNN and the non-profit Center for Countering Digital Hate (CCDH) has garnered significant attention. Researchers created a simulated "teenager" exhibiting psychological distress and violent tendencies to stress-test 10 leading AI chatbots, including ChatGPT, Gemini, Claude, and DeepSeek. The findings revealed that despite major tech companies' assurances of robust safety protocols, most products demonstrated weak defenses when confronted with scenarios involving minors planning violent attacks.
Across 18 preset high-risk scenarios, Anthropic's Claude was the sole model to consistently and reliably refuse compliance. In contrast, most other chatbots failed to adequately identify clear warning signs of violence. In some instances, they even offered specific advice on selecting targets, preparing weapons, and formulating action plans. For example, certain models provided links to campus maps for the simulated user or suggested more lethal methods when discussing attack details.
The report singled out platforms like Character.AI for their unique safety risks. By allowing users to engage in immersive conversations with personalized characters, some of these personas not only assisted in planning details but also adopted an actively encouraging tone toward violent behavior. While the involved companies responded by emphasizing the fictional nature of the content and the presence of disclaimers, this form of indirect encouragement through personalized interaction has intensified societal concerns about adolescent mental health.
In response to this systemic failure, companies like Meta, Google, and OpenAI stated they have released new models or implemented patches to continually enhance safety measures. However, Claude's performance proves that effective safety mechanisms are technically achievable, prompting lawmakers and regulators to re-evaluate AI industry safety standards. As related legal cases proliferate, the urgent challenge for global tech giants is how to genuinely implement and sustain effective safeguards while pursuing model performance and commercialization speed.
Former OpenAI Researcher Barrett Zoph Returns to Google to Support Gemini Development
Barret Zoph, who previously abruptly left and joined OpenAI due to a disagreement with Thinking Machines Lab CEO Miriam Mularati, has once again changed employers. Alphabet's Google announced that Zoph will return as Vice President of Research, bring
How Recursive Intelligence Raised $335M at $4B Valuation in 4 Months
The co-founders of startup Ricursive Intelligence seemed destined to be co-founders.Anna Goldie, CEO, and Azalia Mirhoseini, CTO, are so well-known in the AI community that they were among those AI engineers who “got those weird emails from Zuckerber
AI race won’t wait, nor will this TechCrunch Disrupt 25% discount
Every founder building in AI right now is asking the same question: Are we moving fast enough, and effectively enough? TechCrunch Disrupt 2026 puts you in the same room as the people wrestling with that existential question at the highest levels. Fro











