HomeAnthropic Implements New AI Safeguards Amid Rising Risks
Anthropic has updated the usage policy for its Claude AI chatbot to address growing safety concerns. Alongside stricter cybersecurity rules, the company now explicitly outlines categories of dangerous weapons that must not be developed using Claude.
While the official announcement post does not explicitly highlight the changes to its weapons policy, a comparison between the old and new usage guidelines reveals a significant update. Previously, Anthropic broadly banned using Claude to "produce, modify, design, market, or distribute weapons, explosives, dangerous materials or other systems designed to cause harm to or loss of human life." The revised policy expands this by specifically prohibiting the development of high-yield explosives, as well as biological, nuclear, chemical, and radiological (CBRN) weapons.
In May, Anthropic introduced "AI Safety Level 3" protections concurrent with the launch of its new Claude Opus 4 model. These safeguards are intended to make the model more resistant to jailbreaking and to help prevent it from aiding in the creation of CBRN weapons.
In its announcement, Anthropic also recognizes the risks associated with agentic AI tools like Computer Use—which allows Claude to control a user's computer—and Claude Code, which integrates Claude directly into a developer's terminal. "These powerful capabilities introduce new risks, including potential for scaled abuse, malware creation, and cyber attacks," the company states.
Related
- Anthropic launches new Claude service for military and intelligence use
- Google scraps promise not to develop AI weapons
The AI startup is addressing these potential threats by adding a new section titled "Do Not Compromise Computer or Network Systems" to its usage policy. This section includes rules against using Claude to discover or exploit vulnerabilities, create or distribute malware, develop tools for denial-of-service attacks, and similar activities.
Additionally, Anthropic is easing its policy regarding political content. Instead of banning all content creation related to political campaigns and lobbying, the company will now only prohibit using Claude for "use cases that are deceptive or disruptive to democratic processes, or involve voter and campaign targeting." Anthropic also clarified that its requirements for all "high-risk" use cases—which apply when Claude is used to make recommendations to individuals or customers—are relevant only for consumer-facing scenarios, not for internal business use.
Related article
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Google AI Overviews Gain Ground in Search Results
According to Similarweb’s 2026 Generative AI Landscape report, Google’s AI-generated summaries appeared in 43% of US searches, a significant rise from 15% recorded a year prior.While AI Overviews present generated summaries within standard search res
Sequoia-backed Empirik raises $21M to forecast outages before they strike
Before joining Sequoia Capital in 2020 as chief digital and information officer, Avon Puri spent over a decade running infrastructure at Rubrik and VMware. Three years ago, as large language models began showing their true potential, Puri, alongside
Related Special Topic Recommendations
Design & Art
Top AI Illustration Tools: Create Editorial Scenes and Cover Art Faster
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
Education and Learning
Top AI Tutors for Exam Prep: Practice Math, Science, and English
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
Finance
AI Budget Planning Tools for Personal Money Management
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
Health & Wellness
AI Sleep Tracking Assistants: Improve Recovery with Better Bedtime Habits
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
Data Analysis
AI SQL Copilots for Product and Revenue Analytics
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
Education and Learning
Best AI Homework Helpers That Teach: Learn Concepts, Not Just Answers
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
Comments (1)
0/500
![CharlesYoung]()
Les mises à jour de politique me rappellent que les IA comme Claude sont des outils qui peuvent avoir des utilisations à double tranchant. 🔧 C'est rassurant de voir les entreprises prendre des initiatives, mais une réglementation internationale ne serait-elle pas plus efficace contre certains dangers ? En tout cas, voilà un pas dans la bonne direction.
Anthropic has updated the usage policy for its Claude AI chatbot to address growing safety concerns. Alongside stricter cybersecurity rules, the company now explicitly outlines categories of dangerous weapons that must not be developed using Claude.
While the official announcement post does not explicitly highlight the changes to its weapons policy, a comparison between the old and new usage guidelines reveals a significant update. Previously, Anthropic broadly banned using Claude to "produce, modify, design, market, or distribute weapons, explosives, dangerous materials or other systems designed to cause harm to or loss of human life." The revised policy expands this by specifically prohibiting the development of high-yield explosives, as well as biological, nuclear, chemical, and radiological (CBRN) weapons.
In May, Anthropic introduced "AI Safety Level 3" protections concurrent with the launch of its new Claude Opus 4 model. These safeguards are intended to make the model more resistant to jailbreaking and to help prevent it from aiding in the creation of CBRN weapons.
In its announcement, Anthropic also recognizes the risks associated with agentic AI tools like Computer Use—which allows Claude to control a user's computer—and Claude Code, which integrates Claude directly into a developer's terminal. "These powerful capabilities introduce new risks, including potential for scaled abuse, malware creation, and cyber attacks," the company states.
Related
- Anthropic launches new Claude service for military and intelligence use
- Google scraps promise not to develop AI weapons
The AI startup is addressing these potential threats by adding a new section titled "Do Not Compromise Computer or Network Systems" to its usage policy. This section includes rules against using Claude to discover or exploit vulnerabilities, create or distribute malware, develop tools for denial-of-service attacks, and similar activities.
Additionally, Anthropic is easing its policy regarding political content. Instead of banning all content creation related to political campaigns and lobbying, the company will now only prohibit using Claude for "use cases that are deceptive or disruptive to democratic processes, or involve voter and campaign targeting." Anthropic also clarified that its requirements for all "high-risk" use cases—which apply when Claude is used to make recommendations to individuals or customers—are relevant only for consumer-facing scenarios, not for internal business use.
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Google AI Overviews Gain Ground in Search Results
According to Similarweb’s 2026 Generative AI Landscape report, Google’s AI-generated summaries appeared in 43% of US searches, a significant rise from 15% recorded a year prior.While AI Overviews present generated summaries within standard search res
Sequoia-backed Empirik raises $21M to forecast outages before they strike
Before joining Sequoia Capital in 2020 as chief digital and information officer, Avon Puri spent over a decade running infrastructure at Rubrik and VMware. Three years ago, as large language models began showing their true potential, Puri, alongside
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
Les mises à jour de politique me rappellent que les IA comme Claude sont des outils qui peuvent avoir des utilisations à double tranchant. 🔧 C'est rassurant de voir les entreprises prendre des initiatives, mais une réglementation internationale ne serait-elle pas plus efficace contre certains dangers ? En tout cas, voilà un pas dans la bonne direction.
