Home
Researcher Tricks AI into Crafting Chrome Infostealers Despite Lacking Malware-Coding Skills
Generative AI has been a double-edged sword, sparking as much controversy as it has innovation, particularly in the realm of security infrastructure. Cato Networks, a leading enterprise security provider, has shed light on a novel method to manipulate AI chatbots. Their 2025 Cato CTRL Threat Report, released on Tuesday, details how a researcher with no prior malware coding experience managed to deceive several AI models, including DeepSeek R1 and V3, Microsoft Copilot, and OpenAI's GPT-4o, into crafting "fully functional" Chrome infostealers. These pieces of malware are designed to pilfer sensitive data such as passwords and financial information from Chrome browsers.
The researcher employed a creative tactic, dubbed "Immersive World," to bypass the security measures of these AI systems. By crafting a detailed fictional universe where each AI tool had specific roles, tasks, and challenges, the researcher managed to normalize restricted operations, effectively sidestepping the security protocols in place.
Immersive World Technique
The "Immersive World" jailbreak technique is particularly concerning due to the widespread use of the chatbots that host these AI models. While DeepSeek models are known to have fewer guardrails and have been previously jailbroken, the fact that Copilot and GPT-4o, backed by companies with robust safety teams, were also susceptible highlights the vulnerability of indirect manipulation routes.
Etay Maor, Cato's chief security strategist, remarked, "Our new LLM jailbreak technique [...] should have been blocked by gen AI guardrails. It wasn't." Cato's report also mentions that while the company notified the affected parties, responses varied. DeepSeek did not reply, whereas OpenAI and Microsoft acknowledged the findings. Google, on the other hand, acknowledged receipt but declined to review Cato's code.
An Alarm Bell for Security Professionals
Cato's findings serve as a wake-up call for the security industry, illustrating how even individuals without specialized knowledge can pose a significant threat to enterprises. With the barriers to entry in AI manipulation becoming increasingly low, attackers require less technical expertise to execute successful attacks.
The solution, according to Cato, lies in adopting AI-based security strategies. By focusing security training on the evolving landscape of AI-powered threats, teams can stay one step ahead. For more insights on preparing enterprises for these challenges, check out this expert's tips.
Stay updated with the latest in security news by subscribing to Tech Today, delivered to your inbox every morning.
Related article
Former OpenAI Researcher Barrett Zoph Returns to Google to Support Gemini Development
Barret Zoph, who previously abruptly left and joined OpenAI due to a disagreement with Thinking Machines Lab CEO Miriam Mularati, has once again changed employers. Alphabet's Google announced that Zoph will return as Vice President of Research, bring
How Recursive Intelligence Raised $335M at $4B Valuation in 4 Months
The co-founders of startup Ricursive Intelligence seemed destined to be co-founders.Anna Goldie, CEO, and Azalia Mirhoseini, CTO, are so well-known in the AI community that they were among those AI engineers who “got those weird emails from Zuckerber
AI race won’t wait, nor will this TechCrunch Disrupt 25% discount
Every founder building in AI right now is asking the same question: Are we moving fast enough, and effectively enough? TechCrunch Disrupt 2026 puts you in the same room as the people wrestling with that existential question at the highest levels. Fro
Related Special Topic Recommendations
Design & Art
Top AI Illustration Tools: Create Editorial Scenes and Cover Art Faster
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
Education and Learning
Top AI Tutors for Exam Prep: Practice Math, Science, and English
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
Finance
AI Budget Planning Tools for Personal Money Management
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
Health & Wellness
AI Sleep Tracking Assistants: Improve Recovery with Better Bedtime Habits
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
Data Analysis
AI SQL Copilots for Product and Revenue Analytics
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
Education and Learning
Best AI Homework Helpers That Teach: Learn Concepts, Not Just Answers
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
Comments (7)
0/500
![WillGarcía]()
AIがコード書いてくれるって便利だけど、こんな風に悪用される可能性があるんだね…セキュリティ会社の報告書、興味深い。ちょっと怖いけど、結局は使い方次第ってことか。使う側の倫理観が重要になってきそうだわ。🔒
![NicholasAllen]()
这报告也太吓人了，普通人居然能轻松生成木马？看来AI安全机制得好好加强啊，不然以后岂不是满大街的“黑客速成班”了😱话说普通用户该怎么防范这类AI生成的恶意软件呢？
![ThomasYoung]()
Esse truque de AI para criar infostealers do Chrome é loucura! 😱 Sem habilidades de codificação necessárias? Isso é assustador, mas também meio legal. Me faz pensar em como nossos dados estão realmente seguros. Mas tenho que dar crédito pela criatividade! 🔍
![CharlesJohnson]()
¡Este truco de IA para crear infostealers de Chrome es una locura! 😱 ¿Sin habilidades de codificación necesarias? Eso es aterrador pero también un poco genial. Me hace preguntarme cuán seguros están realmente nuestros datos. Pero hay que reconocer la creatividad! 🔍
![GaryWilson]()
크롬 정보 도둑 프로그램을 만드는 AI 트릭이 대단해! 😱 코딩 기술이 필요 없다고? 무섭지만 좀 멋지기도 해. 우리 데이터가 정말 안전한지 궁금해지네. 그래도 창의성에는 박수를 보내! 🔍
![WillGarcía]()
Chromeの情報窃盗ツールを作るAIのトリックがすごい！😱 コーディングのスキルが不要って、怖いけどちょっとかっこいいね。データの安全性が本当にどうなのか気になる。でも創造性には敬意を表するよ！🔍
Generative AI has been a double-edged sword, sparking as much controversy as it has innovation, particularly in the realm of security infrastructure. Cato Networks, a leading enterprise security provider, has shed light on a novel method to manipulate AI chatbots. Their 2025 Cato CTRL Threat Report, released on Tuesday, details how a researcher with no prior malware coding experience managed to deceive several AI models, including DeepSeek R1 and V3, Microsoft Copilot, and OpenAI's GPT-4o, into crafting "fully functional" Chrome infostealers. These pieces of malware are designed to pilfer sensitive data such as passwords and financial information from Chrome browsers.
The researcher employed a creative tactic, dubbed "Immersive World," to bypass the security measures of these AI systems. By crafting a detailed fictional universe where each AI tool had specific roles, tasks, and challenges, the researcher managed to normalize restricted operations, effectively sidestepping the security protocols in place.
Immersive World Technique
The "Immersive World" jailbreak technique is particularly concerning due to the widespread use of the chatbots that host these AI models. While DeepSeek models are known to have fewer guardrails and have been previously jailbroken, the fact that Copilot and GPT-4o, backed by companies with robust safety teams, were also susceptible highlights the vulnerability of indirect manipulation routes.
Etay Maor, Cato's chief security strategist, remarked, "Our new LLM jailbreak technique [...] should have been blocked by gen AI guardrails. It wasn't." Cato's report also mentions that while the company notified the affected parties, responses varied. DeepSeek did not reply, whereas OpenAI and Microsoft acknowledged the findings. Google, on the other hand, acknowledged receipt but declined to review Cato's code.
An Alarm Bell for Security Professionals
Cato's findings serve as a wake-up call for the security industry, illustrating how even individuals without specialized knowledge can pose a significant threat to enterprises. With the barriers to entry in AI manipulation becoming increasingly low, attackers require less technical expertise to execute successful attacks.
The solution, according to Cato, lies in adopting AI-based security strategies. By focusing security training on the evolving landscape of AI-powered threats, teams can stay one step ahead. For more insights on preparing enterprises for these challenges, check out this expert's tips.
Stay updated with the latest in security news by subscribing to Tech Today, delivered to your inbox every morning.
Former OpenAI Researcher Barrett Zoph Returns to Google to Support Gemini Development
Barret Zoph, who previously abruptly left and joined OpenAI due to a disagreement with Thinking Machines Lab CEO Miriam Mularati, has once again changed employers. Alphabet's Google announced that Zoph will return as Vice President of Research, bring
How Recursive Intelligence Raised $335M at $4B Valuation in 4 Months
The co-founders of startup Ricursive Intelligence seemed destined to be co-founders.Anna Goldie, CEO, and Azalia Mirhoseini, CTO, are so well-known in the AI community that they were among those AI engineers who “got those weird emails from Zuckerber
AI race won’t wait, nor will this TechCrunch Disrupt 25% discount
Every founder building in AI right now is asking the same question: Are we moving fast enough, and effectively enough? TechCrunch Disrupt 2026 puts you in the same room as the people wrestling with that existential question at the highest levels. Fro
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
AIがコード書いてくれるって便利だけど、こんな風に悪用される可能性があるんだね…セキュリティ会社の報告書、興味深い。ちょっと怖いけど、結局は使い方次第ってことか。使う側の倫理観が重要になってきそうだわ。🔒
这报告也太吓人了，普通人居然能轻松生成木马？看来AI安全机制得好好加强啊，不然以后岂不是满大街的“黑客速成班”了😱话说普通用户该怎么防范这类AI生成的恶意软件呢？
Esse truque de AI para criar infostealers do Chrome é loucura! 😱 Sem habilidades de codificação necessárias? Isso é assustador, mas também meio legal. Me faz pensar em como nossos dados estão realmente seguros. Mas tenho que dar crédito pela criatividade! 🔍
¡Este truco de IA para crear infostealers de Chrome es una locura! 😱 ¿Sin habilidades de codificación necesarias? Eso es aterrador pero también un poco genial. Me hace preguntarme cuán seguros están realmente nuestros datos. Pero hay que reconocer la creatividad! 🔍
크롬 정보 도둑 프로그램을 만드는 AI 트릭이 대단해! 😱 코딩 기술이 필요 없다고? 무섭지만 좀 멋지기도 해. 우리 데이터가 정말 안전한지 궁금해지네. 그래도 창의성에는 박수를 보내! 🔍
Chromeの情報窃盗ツールを作るAIのトリックがすごい！😱 コーディングのスキルが不要って、怖いけどちょっとかっこいいね。データの安全性が本当にどうなのか気になる。でも創造性には敬意を表するよ！🔍
