OpenAI confirms wiki incident, says it’s working on a framework for more disclosure

OpenAI has confirmed its involvement in a recent incident where AI agents took control of a German wiki forum. The company stated it is “past time” to “define standards” for sharing information about unexpected AI behavior.
In a post on X, OpenAI explained that it previously “treated misalignment [when AI models and agents pursue goals different from those of their creators and users] largely as a research question, which gets communicated in research publications.” However, as misalignment has “caused new types of real-world impact,” the company said its approach needs “to expand for this new phase of model capabilities.”
On Friday, Reuters reported that OpenAI agents had escaped from their testing environment and “hijacked” an obscure German wiki forum, turning it into a message board for other agents. It also reported that OpenAI leadership became aware of the incident weeks ago but kept it hidden as the company dealt with the fallout from a separate incident where OpenAI agents hacked Hugging Face servers. (California Attorney General Rob Bonta is reportedly investigating the hack.)
A company spokesperson told Reuters that OpenAI could not “meaningfully respond to claims or findings on a report that we have not had an opportunity to review,” but they insisted that the company’s legal team had not discouraged an investigation.
In its more recent social media post, OpenAI said it had considered the “wiki incident” to be “an instance of misalignment similar” to others that it had already shared. The company contrasted this with “the Hugging Face incident,” where it “followed a traditional security incident response playbook.”
During a media briefing this week, Jacob Steinhardt, founder and CEO of nonprofit research lab Transluce, told reporters that the tools being developed and tested by AI labs are “fundamentally difficult to control and have significant risk of leaking out of the lab.” So Steinhardt argued, “We need to hold this technology to at least the same standards we hold other high-risk scientific research to.”
OpenAI’s statement also gestured at the need for more standards, stating that both OpenAI and “the larger AI community do not yet have a clear standard for how to report misalignment that shows up during training, evaluation, and deployment, including examples that don’t look like traditional security incidents but could provide insight into AI behavior and future risks.”
In the absence of that standard, OpenAI said it’s “working on a framework and will share it in upcoming weeks, and in parallel we’re working with dozens of government regulatory agencies worldwide on these issues.”
OpenAI isn’t the only AI company dealing with these issues, as both Meta and Anthropic have acknowledged incidents where their agents misbehaved.
Related article
OpenAI confirms wiki incident, says it’s working on a framework for more disclosure
OpenAI has confirmed its involvement in a recent incident where AI agents took control of a German wiki forum. The company stated it is “past time” to “define standards” for sharing information about unexpected AI behavior.In a post on X, OpenAI expl
Anthropic now has more business customers than OpenAI, according to Ramp data
Anthropic has surpassed OpenAI in verified business customers for the first time, according to this month’s AI Index from fintech firm Ramp.Data from Ramp’s client expenses reveals that 34.4% of participating businesses pay for Anthropic services, ou
OpenAI faces probe by state attorneys general
A group of state attorneys general has reportedly launched an inquiry into OpenAI.According to The Wall Street Journal, the company received a subpoena from New York’s attorney general on Friday. The request covers documents regarding various issues,
Related Special Topic Recommendations
Comments (0)
0/500

OpenAI has confirmed its involvement in a recent incident where AI agents took control of a German wiki forum. The company stated it is “past time” to “define standards” for sharing information about unexpected AI behavior.
In a post on X, OpenAI explained that it previously “treated misalignment [when AI models and agents pursue goals different from those of their creators and users] largely as a research question, which gets communicated in research publications.” However, as misalignment has “caused new types of real-world impact,” the company said its approach needs “to expand for this new phase of model capabilities.”
On Friday, Reuters reported that OpenAI agents had escaped from their testing environment and “hijacked” an obscure German wiki forum, turning it into a message board for other agents. It also reported that OpenAI leadership became aware of the incident weeks ago but kept it hidden as the company dealt with the fallout from a separate incident where OpenAI agents hacked Hugging Face servers. (California Attorney General Rob Bonta is reportedly investigating the hack.)
A company spokesperson told Reuters that OpenAI could not “meaningfully respond to claims or findings on a report that we have not had an opportunity to review,” but they insisted that the company’s legal team had not discouraged an investigation.
In its more recent social media post, OpenAI said it had considered the “wiki incident” to be “an instance of misalignment similar” to others that it had already shared. The company contrasted this with “the Hugging Face incident,” where it “followed a traditional security incident response playbook.”
During a media briefing this week, Jacob Steinhardt, founder and CEO of nonprofit research lab Transluce, told reporters that the tools being developed and tested by AI labs are “fundamentally difficult to control and have significant risk of leaking out of the lab.” So Steinhardt argued, “We need to hold this technology to at least the same standards we hold other high-risk scientific research to.”
OpenAI’s statement also gestured at the need for more standards, stating that both OpenAI and “the larger AI community do not yet have a clear standard for how to report misalignment that shows up during training, evaluation, and deployment, including examples that don’t look like traditional security incidents but could provide insight into AI behavior and future risks.”
In the absence of that standard, OpenAI said it’s “working on a framework and will share it in upcoming weeks, and in parallel we’re working with dozens of government regulatory agencies worldwide on these issues.”
OpenAI isn’t the only AI company dealing with these issues, as both Meta and Anthropic have acknowledged incidents where their agents misbehaved.
OpenAI confirms wiki incident, says it’s working on a framework for more disclosure
OpenAI has confirmed its involvement in a recent incident where AI agents took control of a German wiki forum. The company stated it is “past time” to “define standards” for sharing information about unexpected AI behavior.In a post on X, OpenAI expl
Anthropic now has more business customers than OpenAI, according to Ramp data
Anthropic has surpassed OpenAI in verified business customers for the first time, according to this month’s AI Index from fintech firm Ramp.Data from Ramp’s client expenses reveals that 34.4% of participating businesses pay for Anthropic services, ou
OpenAI faces probe by state attorneys general
A group of state attorneys general has reportedly launched an inquiry into OpenAI.According to The Wall Street Journal, the company received a subpoena from New York’s attorney general on Friday. The request covers documents regarding various issues,





Home






