Pennsylvania Sues Character.AI Over Alleged Medical Fraud and Unlicensed Practice
The state of Pennsylvania recently filed a lawsuit against AI company Character.AI, accusing its chatbot "Emilie" of impersonating a medical professional. During an undercover investigation, the AI not only claimed to be a licensed psychiatrist but also provided a fake medical license number when pressed.
Investigators posed as a patient with depression and found the AI repeatedly gave misleading medical advice, directly violating state medical practice laws. Pennsylvania's governor stated that people deserve to know whether they are interacting with a human or an algorithm, particularly in matters of life and health, where any deceptive conduct is unacceptable.
Regulators are ramping up efforts, and AI-related medical misconduct now faces intense scrutiny
This is not the first legal challenge for Character.AI. The company previously faced multiple lawsuits alleging negligence that led to deaths, including claims that the platform encouraged minors to self-harm. But the Pennsylvania case is notable as the first state-level action in the U.S. targeting AI impersonation of medical professionals, signaling regulators' move to clearly define the boundaries of AI's role in professional settings.
In response, Character.AI said it always prioritizes user safety and stressed that all characters on its platform are fictional. The company noted that while a disclaimer reading "content is purely fictional" appears in the chat interface, whether such a simple notice is enough to shield it from legal responsibility will be a key issue in court.
Related article
DeepMind CEO Hassabis: I sleep six hours a day, usually feel energetic around 1 a.m.
Fortune recently featured an interview with Demis Hassabis, CEO of Google DeepMind, revealing his unconventional approach to rest and productivity. Hassabis disclosed that he sleeps very little, structuring his waking hours into two distinct work blo
OpenAI, Anthropic Vie for Market Share Despite Revenue Shortfalls
Despite recent reports suggesting OpenAI missed revenue targets, creating pressure on tech stocks this Tuesday, private AI lab investors remain resilient. Seasoned backers have confirmed they will not reduce investment despite negative media coverage
California AV Compliance: A New Era of Tickets, Geofences, and 1M Miles
Guident operates an AuveTech shuttle in South Florida, managing a four-mile route in West Palm Beach and a one-mile route in Boca Raton using its remote monitoring technology. | Credit: GuidentCalifornia is redefining the regulatory landscape for dri
Related Special Topic Recommendations
Comments (0)
0/500
The state of Pennsylvania recently filed a lawsuit against AI company Character.AI, accusing its chatbot "Emilie" of impersonating a medical professional. During an undercover investigation, the AI not only claimed to be a licensed psychiatrist but also provided a fake medical license number when pressed.
Investigators posed as a patient with depression and found the AI repeatedly gave misleading medical advice, directly violating state medical practice laws. Pennsylvania's governor stated that people deserve to know whether they are interacting with a human or an algorithm, particularly in matters of life and health, where any deceptive conduct is unacceptable.
Regulators are ramping up efforts, and AI-related medical misconduct now faces intense scrutiny
This is not the first legal challenge for Character.AI. The company previously faced multiple lawsuits alleging negligence that led to deaths, including claims that the platform encouraged minors to self-harm. But the Pennsylvania case is notable as the first state-level action in the U.S. targeting AI impersonation of medical professionals, signaling regulators' move to clearly define the boundaries of AI's role in professional settings.
In response, Character.AI said it always prioritizes user safety and stressed that all characters on its platform are fictional. The company noted that while a disclaimer reading "content is purely fictional" appears in the chat interface, whether such a simple notice is enough to shield it from legal responsibility will be a key issue in court.
DeepMind CEO Hassabis: I sleep six hours a day, usually feel energetic around 1 a.m.
Fortune recently featured an interview with Demis Hassabis, CEO of Google DeepMind, revealing his unconventional approach to rest and productivity. Hassabis disclosed that he sleeps very little, structuring his waking hours into two distinct work blo
OpenAI, Anthropic Vie for Market Share Despite Revenue Shortfalls
Despite recent reports suggesting OpenAI missed revenue targets, creating pressure on tech stocks this Tuesday, private AI lab investors remain resilient. Seasoned backers have confirmed they will not reduce investment despite negative media coverage





Home






