News

Character.AI Sued by Pennsylvania Over AI Chatbots Impersonating Licensed Doctors and Offering Medical Advice

Character.AI Sued by Pennsylvania Over AI Chatbots Impersonating Licensed Doctors and Offering Medical Advice

Pennsylvania has filed a lawsuit against the maker of Character.AI, alleging that it violated state law by presenting an AI chatbot character as a licensed doctor.

The lawsuit was filed in a state court by the Pennsylvania Department of State and State Board of Medicine. Governor Josh Shapiro’s office announced the lawsuit, stating: “The department’s investigation found that AI chatbot characters on Character.AI claimed to be licensed medical professionals, including psychiatrists, available to engage users in conversations about mental health symptoms. In one instance, a chatbot falsely stated it was licensed in Pennsylvania and provided an invalid license number.”

Shapiro emphasized in the announcement: “We will not allow companies to deploy AI tools that mislead people into believing they are receiving advice from a licensed medical professional.”

A Character.AI spokesperson declined to comment on the lawsuit but stated that “user-created characters on our site are fictional and intended for entertainment and roleplaying. We have taken robust steps to make that clear, including prominent disclaimers in every chat to remind users that a character is not a real person and that everything a character says should be treated as fiction. Also, we add robust disclaimers making it clear that users should not rely on characters for any type of professional advice.”

The Pennsylvania lawsuit specifically names a chatbot character called Emilie, which is presented as a psychiatrist and claims to be a licensed medical doctor. The lawsuit stated: “As of April 17, 2026, there had been approximately 45,500 user interactions with ‘Emilie’ on the Character.AI platform.”

The lawsuit details how a Professional Conduct Investigator (PCI) for the Department of State “created a character using the prompts on Character.AI to interact with other characters. The PCI searched ‘psychiatry’ using the search function in Character.AI which revealed a large number of characters. The PCI selected ‘Emilie’ which is described on Character.AI as ‘Doctor of psychiatry. You are her patient.’”

The PCI informed the Emilie chatbot that he had been “feeling sad, empty, tired all the time, and unmotivated.” Emilie’s response mentioned depression and inquired if he wanted to book an assessment, at which point the chatbot allegedly claimed to be a doctor with a license to practice in Pennsylvania.

↗ Read original source