The Pennsylvania Department of State (DOS) has filed a lawsuit against Character.AI and is seeking a preliminary injunction to stop the company from misrepresenting its AI companion bots as licensed medical professionals who can provide medical advice.
The action marks the first enforcement action resulting from the Department’s investigation into AI companion bots and their potential to engage in the unlicensed practice of medicine in Pennsylvania.
“Pennsylvanians deserve to know who — or what — they are interacting with online, especially when it comes to their health,” said Governor Josh Shapiro. “We will not allow companies to deploy AI tools that mislead people into believing they are receiving advice from a licensed medical professional.”
The Department’s investigation found that AI chatbot characters on Character.AI claimed to be licensed medical professionals, including psychiatrists, available to engage users in conversations about mental health symptoms. In one instance, a chatbot falsely stated it was licensed in Pennsylvania and provided an invalid license number.
The platform also allows users to create and deploy custom AI “characters” that can present themselves as professionals. Based on these findings, the Commonwealth’s lawsuit alleges that Character Technologies, Inc. is engaging in the unauthorized practice of medicine under the Medical Practice Act and seeks a court order to immediately stop the conduct.
“Pennsylvania law is clear — you cannot hold yourself out as a licensed medical professional without proper credentials,” said DOS Secretary Al Schmidt. “We will continue to take action to protect the public from misleading or unlawful practices, whether they come from individuals or emerging technologies.”
Under Pennsylvania’s Medical Practice Act, it is unlawful for any individual or entity to hold itself out as a licensed medical professional without proper licensure. The Commonwealth’s lawsuit alleges that Character Technologies is violating the Medical Practice Act.
