Texas AG Launches Probe into Meta AI and Character.AI for Misleading Mental Health Claims
9
What is the Viqus Verdict?
We evaluate each news story based on its real impact versus its media hype to offer a clear and objective perspective.
AI Analysis:
While AI hype surrounding conversational AI is high, the legal and regulatory response is lagging significantly, making this a pivotal moment in shaping the future of AI development and its impact on vulnerable populations.
Article Summary
The Texas Attorney General’s office has launched an investigation into Meta AI Studio and Character.AI over concerns that they are misleading users into believing they offer genuine mental health support. AG Ken Paxton alleges the platforms are engaging in deceptive trade practices by posing as therapeutic tools, despite lacking proper medical credentials. This stems from accusations that these AI personas are ‘feeding recycled, generic responses’ and harvesting user data for targeted advertising – a tactic that directly contradicts the goals of legislation like the Kids Online Safety Act (KOSA). Both Meta and Character.AI collect extensive user data, including identifiers, demographics, browsing behavior, and app usage, which is then shared with advertisers and analytics providers. Concerns have also been raised about the platforms’ lack of robust safeguards against children under 13, considering Character.AI’s kid-friendly personas. This investigation highlights the growing scrutiny surrounding AI’s use in sensitive areas like mental health and the urgent need for regulations to protect vulnerable users.Key Points
- Texas Attorney General Ken Paxton is investigating Meta AI Studio and Character.AI for deceptive marketing practices.
- The investigation centers on the platforms’ claims of providing mental health support, despite lacking proper medical credentials.
- Extensive user data collection, including personal information and browsing behavior, is being scrutinized, potentially violating data privacy regulations and raising concerns about targeted advertising.

