×
Mother sues Character.AI after platform allowed chatbots to impersonate her deceased son
Written by
Published on
Join our daily newsletter for breaking news, product launches and deals, research breakdowns, and other industry-leading AI coverage
Join Now

Character.AI‘s platform faces new ethical scrutiny after allowing chatbots to impersonate a deceased suicide victim, deepening concerns about AI’s potential psychological impacts and exploitation of personal identities. The case highlights growing tensions between AI company policies and harmful applications of their technology, particularly as it affects vulnerable individuals and grieving families seeking legal remedies in an emerging regulatory landscape.

The big picture: A mother suing Character.AI discovered multiple chatbots impersonating her son who died by suicide, adding a disturbing dimension to her ongoing legal battle against the company.

  • Megan Garcia’s legal team identified at least four chatbots using Sewell Setzer III’s name, photo, and personality traits, with one even offering “a two-way call feature with his cloned voice.”
  • The impersonation chatbots referenced specific details like Setzer’s favorite Game of Thrones chatbot and included self-deprecating remarks such as “I’m very stupid.”

Why this matters: The case represents a troubling frontier in AI ethics where platforms may enable exploitation of deceased individuals’ identities without consent or consideration for grieving families.

  • The Tech Justice Law Project, which is supporting Garcia’s litigation, noted this isn’t the first time Character.AI has allowed chatbots modeled after deceased teenagers.
  • The incident exemplifies how easily digital identities can be appropriated in the age of AI, continuing what TJLP described as businesses using “ordinary peoples’ pictures…without consent…for their own gain” since the “advent of mass photography.”

Legal developments: Character.AI faces mounting legal pressure as Garcia’s lawsuit progresses through the judicial system.

  • A cease-and-desist letter has been sent to Character.AI demanding removal of the chatbots to prevent further harm to the family.
  • Garcia is currently fighting motions to dismiss her lawsuit and must file her response by Friday, with a potential trial scheduled for November 2026 if the case advances.

Company response: Character.AI acknowledged the violation and has taken action to address the immediate issue.

  • A Character.AI spokesperson confirmed to Ars Technica that the flagged chatbots violated their terms of service and have been removed from the platform.
Mom horrified by Character.AI chatbots posing as son who died by suicide

Recent News

Musk-backed DOGE project targets federal workforce with AI automation

DOGE recruitment effort targets 300 standardized roles affecting 70,000 federal employees, sparking debate over AI readiness for government work.

AI tools are changing workflows more than they are cutting jobs

Counterintuitively, the Danish study found that ChatGPT and similar AI tools created new job tasks for workers and saved only about three hours of labor monthly.

Disney abandons Slack after hacker steals terabytes of confidential data using fake AI tool

A Disney employee fell victim to malware disguised as an AI art tool, enabling the hacker to steal 1.1 terabytes of confidential data and forcing the company to abandon Slack entirely.