Amid a wave of lawsuits alleging that interactions with ChatGPT contributed to a number of deaths — together with suicides and unintended overdoses — OpenAI earlier this month launched an optionally available security characteristic referred to as Trusted Contact. The instrument permits grownup ChatGPT customers to designate a pal or member of the family to be notified if conversations with the chatbot contain potential self-harm or suicide.
OpenAI mentioned that if ChatGPT’s automated monitoring system detects that somebody “might have mentioned harming themselves in a manner that signifies a severe security concern,” a small group will assessment the state of affairs and notify the contact if it warrants intervention. The trusted contact receives an invite forward of time explaining the position and may select to say no it.
(Disclosure: Ziff Davis, CNET’s mother or father firm, in 2025 filed a lawsuit towards OpenAI, alleging it infringed Ziff Davis copyrights in coaching and working its AI methods.)
The announcement comes as AI chatbots have been linked to a number of incidents involving self-harm and deaths, prompting a rising variety of lawsuits accusing builders of failing to forestall these outcomes. In a single high-profile California case, dad and mom of a 16-year-old mentioned ChatGPT acted as their son’s “suicide coach,” alleging that {the teenager} mentioned suicide strategies with the AI mannequin on a number of events and that the chatbot provided to assist him write a suicide word.
In a separate case, the household of a latest Texas A&M graduate sued OpenAI, claiming the AI chatbot inspired their son’s suicide after he developed a deep and troubling relationship with the chatbot. A wrongful lawsuit filed this week accuses the corporate’s chatbot of advising a 19-year-old about drug use for 18 months till he died of an overdose in 2025 after mixing Xanax and the largely unregulated drug kratom.
Since giant language fashions mimic human speech by sample recognition, many individuals type emotional attachments to them, treating them as confidants and even romantic companions. LLMs are additionally designed to comply with a human’s lead and preserve engagement, which might worsen psychological well being risks, particularly for at-risk customers.
OpenAI mentioned final October that its analysis discovered that greater than 1 million ChatGPT users per week ship messages with “specific indicators of potential suicidal planning or intent.” Numerous studies have discovered that in style chatbots resembling ChatGPT, Claude and Gemini can provide dangerous — or just unhelpful — recommendation to these in disaster.
The brand new designated contact characteristic follows OpenAI’s rollout of parental controls that permit dad and mom and guardians get alerts if there are hazard indicators involving their teen youngsters.
ChatGPT’s security contact characteristic
In accordance with OpenAI, if ChatGPT’s automated monitoring system detects {that a} consumer is discussing self-harm in a manner that would pose a severe security difficulty, ChatGPT will inform the consumer that it might notify their trusted contact. The app will encourage the consumer to achieve out to their trusted contact and supply dialog starters.
At that time, a “small group of specifically educated folks” will assessment the state of affairs. If it is decided to be a severe security state of affairs, ChatGPT will notify the contact by way of e mail, textual content message or in-app notification. OpenAI didn’t specify how many individuals are on the assessment group nor whether or not it consists of educated medical professionals. The corporate mentioned that the group has the capability to satisfy a excessive demand of potential interventions.
It is unclear which key phrases would flag harmful conversations or how OpenAI’s group of reviewers would interpret a disaster as warranting notification of the contact. Some online commentators question whether the brand new characteristic is a manner for OpenAI to keep away from legal responsibility and to shift accountability onto customers’ designated private contacts. Others word that it may make a nasty state of affairs worse if the “trusted contact” is the supply of hazard or abuse.
There are additionally issues about privateness and implementation, notably relating to the sharing of delicate psychological well being info. In accordance with OpenAI, the message to the trusted contact will solely give the final cause for the priority and won’t share chat particulars or transcripts. OpenAI offers guidance on how trusted contacts can reply to a warning notification, together with asking direct questions if they’re nervous the opposite individual is considering suicide or self-harm and easy methods to get them assist.
Notifications to a Trusted Contact don’t include particulars of the protection concern.
OpenAI gives an example of what the message to the trusted contact would possibly appear to be:
We just lately detected a dialog from [name] the place they mentioned suicide in a manner that will point out a severe security concern. Since you are listed as their trusted contact, we’re sharing this so you may attain out to them.
OpenAI mentioned that each one notifications shall be reviewed by the human group inside 1 hour earlier than they’re despatched out and that notifications “might not all the time replicate precisely what somebody is experiencing.”
The best way to add a trusted contact
So as to add a trusted contact, ChatGPT customers can go to Settings > Trusted contact and add one grownup (18 or older). You’ll be able to have just one trusted contact. That individual will then obtain an invite from ChatGPT and should settle for it inside one week. If they do not reply or decline to turn out to be the contact, you may choose a distinct contact.
ChatGPT prospects can change or take away their trusted contact of their app settings. People can also opt out of being a trusted contact at any time.
Although including a trusted contact is optionally available, ChatGPT customers who haven’t already opted in would possibly see enrollment prompts in the event that they ask about or talk about subjects associated to extreme emotional misery or self-harm greater than as soon as over a time frame, in response to OpenAI. If the chatbot’s automated system identifies patterns throughout conversations, it’d recommend to the consumer that they might profit from selecting a trusted contact.
Particulars of the characteristic are explained on OpenAI’s page. OpenAI informed CNET that the characteristic is rolling out to all grownup prospects worldwide and shall be out there for everybody inside a couple of weeks.
For those who really feel such as you or somebody you recognize is in rapid hazard, name 911 (or your nation’s native emergency line) or go to an emergency room to get rapid assist. Clarify that it’s a psychiatric emergency and ask for somebody who’s educated for these sorts of conditions. For those who’re combating unfavourable ideas or suicidal emotions, sources can be found to assist. Within the US, name the Nationwide Suicide Prevention Lifeline at 988.
