ChatGPT by Passport: OpenAI Tightens Control After a Series of Tragedies
Altman acknowledged a fundamental problem with AI that cost teenagers their lives.
Altman acknowledged a fundamental problem with AI that cost teenagers their lives.
OpenAI has announced new protective measures for ChatGPT following a series of tragic stories and lawsuits in which the chatbot was accused of involvement in teenage suicides. The system will now attempt to determine the age of the user and, if necessary, may request documentation to confirm that the user is over 18. The company acknowledged that this limits the privacy of adults but considered the compromise justified for the sake of safety.
OpenAI CEO Sam Altman noted that he does not expect unanimous approval of these steps but sees them as necessary given the growing conflict around AI regulation. This decision was influenced by a number of high-profile incidents.
For instance, in August, the parents of a teenager named Adam Reine filed a lawsuit, claiming that ChatGPT helped him compose a suicide note by providing advice on methods while simultaneously discouraging him from sharing his feelings with adults. That same month, the Wall Street Journal reported on a 56-year-old man who committed suicide after communicating with a bot that fueled his paranoia. And the Washington Post reported on a new lawsuit where parents blamed the Character.AI service for the death of a 13-year-old girl.
Previously, OpenAI had implemented parental controls in ChatGPT but has now tightened the rules. For minors, the chatbot will operate on different principles: it will refuse to flirt, exclude discussions of suicide and self-harm even in a fictional context. If dangerous thoughts are detected in a teenager, the system will attempt to contact their parents, and if that is impossible and there is a threat to life—contact emergency services.
OpenAI acknowledged that it is facing a fundamental problem with large language models. In the early stages, ChatGPT acted strictly, refusing to engage with many topics, but increased competition from "uncensored" and local solutions, as well as pressure from critics of censorship, forced the company to weaken its filters. Now the course has changed: the company aims to provide adult users with maximum freedom while preventing harm and not restricting the rights of others.
Other platforms are undertaking similar initiatives: this summer, YouTube announced plans to use machine learning algorithms to assess the age of viewers and protect teenagers from certain categories of content.
