OpenAI introduced a new version of its marquee ChatGPT chatbot Tuesday designed exclusively for teens, with stronger safeguards and monitoring, after facing criticism and legal complaints that it drove some users to suicide.
Dubbed "ChatGPT for Teens," the modified parameters automatically deploy for any user who registers as aged 13 to 17 or is detected to be underage by the company through usage patterns or account age.
Most of the safeguards utilised in the ChatGPT for Teens model already existed for ChatGPT accounts belonging to minors, such as restrictions when dealing with content related to self-harm, violence, eating disorders and graphic sexuality.
The program also offers more frequent break reminders, blackout "quiet hours" and Study Mode, which responds to users with guiding questions instead of popping out direct answers "to help teens understand the material," according to OpenAI.
Other restrictions in the ChatGPT for Teens model include preventing the chatbot from suggesting it has personal feelings for the user or that it possesses its own consciousness, and some modalities such as voice mode are disabled.
Parents are offered the choice to link accounts with those of their teens, and to be alerted if there is discussion of some high-risk situations, such as self-harm or suicide.
Parental alerts are reviewed by human moderators, and specific details from chat logs are removed to protect privacy.
The new teen mode comes amid mounting legal and regulatory pressure.
OpenAI faces several wrongful death lawsuits, including the parents of 16-year-old Adam Raine, a teenager who committed suicide allegedly using methods advised by ChatGPT.
The US Federal Trade Commission has also launched an inquiry into AI chatbots that act as digital companions, focusing on potential risks to children and teenagers.
Like social media companies, AI giants are facing growing regulatory pressure, with Congress introducing multiple bills to regulate chatbots, and California requiring safeguards to be in place for assistants that serve as companions or confidants.
Other AI companies have also received backlash from problems stemming from their use by minors, with some like rival Anthropic opting to restrict usage of its model to adults.
