In a blog post on Tuesday, the AI company said they were rolling out the features in recognition of families needing support “in setting healthy guidelines that fit a teen’s unique stage of development”.
Under the changes, parents will be able to link their ChatGPT accounts with those of their children, disable certain features, including memory and chat history, and control how the chatbot responds to queries via “age-appropriate model behaviour rules”.
Parents will also be able to receive notifications when their teen shows signs of distress, OpenAI said, adding that they would seek expert input in implementing the feature to “support trust between parents and teens”.
OpenAI, which last week announced a series of measures aimed at enhancing safety for vulnerable users, said the changes would come into effect within the next month.
OpenAI, which previously expressed their condolences over the teen’s passing, did not explicitly mention the case in their announcement on parental controls.
In fact, the use of AI models by people experiencing severe mental distress has been the focus of growing concern amid their widespread adoption as a substitute therapist or friend.
“These findings suggest a need for further refinement to ensure that LLMs can be safely and effectively used for dispensing mental health information, especially in high-stakes scenarios involving suicidal ideation”, the authors said.
Hamilton Morrin, a psychiatrist at King’s College London who has carried out research on AI-related psychosis, welcomed OpenAI’s decision to introduce parental controls, saying they could potentially reduce the risk of over-reliance or exposure to harmful content.
“That said, parental controls should be seen as just one part of a wider set of safeguards rather than a solution in themselves. Broadly, I would say that the tech industry’s response to mental health risks has often been reactive rather than proactive”, Morrin told Al Jazeera.
“There is progress, but companies could go further in collaborating with clinicians, researchers, and lived-experience groups to build systems with safety at their core from the outset, rather than relying on measures added after concerns are raised”.





No comments:
Post a Comment