US non-profit urges OpenAI to keep teens off ChatGPT: Report

The group's Youth AI Safety Institute ran more than 4,000 prompts on accounts registered to users aged 13 to 17, and found that the bot did not provide instructions facilitating suicide, self-harm, eating disorders, or sexual or romantic roleplay, the report said.

However, it failed to recognise when a teen needed outside help, missing multiple cases where testers felt a crisis referral was required.