In excess of a million users each week express suicidal intent when chatting with the AI chatbot, the artificial intelligence firm states.

Based on a latest update from the AI developer, more than a million AI chatbot users every week input messages that feature "clear signs of potential suicide planning or intent".

This data is included in an report on how the AI assistant addresses delicate discussions and constitutes one of the clearest declarations from the tech company regarding the magnitude of how AI can intensify psychological problems.

Psychological Crises and Severe Conditions

Besides its figures on self-harm considerations and similar exchanges, OpenAI also stated that about 0.07% of active users – approximately 560,000 out of its touted 800 million active users – show "possible signs of mental health emergencies related to psychosis".

The announcement cautioned that these exchanges were hard to measure or quantify, and that this represented an preliminary assessment.

Increased Scrutiny and Legal Actions

When the AI developer releases findings on psychological concerns associated with its marquee product, the company is facing increased scrutiny in the wake of a highly publicized lawsuit from the relatives of a teenage boy who took his own life after significant use with ChatGPT.

The regulatory agency last month furthermore initiated a extensive examination into organizations that create artificial intelligence assistants, like OpenAI, to determine how they assess harmful effects on children and teens.

GPT-5 Update and Safety Improvements

The company claimed in its announcement that its latest GPT-5 update lowered the number of undesirable behaviors from its offering and strengthened user safety in a model evaluation including in excess of 1,000 self-destructive discussions.

"The latest system assessments score the latest AI system at 91% compliant with our preferred responses, versus 77% for the previous GPT-5 model," the announcement reads.

The AI developer mentioned that the new model enhanced access to crisis hotlines and included notifications for people to pause during extended conversations.

Health Specialists and Study Assistance

To enhance performance to the model, the firm mentioned it enlisted 170 clinicians from its international medical network of medical specialists to support its study over recent months, which included rating the protection of its AI's replies and helping write the chatbot's answers to mental-health related questions.

"Included in this effort, clinical experts examined more than 1,800 system replies featuring serious mental health situations and evaluated answers from the latest AI system to previous models," OpenAI stated.

System Challenges

AI researchers and mental health professionals have historically concerned of chatbots' propensity to affirm users' decisions or delusions without considering whether they may be dangerous, an problem known as over-compliance.

Psychological professionals have additionally worried about people using AI chatbots for emotional assistance and warned how it could negatively affect vulnerable users.

Organizational View

The language in the firm's update distinguishes the company from any likely relationships between its offering and the emotional situations that its customers are undergoing.

"Mental health symptoms and emotional distress are widespread in human societies, and an growing customer base means that a percentage of ChatGPT conversations contain these circumstances," OpenAI's post mentioned.

Planned Adjustments

The company's leader earlier this month stated in a social media update that the organization had developed improvements in handling psychological concerns, revealing that the AI developer would reduce constraints and shortly start to allow mature users to generate erotic content.

"We created the conversational system quite limited to make sure we were exercising caution with emotional problems. We acknowledge this made it less valuable/satisfactory to multiple people who had no mental health problems, but given the seriousness of the issue we sought to address this correctly," the executive posted. "Now that we have been able to mitigate the critical psychological concerns and have new tools, we are ready to securely ease the limitations in most cases."

• Help Resources: Various worldwide crisis lines exist for individuals undergoing emotional distress.
• Professional Help: Seeking professional mental health support is recommended for individuals experiencing severe mental health concerns.
• Emergency Support: Multiple organizations offer prompt assistance for emergencies internationally.