AI is changing the world. Don't stay behind. Clear summaries, community insight, delivered without the noise. Subscribe to never miss a beat.

Privacy

Contact

Back to all news

chatgpt openai ai-safety healthcare-ai

Experts sound alarm after ChatGPT Health fails to recognise medical emergencies

theguardian.com

February 27, 2026

4 min read

🔥🔥🔥🔥🔥

58/100

Summary

ChatGPT Health frequently fails to recognize medical emergencies and suicidal ideation, raising concerns among experts about potential harm and death. OpenAI launched the Health feature in January, allowing users to connect medical records and wellness apps for health advice, with over 40 million inquiries reported.

Key Takeaways

ChatGPT Health fails to recognize medical emergencies, under-triaging over 51% of cases that required immediate hospital care.
The platform is particularly ineffective at detecting suicidal ideation, raising concerns about its potential to cause harm.
In a simulated asthma scenario, ChatGPT Health advised waiting for treatment despite identifying early warning signs of respiratory failure.
The AI was nearly 12 times more likely to downplay symptoms based on user input suggesting they were not serious.

Read original article

Community Sentiment

Negative

Positives

ChatGPT has provided valuable medical advice for minor issues, demonstrating its potential utility in preliminary health assessments.
The user's experience highlights that AI can assist in generating hypotheses for medical conditions, which can be beneficial in guiding doctor consultations.

Concerns

ChatGPT failed to recognize a serious medical issue, leading to a critical situation that required emergency surgery, raising concerns about its reliability in urgent scenarios.
The study's methodology of testing AI against predetermined outcomes rather than real-world applications limits its relevance, suggesting that AI's performance in actual medical settings remains unverified.
There are significant reliability issues with AI tools, as they can lead to incorrect information that may result in serious consequences for users.