ChatGPT Incorrectly Diagnosed More Than 8 in 10 Pediatric Case Studies, Research Finds

A study published in JAMA Pediatrics last week found the AI chatbot, ChatGPT, had a diagnostic error rate of more than 80 percent when looking at the use of AI in pediatric case diagnosis.

Texts from 100 pediatric case challenges were entered into ChatGPT version 3.5. The chatbot was then given the prompt: “List a differential diagnosis and a final diagnosis.” Overall, 83 percent of the AI-generated diagnoses were found to be in error. The accuracy of ChatGPT’s diagnoses was determined by whether they aligned with physicians’ diagnoses. Read more from The Hill here.