Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Internal Medicine Neurology Oncology Pediatrics Respiratory Medicine Surgery
Congress Coverage
2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting

Keynote Webinar | Spotlight on Diet and Diabetes

Watch on-demand

An expert-led symposium exploring the prevention and management of type 2 diabetes through dietary interventions. 
ADVANCED SEARCH
Log in
Top
European Archives of Oto-Rhino-Laryngology

19-11-2023 | Sleep Apnea | Head and Neck

Chat GPT for the management of obstructive sleep apnea: do we have a polar star?

Authors: Felipe Ahumada Mira, Valentin Favier, Heloisa dos Santos Sobreira Nunes, Joana Vaz de Castro, Florent Carsuzaa, Giuseppe Meccariello, Claudio Vicini, Andrea De Vito, Jerome R. Lechien, Carlos Chiesa Estomba, Antonino Maniaci, Giannicola Iannella, Eduardo Peña Rojas, Jenifer Barros Cornejo, Giovanni Cammaroto

Published in: European Archives of Oto-Rhino-Laryngology

Login to get access

Abstract

Purpose

This study explores the potential of the Chat-Generative Pre-Trained Transformer (Chat-GPT), a Large Language Model (LLM), in assisting healthcare professionals in the diagnosis of obstructive sleep apnea (OSA). It aims to assess the agreement between Chat-GPT's responses and those of expert otolaryngologists, shedding light on the role of AI-generated content in medical decision-making.

Methods

A prospective, cross-sectional study was conducted, involving 350 otolaryngologists from 25 countries who responded to a specialized OSA survey. Chat-GPT was tasked with providing answers to the same survey questions. Responses were assessed by both super-experts and statistically analyzed for agreement.

Results

The study revealed that Chat-GPT and expert responses shared a common answer in over 75% of cases for individual questions. However, the overall consensus was achieved in only four questions. Super-expert assessments showed a moderate agreement level, with Chat-GPT scoring slightly lower than experts. Statistically, Chat-GPT's responses differed significantly from experts' opinions (p = 0.0009). Sub-analysis revealed areas of improvement for Chat-GPT, particularly in questions where super-experts rated its responses lower than expert consensus.

Conclusions

Chat-GPT demonstrates potential as a valuable resource for OSA diagnosis, especially where access to specialists is limited. The study emphasizes the importance of AI-human collaboration, with Chat-GPT serving as a complementary tool rather than a replacement for medical professionals. This research contributes to the discourse in otolaryngology and encourages further exploration of AI-driven healthcare applications. While Chat-GPT exhibits a commendable level of consensus with expert responses, ongoing refinements in AI-based healthcare tools hold significant promise for the future of medicine, addressing the underdiagnosis and undertreatment of OSA and improving patient outcomes.
Literature
1.
Shen Y, Heacock L, Elias J et al (2023) ChatGPT and other large language models are double-edged swords. Radiology. 307(2):e230163 CrossRefPubMed
2.
Rajkomar A, Dean J, Kohane I (2019) Machine learning in medicine. N Engl J Med 380(14):1347–1358 CrossRefPubMed
3.
4.
Yeghiazarians Y, Jneid H, Tietjens JR et al (2021) Obstructive sleep apnea and cardiovascular disease: a scientific statement from the american heart association. Circulation 144(3):E56–E67 CrossRefPubMed
5.
Peppard PE, Young T, Barnet JH et al (2013) Increased prevalence of sleep-disordered breathing in adults. Am J Epidemiol 177(9):1006–1014 CrossRefPubMedCentral
6.
Warrens MJ (2010) Inequalities between multi-rater kappas. Adv Data Anal Classif 4(4):271–286 CrossRef
7.
8.
Radford A, Wu J, Child R et al (2019) Language models are unsupervised multitask learners. OpenAI Blog 1(8):9
9.
Peppard PE, Young T, Palta M et al (2000) Prospective study of the association between sleep-disordered breathing and hypertension. N Engl J Med 342(19):1378–1384 CrossRefPubMed
10.
Senaratna CV, Perret JL, Lodge CJ et al (2017) Prevalence of obstructive sleep apnea in the general population: a systematic review. Sleep Med Rev 34:70–81 CrossRef
11.
12.
Xv Y, Peng C, Wei Z et al (2023) Can Chat-GPT a substitute for urological resident physician in diagnosing diseases?: a preliminary conclusion from an exploratory investigation. World J Urol 41(9):2569–2571 CrossRefPubMed
13.
14.
Metadata
Title
Chat GPT for the management of obstructive sleep apnea: do we have a polar star?
Authors
Felipe Ahumada Mira
Valentin Favier
Heloisa dos Santos Sobreira Nunes
Joana Vaz de Castro
Florent Carsuzaa
Giuseppe Meccariello
Claudio Vicini
Andrea De Vito
Jerome R. Lechien
Carlos Chiesa Estomba
Antonino Maniaci
Giannicola Iannella
Eduardo Peña Rojas
Jenifer Barros Cornejo
Giovanni Cammaroto
Publication date
19-11-2023
Publisher
Springer Berlin Heidelberg
Published in
European Archives of Oto-Rhino-Laryngology
Print ISSN: 0937-4477
Electronic ISSN: 1434-4726
DOI
https://doi.org/10.1007/s00405-023-08270-9