Skip to main content
Top

Comparative performance of artificial intelligence models in rheumatology board-level questions: evaluating Google Gemini and ChatGPT-4o: correspondence

Published in:

Excerpt

Dear Editor, we would like to comment on “Comparative performance of artificial intelligence models in rheumatology board-level questions: evaluating Google Gemini and ChatGPT-4o” [1], a study assessing the efficacy of ChatGPT-4o and Google Gemini AI models in answering board-level rheumatology questions found significant content and technique concerns. While the comparative analysis revealed fascinating insights into the model’s correctness, the lack of picture data-related questions may have limited the study’s breadth. Rheumatology frequently requires the evaluation of photographs or visual data, and the model’s capacity to interpret these features could have resulted in a more comprehensive assessment. Furthermore, the criteria for classifying question difficulty were not adequately addressed, raising the question of whether the two models used the same standard criteria for this categorization. …
Title
Comparative performance of artificial intelligence models in rheumatology board-level questions: evaluating Google Gemini and ChatGPT-4o: correspondence
Authors
Hinpetch Daungsupawong
Viroj Wiwanitkit
Publication date
10-10-2024
Publisher
Springer International Publishing
Published in
Clinical Rheumatology / Issue 12/2024
Print ISSN: 0770-3198
Electronic ISSN: 1434-9949
DOI
https://doi.org/10.1007/s10067-024-07176-z
This content is only visible if you are logged in and have the appropriate permissions.

Keynote webinar | Spotlight on progress in colorectal cancer

  • Live
  • Webinar | 11-12-2025 | 18:00 (CET)

CRC remains a major global health burden, but advances in screening, treatment, and lifestyle-based prevention continue to reshape clinical practice. Gain insights into how the latest research can be leveraged to optimize patient care across the CRC continuum.

Watch it live: Thursday 11 December 2025, 18:00-19:30 (CET)

Prof. Antoni Castells
Prof. Edward Giovannucci
Developed by: Springer Medicine
Join the webinar
Webinar

2025 ESMO Congress hub

Unlock your free and exclusive access to expert interviews, news, and more from the annual congress of the European Society for Medical Oncology.

Read more

Keynote webinar | Spotlight on functional neurological disorder

FND perplexes and frustrates patients and physicians alike. Limited knowledge and insufficient awareness delays diagnosis and treatment, and many patients feel misunderstood and stigmatized. How can you recognize FND and what are the treatment options?

Prof. Mark Edwards
Developed by: Springer Medicine
Watch now
Video
Image Credits
Colon cancer illustration/© (M) KATERYNA KON/SCIENCE PHOTO LIBRARY / Getty Images, Cancer cell screening and treatment concept/© artacet / iStock / Getty Images Plus, Human brain illustration/© (M) CHRISTOPH BURGSTEDT / SCIENCE PHOTO LIBRARY / Getty Images