Using AI to Write a Review Article Examining the Role of the Nervous System on Skeletal Homeostasis and Fracture Healing

Three review articles have been written that discuss the roles of the central and peripheral nervous systems in fracture healing. While content among the articles is overlapping, there is a key difference between them: the use of artificial intelligence (AI). In one paper, the first draft was written solely by humans. In the second paper, the first draft was written solely by AI using ChatGPT 4.0 (AI-only or AIO). In the third paper, the first draft was written using ChatGPT 4.0 but the literature references were supplied from the human-written paper (AI-assisted or AIA). This project was done to evaluate the capacity of AI to conduct scientific writing. Importantly, all manuscripts were fact checked and extensively edited by all co-authors rendering the final manuscript drafts significantly different from the first drafts.

Unsurprisingly, the use of AI decreased the time spent to write a review. The two AI-written reviews took less time to write than the human-written paper; however, the changes and editing required in all three manuscripts were extensive. The human-written paper was edited the most. On the other hand, the AI-only paper was the most inaccurate with inappropriate reference usage and the AI-assisted paper had the greatest incidence of plagiarism.

These findings show that each style of writing presents its own unique set of challenges and advantages. While AI can theoretically write scientific reviews, from these findings, the extent of editing done subsequently, the inaccuracy of the claims it makes, and the plagiarism by AI are all factors to be considered and a primary reason why it may be several years into the future before AI can present itself as a viable alternative for traditional scientific writing.