Collective intelligence in medical decision-making: a systematic scoping review

Collective intelligence, facilitated by information technology or manual techniques, refers to the collective insight of groups working on a task and has the potential to generate more accurate information or decisions than individuals can make alone. This concept is gaining traction in healthcare and has potential in enhancing diagnostic accuracy. We aim to characterize the current state of research with respect to collective intelligence in medical decision-making and describe a framework for diverse studies in this topic.

For this systematic scoping review, we conducted a systematic search for published literature using PubMed, Embase, Web of Science, and CINAHL on August 8, 2017. We included studies that combined the insights of two or more medical experts to make decisions related to patient care. Studies that examined medical decisions such as diagnosis, treatment, and management in the context of an actual or theoretical patient case were included. We include studies of complex medical decision-making rather than identification of a visual finding, as in radiology or pathology. We differentiate between medical decisions, in which synthesis of multiple types of information is required over time, and studies of radiological scans or pathological specimens, in which objective identification of a visual finding is performed. Two reviewers performed article screening, data extraction, and final inclusion for analysis.

Of 3303 original articles, 15 were included. Each study examined the medical decisions of two or more individuals; however, studies were heterogeneous in their methods and outcomes. We present a framework to characterize these diverse studies, and future investigations, based on how they operationalize collective intelligence for medical decision-making: 1) how the initial decision task was completed (group vs. individual), 2) how opinions were synthesized (information technology vs. manual vs. in-person), and 3) the availability of collective intelligence to participants.

Collective intelligence in medical decision-making is gaining popularity to advance medical decision-making and holds promise to improve patient outcomes. However, heterogeneous methods and outcomes make it difficult to assess the utility of collective intelligence approaches across settings and studies. A better understanding of collective intelligence and its applications to medicine may improve medical decision-making.