Skip to main content
Top
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews

Authors: Abigail M Methley, Stephen Campbell, Carolyn Chew-Graham, Rosalind McNally, Sudeh Cheraghi-Sohi

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

Qualitative systematic reviews are increasing in popularity in evidence based health care. Difficulties have been reported in conducting literature searches of qualitative research using the PICO search tool. An alternative search tool, entitled SPIDER, was recently developed for more effective searching of qualitative research, but remained untested beyond its development team.

Methods

In this article we tested the ‘SPIDER’ search tool in a systematic narrative review of qualitative literature investigating the health care experiences of people with Multiple Sclerosis. Identical search terms were combined into the PICO or SPIDER search tool and compared across Ovid MEDLINE, Ovid EMBASE and EBSCO CINAHL Plus databases. In addition, we added to this method by comparing initial SPIDER and PICO tools to a modified version of PICO with added qualitative search terms (PICOS).

Results

Results showed a greater number of hits from the PICO searches, in comparison to the SPIDER searches, with greater sensitivity. SPIDER searches showed greatest specificity for every database. The modified PICO demonstrated equal or higher sensitivity than SPIDER searches, and equal or lower specificity than SPIDER searches. The modified PICO demonstrated lower sensitivity and greater specificity than PICO searches.

Conclusions

The recommendations for practice are therefore to use the PICO tool for a fully comprehensive search but the PICOS tool where time and resources are limited. Based on these limited findings the SPIDER tool would not be recommended due to the risk of not identifying relevant papers, but has potential due to its greater specificity.
Literature
1.
go back to reference Stephens KR: Systematic reviews: the heart of evidence-based practice. Am Assoc Crit Care Nurs Clin Issu. 2001, 12 (4): 529-538. Stephens KR: Systematic reviews: the heart of evidence-based practice. Am Assoc Crit Care Nurs Clin Issu. 2001, 12 (4): 529-538.
2.
go back to reference Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration. 2013 Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration. 2013
3.
go back to reference Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, Hsu R, Katbamna S, Olson R, Smith L, Riley R, Sutton AJ: Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006, 6: 3-10.1186/1471-2288-6-35.CrossRef Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, Hsu R, Katbamna S, Olson R, Smith L, Riley R, Sutton AJ: Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006, 6: 3-10.1186/1471-2288-6-35.CrossRef
4.
go back to reference Centre for reviews and dissemination: Systematic Reviews: CRD’s Guidance for Undertaking Reviews in Health Care. 2006, University of York, York Centre for reviews and dissemination: Systematic Reviews: CRD’s Guidance for Undertaking Reviews in Health Care. 2006, University of York, York
5.
go back to reference Helmer D, Savoie I, Green C, Kazanjian A: Evidence-based practice: extending the search to find material for the systematic review. Bull Med Libr Assoc. 2001, 89 (4): 346-352.PubMedPubMedCentral Helmer D, Savoie I, Green C, Kazanjian A: Evidence-based practice: extending the search to find material for the systematic review. Bull Med Libr Assoc. 2001, 89 (4): 346-352.PubMedPubMedCentral
6.
go back to reference Stevinson C, Lawlor DA: Searching multiple databases for systematic reviews: added value or diminishing returns?. Complement Ther Med. 2004, 12: 228-232. 10.1016/j.ctim.2004.09.003.CrossRefPubMed Stevinson C, Lawlor DA: Searching multiple databases for systematic reviews: added value or diminishing returns?. Complement Ther Med. 2004, 12: 228-232. 10.1016/j.ctim.2004.09.003.CrossRefPubMed
7.
go back to reference Noyes J: Never mind the qualitative feel the depth! The evolving role of qualitative research in Cochrane intervention reviews. J Res Nurs. 2010, 15: 525-534. 10.1177/1744987110381696.CrossRef Noyes J: Never mind the qualitative feel the depth! The evolving role of qualitative research in Cochrane intervention reviews. J Res Nurs. 2010, 15: 525-534. 10.1177/1744987110381696.CrossRef
8.
go back to reference Noyes J, Popay J, Pearson A, Hannes K, Booth A: Chapter 20: qualitative research and cochrane reviews. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2008, 20.1-20.18 Noyes J, Popay J, Pearson A, Hannes K, Booth A: Chapter 20: qualitative research and cochrane reviews. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2008, 20.1-20.18
9.
go back to reference Cooke A, Smith D, Booth A: Beyond PICO: the SPIDER tool for qualitative evidence synthesis. Qual Health Res. 2012, 22: 1435-1443. 10.1177/1049732312452938.CrossRefPubMed Cooke A, Smith D, Booth A: Beyond PICO: the SPIDER tool for qualitative evidence synthesis. Qual Health Res. 2012, 22: 1435-1443. 10.1177/1049732312452938.CrossRefPubMed
10.
go back to reference Evans D: Database searches for qualitative research. J Med Library Assoc. 2002, 9: 290-293. Evans D: Database searches for qualitative research. J Med Library Assoc. 2002, 9: 290-293.
11.
go back to reference Shaw RL, Booth A, Sutton AJ, Miller T, Smith JA, Young B, Jones DR, Dixon-Woods M: Finding qualitative research: an evaluation of search strategies. BMC Med Res Methodol. 2004, 4: 5-10.1186/1471-2288-4-5.CrossRefPubMedPubMedCentral Shaw RL, Booth A, Sutton AJ, Miller T, Smith JA, Young B, Jones DR, Dixon-Woods M: Finding qualitative research: an evaluation of search strategies. BMC Med Res Methodol. 2004, 4: 5-10.1186/1471-2288-4-5.CrossRefPubMedPubMedCentral
13.
go back to reference Kenny A, Hyett N, Sawtell J, Dickson-Swift V, Farmer J, O’Meara P: Community participation in rural health: a scoping review. BMC Health Serv Res. 2013, 13: 64-10.1186/1472-6963-13-64.CrossRefPubMedPubMedCentral Kenny A, Hyett N, Sawtell J, Dickson-Swift V, Farmer J, O’Meara P: Community participation in rural health: a scoping review. BMC Health Serv Res. 2013, 13: 64-10.1186/1472-6963-13-64.CrossRefPubMedPubMedCentral
14.
go back to reference Methley AM, Chew-Graham C, Campbell S, Cheraghi-Sohi S: Experiences of UK health care services for people with Multiple Sclerosis: a systematic narrative review. Health Expect 2014, epub ahead of print.. Methley AM, Chew-Graham C, Campbell S, Cheraghi-Sohi S: Experiences of UK health care services for people with Multiple Sclerosis: a systematic narrative review. Health Expect 2014, epub ahead of print..
15.
go back to reference Sinfield P, Baker R, Camosso- Stefinovic J, Colman AM, Tarrant C, Mellon JK, Steward W, Kockelbergh R, Agarwal S: Men’s and carer’s experiences of care for prostate cancer: a narrative literature review. Health Expect. 2009, 12: 301-312. 10.1111/j.1369-7625.2009.00546.x.CrossRefPubMed Sinfield P, Baker R, Camosso- Stefinovic J, Colman AM, Tarrant C, Mellon JK, Steward W, Kockelbergh R, Agarwal S: Men’s and carer’s experiences of care for prostate cancer: a narrative literature review. Health Expect. 2009, 12: 301-312. 10.1111/j.1369-7625.2009.00546.x.CrossRefPubMed
16.
go back to reference Lohne V, Aasgaard T, Caspari S, Slettebo A, Naden D: The lonely battle for dignity: individuals struggling with multiple sclerosis. Nurs Ethics. 2010, 17 (3): 301-311. 10.1177/0969733010361439.CrossRefPubMed Lohne V, Aasgaard T, Caspari S, Slettebo A, Naden D: The lonely battle for dignity: individuals struggling with multiple sclerosis. Nurs Ethics. 2010, 17 (3): 301-311. 10.1177/0969733010361439.CrossRefPubMed
17.
go back to reference Mackereth PA, Booth K, Hillier VF, Caress A: Reflexology and progressive muscle relaxation training for people with multiple sclerosis: a crossover trial. Complement Ther Clin Pract. 2008, 15: 14-21. 10.1016/j.ctcp.2008.07.002.CrossRefPubMed Mackereth PA, Booth K, Hillier VF, Caress A: Reflexology and progressive muscle relaxation training for people with multiple sclerosis: a crossover trial. Complement Ther Clin Pract. 2008, 15: 14-21. 10.1016/j.ctcp.2008.07.002.CrossRefPubMed
18.
go back to reference Isaksson AK, Ahlström G: Managing chronic sorrow: experiences of patients with multiple sclerosis. J Neurosci Nurs. 2008, 40 (3): 180-191. 10.1097/01376517-200806000-00009.CrossRefPubMed Isaksson AK, Ahlström G: Managing chronic sorrow: experiences of patients with multiple sclerosis. J Neurosci Nurs. 2008, 40 (3): 180-191. 10.1097/01376517-200806000-00009.CrossRefPubMed
19.
go back to reference Edwards RG, Barlow JH, Turner AP: Experiences of diagnosis and treatment among people with multiple sclerosis. J Eval Clin Pract. 2008, 14 (3): 460-464. 10.1111/j.1365-2753.2007.00902.x.CrossRefPubMed Edwards RG, Barlow JH, Turner AP: Experiences of diagnosis and treatment among people with multiple sclerosis. J Eval Clin Pract. 2008, 14 (3): 460-464. 10.1111/j.1365-2753.2007.00902.x.CrossRefPubMed
20.
go back to reference Barker-Collo S, Cartwright C, Read J: Into the unknown: The experiences of individuals living with multiple sclerosis. J Neurosci Nurs. 2006, 38 (6): 435-441. 10.1097/01376517-200612000-00008.CrossRefPubMed Barker-Collo S, Cartwright C, Read J: Into the unknown: The experiences of individuals living with multiple sclerosis. J Neurosci Nurs. 2006, 38 (6): 435-441. 10.1097/01376517-200612000-00008.CrossRefPubMed
21.
go back to reference Isaksson AK, Ahlström G: From symptom to diagnosis: illness experiences of multiple sclerosis patients. J Neurosci Nurs. 2006, 38 (4): 229-237. 10.1097/01376517-200608000-00005.CrossRefPubMed Isaksson AK, Ahlström G: From symptom to diagnosis: illness experiences of multiple sclerosis patients. J Neurosci Nurs. 2006, 38 (4): 229-237. 10.1097/01376517-200608000-00005.CrossRefPubMed
22.
go back to reference Miller CE, Jezewski MA: Relapsing MS patients’ experiences with glatiramer acetate treatment: a phenomenologic study. J Neurosci Nurs. 2006, 38 (1): 37-41. 10.1097/01376517-200602000-00008.CrossRefPubMed Miller CE, Jezewski MA: Relapsing MS patients’ experiences with glatiramer acetate treatment: a phenomenologic study. J Neurosci Nurs. 2006, 38 (1): 37-41. 10.1097/01376517-200602000-00008.CrossRefPubMed
23.
go back to reference Johnson J: On receiving the diagnosis of multiple sclerosis: managing the transition. Mult Scler. 2003, 9 (1): 82-88. 10.1191/1352458503ms856oa.CrossRefPubMed Johnson J: On receiving the diagnosis of multiple sclerosis: managing the transition. Mult Scler. 2003, 9 (1): 82-88. 10.1191/1352458503ms856oa.CrossRefPubMed
24.
go back to reference Miller CE, Jezewski MA: A phenomenologic assessment of relapsing MS patients’ experiences during treatment with Interferon Beta-1(*). J Neurosci Nurs. 2001, 33 (5): 240-244. 10.1097/01376517-200110000-00004.CrossRefPubMed Miller CE, Jezewski MA: A phenomenologic assessment of relapsing MS patients’ experiences during treatment with Interferon Beta-1(*). J Neurosci Nurs. 2001, 33 (5): 240-244. 10.1097/01376517-200110000-00004.CrossRefPubMed
25.
go back to reference Miller CM: The lived experience of relapsing multiple sclerosis: a phenomenological study. J Neurosci Nurs. 1997, 29 (5): 294-304. 10.1097/01376517-199710000-00003.CrossRefPubMed Miller CM: The lived experience of relapsing multiple sclerosis: a phenomenological study. J Neurosci Nurs. 1997, 29 (5): 294-304. 10.1097/01376517-199710000-00003.CrossRefPubMed
26.
go back to reference Aars H, Bruusgaard D: Chronic disease and sexuality: an interview study on sexual dysfunction in patients with multiple sclerosis. Tidsskrift Den Norske Laegeforening. 1989, 109 (32): 3352-3354. Aars H, Bruusgaard D: Chronic disease and sexuality: an interview study on sexual dysfunction in patients with multiple sclerosis. Tidsskrift Den Norske Laegeforening. 1989, 109 (32): 3352-3354.
27.
go back to reference Rintell DJ, Frankel D, Minden SL, Glanz BI: Patients’ perspectives on quality of mental health care for people with MS. Gen Hosp Psychiatry. 2012, 34 (6): 604-610. 10.1016/j.genhosppsych.2012.04.001.CrossRefPubMed Rintell DJ, Frankel D, Minden SL, Glanz BI: Patients’ perspectives on quality of mental health care for people with MS. Gen Hosp Psychiatry. 2012, 34 (6): 604-610. 10.1016/j.genhosppsych.2012.04.001.CrossRefPubMed
28.
go back to reference Laidlaw A, Henwood S: Patients with multiple sclerosis: their experiences and perceptions of the MRI investigation. J Diagn Radiogr Imaging. 2003, 5 (1): 19-25. 10.1017/S146047280300004X.CrossRef Laidlaw A, Henwood S: Patients with multiple sclerosis: their experiences and perceptions of the MRI investigation. J Diagn Radiogr Imaging. 2003, 5 (1): 19-25. 10.1017/S146047280300004X.CrossRef
29.
go back to reference Koopman W, Schweitzer A: The journey to multiple sclerosis: a qualitative study. J Neurosci Nurs. 1999, 31 (1): 17-26. 10.1097/01376517-199902000-00003.CrossRefPubMed Koopman W, Schweitzer A: The journey to multiple sclerosis: a qualitative study. J Neurosci Nurs. 1999, 31 (1): 17-26. 10.1097/01376517-199902000-00003.CrossRefPubMed
30.
go back to reference Hansen AK, Krogh H, Bangsgaard L, Aabling S: Facing the diagnosis. Sygeplejersken. 2008, 4: 52-56. Hansen AK, Krogh H, Bangsgaard L, Aabling S: Facing the diagnosis. Sygeplejersken. 2008, 4: 52-56.
31.
go back to reference Loveland CA: The experiences of African americans and euro-americans with multiple sclerosis. Sex Disabil. 1999, 17 (1): 19-35. 10.1023/A:1021499628918.CrossRef Loveland CA: The experiences of African americans and euro-americans with multiple sclerosis. Sex Disabil. 1999, 17 (1): 19-35. 10.1023/A:1021499628918.CrossRef
32.
go back to reference Moriya R, Suzuki S: A qualitative study relating to the experiences of people with MS: differences by disease severity. Br J Neurosci Nurs. 2011, 7 (4): 593-600. 10.12968/bjnn.2011.7.4.593.CrossRef Moriya R, Suzuki S: A qualitative study relating to the experiences of people with MS: differences by disease severity. Br J Neurosci Nurs. 2011, 7 (4): 593-600. 10.12968/bjnn.2011.7.4.593.CrossRef
33.
go back to reference Classen S, Lou JQ: Exploring rehabilitation and wellness needs of people with MS living in South Florida: a pilot study. Intern J MS Care. 2004, 1: 26-31. 10.7224/1537-2073-6.1.26.CrossRef Classen S, Lou JQ: Exploring rehabilitation and wellness needs of people with MS living in South Florida: a pilot study. Intern J MS Care. 2004, 1: 26-31. 10.7224/1537-2073-6.1.26.CrossRef
35.
go back to reference Chalavi S, Simmons A, Dijkstra H, Barker GJ, Reindeers AATS: Quantitative and qualitative assessment of structural magnetic resonance imaging data in a two-center study. BMC Med Imaging. 2012, 12: 27-10.1186/1471-2342-12-27.CrossRefPubMedPubMedCentral Chalavi S, Simmons A, Dijkstra H, Barker GJ, Reindeers AATS: Quantitative and qualitative assessment of structural magnetic resonance imaging data in a two-center study. BMC Med Imaging. 2012, 12: 27-10.1186/1471-2342-12-27.CrossRefPubMedPubMedCentral
Metadata
Title
PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews
Authors
Abigail M Methley
Stephen Campbell
Carolyn Chew-Graham
Rosalind McNally
Sudeh Cheraghi-Sohi
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-014-0579-0

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue