Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2004

Open Access 01-12-2004 | Research article

Finding qualitative research: an evaluation of search strategies

Authors: Rachel L Shaw, Andrew Booth, Alex J Sutton, Tina Miller, Jonathan A Smith, Bridget Young, David R Jones, Mary Dixon-Woods

Published in: BMC Medical Research Methodology | Issue 1/2004

Login to get access

Abstract

Background

Qualitative research makes an important contribution to our understanding of health and healthcare. However, qualitative evidence can be difficult to search for and identify, and the effectiveness of different types of search strategies is unknown.

Methods

Three search strategies for qualitative research in the example area of support for breast-feeding were evaluated using six electronic bibliographic databases. The strategies were based on using thesaurus terms, free-text terms and broad-based terms. These strategies were combined with recognised search terms for support for breast-feeding previously used in a Cochrane review. For each strategy, we evaluated the recall (potentially relevant records found) and precision (actually relevant records found).

Results

A total yield of 7420 potentially relevant records was retrieved by the three strategies combined. Of these, 262 were judged relevant. Using one strategy alone would miss relevant records. The broad-based strategy had the highest recall and the thesaurus strategy the highest precision. Precision was generally poor: 96% of records initially identified as potentially relevant were deemed irrelevant. Searching for qualitative research involves trade-offs between recall and precision.

Conclusions

These findings confirm that strategies that attempt to maximise the number of potentially relevant records found are likely to result in a large number of false positives. The findings also suggest that a range of search terms is required to optimise searching for qualitative evidence. This underlines the problems of current methods for indexing qualitative research in bibliographic databases and indicates where improvements need to be made.
Appendix
Available only for authorised users
Literature
1.
go back to reference Murphy E, Dingwall R, Greenbatch D, Parker S, Watson P: Qualitative research methods in health technology assessment: a review of the literature. Health Technology Assessment. 1998, 2: iii-ix, 1-274.PubMed Murphy E, Dingwall R, Greenbatch D, Parker S, Watson P: Qualitative research methods in health technology assessment: a review of the literature. Health Technology Assessment. 1998, 2: iii-ix, 1-274.PubMed
2.
3.
4.
go back to reference Hawaii Medical Library: Evidence-Based filters for CINAHL (Ovid). 2003, Accessed at http://hml.org/WWW/qr-long 31 October Hawaii Medical Library: Evidence-Based filters for CINAHL (Ovid). 2003, Accessed at http://​hml.​org/​WWW/​qr-long 31 October
5.
go back to reference Dixon-Woods M, Fitzpatrick R, Roberts K: Including qualitative research in systematic reviews: opportunities and problems. Journal of Evaluation in Clinical Practice. 2001, 7: 125-133. 10.1046/j.1365-2753.2001.00257.x.CrossRefPubMed Dixon-Woods M, Fitzpatrick R, Roberts K: Including qualitative research in systematic reviews: opportunities and problems. Journal of Evaluation in Clinical Practice. 2001, 7: 125-133. 10.1046/j.1365-2753.2001.00257.x.CrossRefPubMed
6.
go back to reference NHS Centre for Reviews and Dissemination: Undertaking systematic reviews of research on effectiveness: CRD's guidance for those carrying out or commissioning reviews. Report number 4 (2nd edition). 2001, York, CRD NHS Centre for Reviews and Dissemination: Undertaking systematic reviews of research on effectiveness: CRD's guidance for those carrying out or commissioning reviews. Report number 4 (2nd edition). 2001, York, CRD
7.
go back to reference O'Rourke A, Booth A, Ford N: Another fine MeSH: clinical medicine meets information science. Journal of Information Science. 1999, 25: 275-281. 10.1177/0165551994232756.CrossRef O'Rourke A, Booth A, Ford N: Another fine MeSH: clinical medicine meets information science. Journal of Information Science. 1999, 25: 275-281. 10.1177/0165551994232756.CrossRef
8.
go back to reference Diagnostic strategies for information retrieval: Quantitative issues in information retrieval. http://www.diagnosticstrategies.com/info_retrieval.htm. 2004 Diagnostic strategies for information retrieval: Quantitative issues in information retrieval. http://​www.​diagnosticstrate​gies.​com/​info_​retrieval.​htm.​ 2004
9.
go back to reference Sikorski J, Renfrew MJ, Pindoria S, Wade A: Support for breast-feeding mothers (Cochrane Review). 2002, Oxford Update Software, The Cochrane Library, Issue 3: Sikorski J, Renfrew MJ, Pindoria S, Wade A: Support for breast-feeding mothers (Cochrane Review). 2002, Oxford Update Software, The Cochrane Library, Issue 3:
10.
go back to reference Grant MJ: Searching for qualitative research studies on the MEDLINE database: the development of an optimal search strategy. Department of Information and Library Studies. 2000, Aberystwyth, University of Wales Grant MJ: Searching for qualitative research studies on the MEDLINE database: the development of an optimal search strategy. Department of Information and Library Studies. 2000, Aberystwyth, University of Wales
11.
go back to reference Buckland MK, Gey F: The relationship between recall and precision. Journal of the American Society for Information Retrieval. 1994, 45: 12-19.CrossRef Buckland MK, Gey F: The relationship between recall and precision. Journal of the American Society for Information Retrieval. 1994, 45: 12-19.CrossRef
12.
go back to reference Barroso J, Gallup CJ, Sandelowski M, Meynell J, Pearce PF, Collins LJ: The challenge of searching for and retrieving qualitative studies. Western Journal of Nursing Research. 2003, 25: 153-178. 10.1177/0193945902250034.CrossRefPubMed Barroso J, Gallup CJ, Sandelowski M, Meynell J, Pearce PF, Collins LJ: The challenge of searching for and retrieving qualitative studies. Western Journal of Nursing Research. 2003, 25: 153-178. 10.1177/0193945902250034.CrossRefPubMed
13.
go back to reference Hartley J, Benjamin M: An evaluation of structured abstracts in journals published by the British Psychological Society. British Journal of Educational Psychology. 1998, 68: 443-456.CrossRef Hartley J, Benjamin M: An evaluation of structured abstracts in journals published by the British Psychological Society. British Journal of Educational Psychology. 1998, 68: 443-456.CrossRef
Metadata
Title
Finding qualitative research: an evaluation of search strategies
Authors
Rachel L Shaw
Andrew Booth
Alex J Sutton
Tina Miller
Jonathan A Smith
Bridget Young
David R Jones
Mary Dixon-Woods
Publication date
01-12-2004
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2004
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-4-5

Other articles of this Issue 1/2004

BMC Medical Research Methodology 1/2004 Go to the issue