Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Health and Quality of Life Outcomes
Published in: Health and Quality of Life Outcomes 1/2017

Open Access 01-12-2017 | Research

Development and use of a content search strategy for retrieving studies on patients' views and preferences

Authors: Anna Selva, Ivan Solà, Yuan Zhang, Hector Pardo-Hernandez, R. Brian Haynes, Laura Martínez García, Tamara Navarro, Holger Schünemann, Pablo Alonso-Coello

Published in: Health and Quality of Life Outcomes | Issue 1/2017

Login to get access

Abstract

Background

Identifying scientific literature addressing patients’ views and preferences is complex due to the wide range of studies that can be informative and the poor indexing of this evidence. Given the lack of guidance we developed a search strategy to retrieve this type of evidence.

Methods

We assembled an initial list of terms from several sources, including the revision of the terms and indexing of topic-related studies and, methods research literature, and other relevant projects and systematic reviews. We used the relative recall approach, evaluating the capacity of the designed search strategy for retrieving studies included in relevant systematic reviews for the topic. We implemented in practice the final version of the search strategy for conducting systematic reviews and guidelines, and calculated search’s precision and the number of references needed to read (NNR).

Results

We assembled an initial version of the search strategy, which had a relative recall of 87.4% (yield of 132/out of 151 studies). We then added some additional terms from the studies not initially identified, and re-tested this improved version against the studies included in a new set of systematic reviews, reaching a relative recall of 85.8% (151/out of 176 studies, 95% CI 79.9 to 90.2). This final version of the strategy includes two sets of terms related with two domains: “Patient Preferences and Decision Making” and “Health State Utilities Values”. When we used the search strategy for the development of systematic reviews and clinical guidelines we obtained low precision values (ranging from 2% to 5%), and the NNR from 20 to 50.

Conclusions

This search strategy fills an important research gap in this field. It will help systematic reviewers, clinical guideline developers, and policy-makers to retrieve published research on patients’ views and preferences. In turn, this will facilitate the inclusion of this critical aspect when formulating heath care decisions, including recommendations.
Appendix
Available only for authorised users
Literature
1.
Alonso-Coello P, Schunemann H, Moberg J, Brignardello-Petersen R, Akl E, Marina D, et al., GRADE Working Group. GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 1: Introduction. BMJ. 2016;353:i2016. doi:10.​1136/​bmj.​i2016.CrossRefPubMed
2.
Alonso-Coello P, Oxman AD, Moberg J, Brignardello-Petersen R, Akl E, Marina D, et al. GRADE working group. GRADE evidence to decision (EtD) frameworks: 2. Clinical practice guidelines. BMJ. 2016;353:i2089. doi:10.​1136/​bmj.​i2089.CrossRefPubMed
3.
Schünemann HJ, Mustafa R, Brozek J, Santesso N, Alonso-Coello P, Guyatt G, et al., GRADE Working Group. Development of the GRADE evidence to decision (EtD) frameworks for tests in clinical practice and public health. J Clin Epidemiol. 2016;76:89–98.
4.
Andrews J, Guyatt G, Oxman AD, Alderson P, Dahm P, Falck-Ytter Y, et al. GRADE guidelines: 14. Going from evidence to recommendations: the significance and presentation of recommendations. J Clin Epidemiol. 2013;66:719–25.CrossRefPubMed
5.
Krahn M, Naglie G. The next step in guideline development: incorporating patient preferences. JAMA. 2008;300:436–8.CrossRefPubMed
6.
Mühlbacher AC, Juhnke C. Patient preferences versus physicians’ judgement: does it make a difference in healthcare decision making? Appl Health Econ Health Policy. 2013;11:163–80.CrossRefPubMed
7.
Andrews JC, Schünemann HJ, Oxman AD, Pottie K, Meerpohl JJ, Alonso Coello P, et al. GRADE guidelines: 15. Going from evidence to recommendation- determinants of a recommendation’s direction and strength. J Clin Epidemiol. 2013;66:726–35.CrossRefPubMed
8.
Chong C, Chen I, Naglie C, Krahn M. Do clinical practice guidelines incorporate evidence on patient preferences? Med Dec Making. 2007;27:E63–4.
9.
Elwyn G, Légaré F, Edwards A, Weijden van der T, May C. Arduous implementation: does the normalisation process model explain why it’s so difficult to embed decision support technologies for patients in routine clinical practice. Implement Sci. 2008;3:57. doi:10.​1186/​1748-5908-3-57. PubMed CentralView ArticlePubMedCrossRefPubMedPubMedCentral
10.
Légaré F, Ratté S, Gravel K, Graham ID. Barriers and facilitators to implementing shared decision-making in clinical practice: update of a systematic review of health professionals’ perceptions. Pat Educ Couns. 2008;73:526–35. doi:10.​1016/​j.​pec.​2008.​07.​018.CrossRef
11.
12.
Acuña-Izcaray A, Sánchez-Angarita E, Plaza V, Rodrigo G, Montes de Oca M, Gich I, et al. Quality assessment of asthma clinical practice guidelines: a systematic appraisal. Chest. 2013;144(2):390–7. doi:10.​1378/​chest.​12-2005.
13.
Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, et al. The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care. 2010;19:6 e58.
14.
Brouwers M, Kho ME, Browman GP, Cluzeau F, Feder G, Fervers B, et al., on behalf of the AGREE Next Steps Consortium. AGREE II: advancing guideline development, reporting and evaluation in healthcare. Can Med Assoc J. 2010;182:E839–42. doi:10.​1503/​cmaj.​090449.
15.
Kung J, Miller RR, Mackowiak PA. Failure of clinical practice guidelines to meet institute of medicine standards: two more decades of little, if any, progress. Arch Intern Med. 2012;172(21):1628–33.CrossRefPubMed
16.
Selva A, Sanabria AJ, Pequeño S, et al. Incorporationg patients’ views in guideline development: a systematic review of guidance documents. Under revision, J Clin Epidemiol 2017. Available online 1 June 2017. In Press, Accepted Manuscript. doi:10.​1016/​j.​jclinepi.​2017.​05.​018.
17.
van der Weijden T, Legare F, Boivin A, et al. How to integrate individual patient values and preferences in clinical practice guidelines? A research protocol. Implement Sci. 2010;5:10.CrossRefPubMedPubMedCentral
18.
19.
Feeny D, Furlong W, Saigal S, Sun J. Comparing directly measured standard gamble scores to HUI2 and HUI3 utility scores: group- and individual-level comparisons. Soc Sci Med. 2004;58(4):799–809.CrossRefPubMed
20.
Ariza-Ariza R, Hernandez-Cruz B, Carmona L, Dolores Ruiz-Montesinos M, Ballina J, Navarro-Sarabia F. Assessing utility values in rheumatoid arthritis: a comparison between time trade-off and the EuroQol. Arthritis Rheum. 2006;55(5):751–6.CrossRefPubMed
21.
Rashidi AA, Anis AH, Marra CA. Do visual analogue scale (VAS) derived standard gamble (SG) utilities agree with health utilities index utilities? A comparison of patient and community preferences for health status in rheumatoid arthritis patients. Health Qual Life Outcomes. 2006;4:25. doi:10.​1186/​1477-7525-4-25.CrossRefPubMedPubMedCentral
22.
Bosch JL, Hunink MG. Comparison of the health utilities index mark 3 (HUI3) and the EuroQol EQ-5D in patients treated for intermittent claudication. Qual Life Res. 2000;9(6):591–601.CrossRefPubMed
23.
24.
Kipp R, Lehman J, Israel J, Edwards N, Becker T, Raval AN. Patient preferences for coronary artery bypass graft surgery or Percutaneous intervention in multi-vessel coronary artery disease. Catheter Cardiovasc Interv. 2013;82(2):212–8. doi:10.​1002/​ccd.​24399.CrossRefPubMedPubMedCentral
25.
Hersch J, Jansen J, Barratt A, Irwig L, Houssami N, Jacklyn G, et al. Overdetection in breast cancer screening: development and preliminary evaluation of a decision aid. BMJ Open. 2014;4(9):e006016.
26.
Hersch Hersch J, Jansen J, Barratt A, Irwig L, Houssami N, Howard K, et al. Women’s views on overdiagnosis in breast cancer screening: a qualitative study. BMJ. 2013;346:f158. doi:10.​1136/​bmj.​f158.
27.
28.
Wessels M, Hielkema L, van der Weijden T. How to identify existing literature on patients’ knowledge, views, and values: the development of a validated search filter. J Med Libr Assoc. 2016;104(4):320–4.CrossRefPubMedPubMedCentral
29.
Arber M, Garcia S, Veale T, Edwards M, Shaw A, Glanville J. Sensitivity of a Search Filter Designed to Identify Studies Reporting Health State Utility Values. HTAi 12th Annual Conference. 15-17 June 2015, Oslo.
30.
van Hoorn R, Kievit W, Booth A, Mozygemba K, Lysdahl KB, Refolo P, et al. The development of PubMed search strategies for patient preferences for treatment outcomes. BMC Med Res Methodol. 2016;16:88. doi:10.​1186/​s12874-016-0192-5.
31.
MacLean S, Mulla S, Akl EA, et al. Patient values and preferences in decision making for antithrombotic therapy: a systematic review: antithrombotic therapy and prevention of thrombosis, 9th ed: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines. Chest. 2012;141(2 Suppl):e1S–23S.CrossRefPubMedPubMedCentral
32.
Arnold D, Girling A, Stevens A, et al. Comparison of direct and indirect methods of estimating health state utilities for resource allocation: review and empirical analysis. BMJ. 2009;339:b2688.CrossRefPubMedPubMedCentral
33.
Dolan P, Gudex C, Kind P, et al. Valuing health states: a comparison of methods. J Health Econ. 1996;15:209–31.CrossRefPubMed
34.
Drummond M. Introducing economic and quality of life measurements into clinical studies. Ann Med. 2001;33:344–9.CrossRefPubMed
35.
Drummond MF, Sculpher MJ, Torrance GW, O’brien BJ, Stoddart GL. Cost-utility analysis. Methods for the economic evaluation of health care programmes. 3rd ed. Oxford: Oxford University Press; 2005. p. 137–209.
36.
Montori V, Devereaux P, Straus S, Haynes B, Guyatt G. Decision making and the patient. In: Guyatt G, Rennie D, Meade M, Cook D, editors. The users’ guides to the medical literature: a manual for evidence-based clinical practice. 2nd ed. New York, NY: McGraw-Hill; 2008.
37.
Muskopf J. Utility Assessment. From Chumney EC and Simpson KN. Methods and Designs for outcomes research. American Society of Health-System Pharmacist. 2006.
38.
39.
Torrance GW. Measurement of health state utilities for economic appraisal. J Health Econom. 1986;5:1–30.CrossRef
40.
Bremmer KE, Chong CAKY, Tomlinson G, Alibhai SMH, Krahn MD. A review and meta-analysis of Prostate cancer utilities. Med Decis Mak. 2007;27:288.CrossRef
41.
Brooker AS, Carcone S, Witteman W, Krahn M. Quantitative patient preference evidence for health technology assessment: a case study. Int J Technol Assessment Health Care. 2013;29(3):290–300.CrossRef
42.
Morton RL, Tong A, Howard K, Snelling P, Webster ACBMJ. The views of patients and carers in treatment decision making for chronic kidney disease: systematic review and thematic synthesis of qualitative studies. BMC. 2010;340:c112. doi:10.​1136/​bmj.​c112.​ CrossRef
43.
Peasgood T, Ward SE, Brazier J. Health-state utility values in breast cancer. Expert Rev Pharmacoecon Outcomes Res. 2010;10:553–66.CrossRefPubMed
44.
Petrillo J, van Nooten F, Jones P, Rutten-van MM. Utility estimation in chronic obstructive pulmonary disease. A preference for change? PharmacoEconomics. 2011;29:917–32.CrossRefPubMed
45.
Alfadda AA, Al-Dhwayan MM, Alharbi AA, Al Khudhair BK, Al Nozha OM, Al-Qahtani NM, et al. The Saudi clinical practice guideline for the management of overweight and obesity in adults. Saudi Med J. 2016;37(10):1151–62. doi:10.​15537/​smj.​2016.​10.​14353.
46.
Al-Hameed F, Al-Dorzi HM, AlMomen A, Algahtani F, AlZahrani H, AlSaleh K, et al. Prophylaxis and treatment of venous thromboembolism in patients with cancer: the Saudi clinical practice guideline. Ann Saudi Med. 2015;35(2):95–106. doi:10.​5144/​0256-4947.​2015.​95.
47.
Al-Hameed FM, Al-Dorzi HM, Al-Momen AM, Algahtani FH, Al-Zahrani HA, Al-Saleh KA, et al. The Saudi clinical practice guideline for the treatment of venous thromboembolism. Outpatient versus inpatient management. Saudi Med J. 2015;36(8):1004–10. doi:10.​15537/​smj.​2015.​8.​12024.
48.
49.
Sampson M, Zhang L, Morrison A, et al. An alternative to the hand searching gold standard: validating methodological search filters using relative recall. BMC Medl Res Methodol. 2006;6:33. doi:10.​1186/​1471-2288-6-33.CrossRef
50.
Hoogendam A, de Vries Robbé PF, Stalenhoef AF, Overbeke AJ. Evaluation of PubMed filters used for evidence-based searching: validation using relative recall. J Med Libr Assoc. 2009;97(3):186–93.CrossRefPubMedPubMedCentral
51.
Vincent S, Greenley S, Beaven O. Clinical evidence diagnosis: developing a sensitive search strategy to retrieve diagnostic studies on deep vein thrombosis: a pragmatic approach. Health Inf Libr J. 2003;20(3):150–9.CrossRef
52.
Doust JA, Pietrzak E, Sanders S, Glasziou PP. Identifying studies for systematic reviews of diagnostic tests was difficult due to the poor sensitivity and precision of methodologic filters and the lack of information in the abstract. J Clin Epidemiol. 2005;58(5):444–9.CrossRefPubMed
53.
Grupo de trabajo de la Guía de práctica clínica de atención en el embarazo y puerperio. Guía de práctica clínica de atención en el embarazo y puerperio. Ministerio de Sanidad, Servicios Sociales e Igualdad. Agencia de Evaluación de Tecnologías Sanitarias de Andalucía; 2014. Guías de Práctica Clínica en el SNS: AETSA 2011/10.
54.
Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2014. Available from http://​handbook.​cochrane.​org/​. Accessed 6 June 2017.
55.
Leeflang M, McDonald S, Scholten RJ, Rutjes A, Reitsma JJB. Search strategies to identify diagnostic accuracy studies in MEDLINE and EMBASE. Cochrane Database Syst Rev. 2007, Issue 2. Art. No.: MR000022. doi:10.​1002/​14651858.​MR000022.​pub2.
56.
57.
Shaw RL, Holland C, Pattison HM, Cooke R. Patients’ perceptions and experiences of cardiovascular disease and diabetes prevention programmes: a systematic review and framework synthesis using the theoretical domains framework. Soc Sci Med. 2016;156:192–203.CrossRefPubMed
58.
59.
Finlayson CS, Chen YT, Fu MR. The impact of patients’ awareness of disease status on treatment preferences and quality of life among patients with metastatic cancer: a systematic review from 1997-2014. J Palliat Med. 2015;18(2):176–86. doi:10.​1089/​jpm.​2014.​0222. Epub 2014 Sep 26CrossRefPubMed
60.
61.
Cowley A, Evans C, Bath-Hextall F, Cooper J. Patient, nursing and medical staff experiences and perceptions of the care of people with palliative esophagogastric cancer: a systematic review of the qualitative evidence. JBI Database Syst Rev Implement Rep. 2016;14(10):134–66.CrossRef
62.
Loewen PS, Ji AT, Kapanen A, McClean A. Patient values and preferences for antithrombotic therapy in atrial fibrillation. A narrative systematic review. Thromb Haemost. 2017;117(6):1007–22. doi:10.​1160/​TH16-10-0787.CrossRefPubMed
63.
Brown J, Cook K, Adamski K, Lau J, Bargo D, Breen S, et al. Utility values associated with advanced or metastatic non-small cell lung cancer: data needs for economic modeling. Expert Rev Pharmacoecon Outcomes Res. 2017;17(2):153–64. doi:10.​1080/​14737167.​2017.​1311210.
64.
65.
Carter GC, King DT, Hess LM, Mitchell SA, Taipale KL, Kiiskinen U, et al. Health state utility values associated with advanced gastric, oesophageal, or gastro-oesophageal junction adenocarcinoma: a systematic review. J Med Econ. 2015;18(11):954–66. doi:10.​3111/​13696998.​2015.​1066380.
66.
Lefebvre C, Manheimer E, Glanville J. Chapter 6: Searching for studies. In: Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011. Available from http://​handbook.​cochrane.​org/​.
67.
Sampson M, Tetzlaff J, Urquhart C. Precision of healthcare systematic review searches in a cross-sectional sample. Res Synth Methods. 2011;2(2):119–25.CrossRefPubMed
68.
Glanville J, Bayliss S, Booth A, Dundar Y, Fernandes H, Fleeman ND, et al. So many filters, so little time: the development of a search filter appraisal checklist. J Med Library Assoc. 2008;96(4):356–61.
69.
70.
71.
Grant MJ. How does your searching grow? A survey of search preferences and the use of optimal search strategies in the identification of qualitative research. Health Inf Libr J. 2004;21:21–32.CrossRef
72.
DeJean D, Giacomini M, Simeonov D, Smith A. Finding qualitative research evidence for health technology assessment. Qual Health Res. 2016;26(10):1307–17.CrossRefPubMed
73.
Metadata
Title
Development and use of a content search strategy for retrieving studies on patients' views and preferences
Authors
Anna Selva
Ivan Solà
Yuan Zhang
Hector Pardo-Hernandez
R. Brian Haynes
Laura Martínez García
Tamara Navarro
Holger Schünemann
Pablo Alonso-Coello
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2017
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-017-0698-5

Other articles of this Issue 1/2017

Health and Quality of Life Outcomes 1/2017 Go to the issue

Research

Development and validation of a patient-reported questionnaire assessing systemic therapy induced diarrhea in oncology patients

Research

How does playing adapted sports affect quality of life of people with mobility limitations? Results from a mixed-method sequential explanatory study

Research

Incremental decreases in quality-adjusted life years (QALY) associated with higher levels of depressive symptoms for U.S. Adults aged 65 years and older

Research

Fatigue and sleepiness determine respiratory quality of life among veterans evaluated for sleep apnea

Research

Bayesian nonparametric estimation of EQ-5D utilities for United States using the existing United Kingdom data

Research

The use of the EQ-5D-Y health related quality of life outcome measure in children in the Western Cape, South Africa: psychometric properties, feasibility and usefulness - a longitudinal, analytical study