Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2020

Open Access 01-12-2020 | Research

Development and use of health outcome descriptors: a guideline development case study

Authors: Tejan Baldeh, Zuleika Saz-Parkinson, Paola Muti, Nancy Santesso, Gian Paolo Morgano, Wojtek Wiercioch, Robby Nieuwlaat, Axel Gräwingholt, Mireille Broeders, Stephen Duffy, Solveig Hofvind, Lennarth Nystrom, Lydia Ioannidou-Mouzaka, Sue Warman, Helen McGarrigle, Susan Knox, Patricia Fitzpatrick, Paolo Giorgi Rossi, Cecily Quinn, Bettina Borisch, Annette Lebeau, Chris de Wolf, Miranda Langendam, Thomas Piggott, Livia Giordano, Cary van Landsveld-Verhoeven, Jacques Bernier, Peter Rabe, Holger J. Schünemann

Published in: Health and Quality of Life Outcomes | Issue 1/2020

Login to get access

Abstract

Background

During healthcare guideline development, panel members often have implicit, different definitions of health outcomes that can lead to misunderstandings about how important these outcomes are and how to balance benefits and harms. McMaster GRADE Centre researchers developed ‘health outcome descriptors’ for standardizing descriptions of health outcomes and overcoming these problems to support the European Commission Initiative on Breast Cancer (ECIBC) Guideline Development Group (GDG). We aimed to determine which aspects of the development, content, and use of health outcome descriptors were valuable to guideline developers.

Methods

We developed 24 health outcome descriptors related to breast cancer screening and diagnosis for the European Commission Breast Guideline Development Group (GDG). Eighteen GDG members provided feedback in written format or in interviews. We then evaluated the process and conducted two health utility rating surveys.

Results

Feedback from GDG members revealed that health outcome descriptors are probably useful for developing recommendations and improving transparency of guideline methods. Time commitment, methodology training, and need for multidisciplinary expertise throughout development were considered important determinants of the process. Comparison of the two health utility surveys showed a decrease in standard deviation in the second survey across 21 (88%) of the outcomes.

Conclusions

Health outcome descriptors are feasible and should be developed prior to the outcome prioritization step in the guideline development process. Guideline developers should involve a subgroup of multidisciplinary experts in all stages of development and ensure all guideline panel members are trained in guideline methodology that includes understanding the importance of defining and understanding the outcomes of interest.
Appendix
Available only for authorised users
Literature
1.
go back to reference Institute of Medicine Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical practice guidelines we can trust. Washington, D.C.: National Academies Press; 2011. Institute of Medicine Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical practice guidelines we can trust. Washington, D.C.: National Academies Press; 2011.
2.
go back to reference Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. J Clin Epidemiol. 2010;63(12):1308–11.CrossRef Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. J Clin Epidemiol. 2010;63(12):1308–11.CrossRef
3.
go back to reference Schunemann HJ, Wiercioch W, Etxeandia I, Falavigna M, Santesso N, Mustafa R, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CMAJ. 2014;186(3):E123–42.CrossRef Schunemann HJ, Wiercioch W, Etxeandia I, Falavigna M, Santesso N, Mustafa R, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CMAJ. 2014;186(3):E123–42.CrossRef
4.
go back to reference Shekelle P, Woolf S, Grimshaw JM, Schunemann HJ, Eccles MP. Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012;7:62.CrossRef Shekelle P, Woolf S, Grimshaw JM, Schunemann HJ, Eccles MP. Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012;7:62.CrossRef
5.
go back to reference Eccles MP, Grimshaw JM, Shekelle P, Schunemann HJ, Woolf S. Developing clinical practice guidelines: target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest. Implement Sci. 2012;7:60.CrossRef Eccles MP, Grimshaw JM, Shekelle P, Schunemann HJ, Woolf S. Developing clinical practice guidelines: target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest. Implement Sci. 2012;7:60.CrossRef
6.
go back to reference Woolf S, Schunemann HJ, Eccles MP, Grimshaw JM, Shekelle P. Developing clinical practice guidelines: types of evidence and outcomes; values and economics, synthesis, grading, and presentation and deriving recommendations. Implement Sci. 2012;7:61.CrossRef Woolf S, Schunemann HJ, Eccles MP, Grimshaw JM, Shekelle P. Developing clinical practice guidelines: types of evidence and outcomes; values and economics, synthesis, grading, and presentation and deriving recommendations. Implement Sci. 2012;7:61.CrossRef
7.
go back to reference Qaseem A, Forland F, Macbeth F, Ollenschlager G, Phillips S, van der Wees P, et al. Guidelines international network: toward international standards for clinical practice guidelines. Ann Intern Med. 2012;156(7):525–31.CrossRef Qaseem A, Forland F, Macbeth F, Ollenschlager G, Phillips S, van der Wees P, et al. Guidelines international network: toward international standards for clinical practice guidelines. Ann Intern Med. 2012;156(7):525–31.CrossRef
8.
go back to reference Langer G, Meerpohl JJ, Perleth M, Gartlehner G, Kaminski-Hartenthaler A, Schunemann H. GRADE guidelines: 1. Introduction - GRADE evidence profiles and summary of findings tables. Z Evid Fortbild Qual Gesundhwes. 2012;106(5):357–68.CrossRef Langer G, Meerpohl JJ, Perleth M, Gartlehner G, Kaminski-Hartenthaler A, Schunemann H. GRADE guidelines: 1. Introduction - GRADE evidence profiles and summary of findings tables. Z Evid Fortbild Qual Gesundhwes. 2012;106(5):357–68.CrossRef
9.
go back to reference Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence--imprecision. J Clin Epidemiol. 2011;64(12):1283–93.CrossRef Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence--imprecision. J Clin Epidemiol. 2011;64(12):1283–93.CrossRef
10.
go back to reference Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011;64(4):395–400.CrossRef Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011;64(4):395–400.CrossRef
11.
go back to reference Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94.CrossRef Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94.CrossRef
12.
go back to reference Carrasco-Labra A, Brignardello-Petersen R, Santesso N, Neumann I, Mustafa RA, Mbuagbaw L, et al. Improving GRADE evidence tables part 1: a randomized trial shows improved understanding of content in summary of findings tables with a new format. J Clin Epidemiol. 2016;74:7–18.CrossRef Carrasco-Labra A, Brignardello-Petersen R, Santesso N, Neumann I, Mustafa RA, Mbuagbaw L, et al. Improving GRADE evidence tables part 1: a randomized trial shows improved understanding of content in summary of findings tables with a new format. J Clin Epidemiol. 2016;74:7–18.CrossRef
13.
go back to reference Langendam M, Carrasco-Labra A, Santesso N, Mustafa RA, Brignardello-Petersen R, Ventresca M, et al. Improving GRADE evidence tables part 2: a systematic survey of explanatory notes shows more guidance is needed. J Clin Epidemiol. 2016;74:19–27.CrossRef Langendam M, Carrasco-Labra A, Santesso N, Mustafa RA, Brignardello-Petersen R, Ventresca M, et al. Improving GRADE evidence tables part 2: a systematic survey of explanatory notes shows more guidance is needed. J Clin Epidemiol. 2016;74:19–27.CrossRef
14.
go back to reference Santesso N, Carrasco-Labra A, Langendam M, Brignardello-Petersen R, Mustafa RA, Heus P, et al. Improving GRADE evidence tables part 3: detailed guidance for explanatory footnotes supports creating and understanding GRADE certainty in the evidence judgments. J Clin Epidemiol. 2016;74:28–39.CrossRef Santesso N, Carrasco-Labra A, Langendam M, Brignardello-Petersen R, Mustafa RA, Heus P, et al. Improving GRADE evidence tables part 3: detailed guidance for explanatory footnotes supports creating and understanding GRADE certainty in the evidence judgments. J Clin Epidemiol. 2016;74:28–39.CrossRef
15.
go back to reference Guyatt GH, Feeny DH, Patrick DL. Measuring health-related quality of life. Ann Intern Med. 1993;118(8):622–9.CrossRef Guyatt GH, Feeny DH, Patrick DL. Measuring health-related quality of life. Ann Intern Med. 1993;118(8):622–9.CrossRef
16.
go back to reference Group GW. Handbook for grading the quality of evidence and the strength of recommendations using the GRADE approach. 2013. Group GW. Handbook for grading the quality of evidence and the strength of recommendations using the GRADE approach. 2013.
17.
go back to reference Torrance GW. Measurement of health state utilities for economic appraisal. J Health Econ. 1986;5(1):1–30.CrossRef Torrance GW. Measurement of health state utilities for economic appraisal. J Health Econ. 1986;5(1):1–30.CrossRef
18.
go back to reference Schunemann HJ, Griffith L, Stubbing D, Goldstein R, Guyatt GH. A clinical trial to evaluate the measurement properties of 2 direct preference instruments administered with and without hypothetical marker states. Med Decis Mak. 2003;23(2):140–9.CrossRef Schunemann HJ, Griffith L, Stubbing D, Goldstein R, Guyatt GH. A clinical trial to evaluate the measurement properties of 2 direct preference instruments administered with and without hypothetical marker states. Med Decis Mak. 2003;23(2):140–9.CrossRef
19.
go back to reference Schunemann HJ, Stahl E, Austin P, Akl E, Armstrong D, Guyatt GH. A comparison of narrative and table formats for presenting hypothetical health states to patients with gastrointestinal or pulmonary disease. Med Decis Mak. 2004;24(1):53–60.CrossRef Schunemann HJ, Stahl E, Austin P, Akl E, Armstrong D, Guyatt GH. A comparison of narrative and table formats for presenting hypothetical health states to patients with gastrointestinal or pulmonary disease. Med Decis Mak. 2004;24(1):53–60.CrossRef
20.
go back to reference Llewellyn-Thomas HA. Health state descriptions. Purposes, issues, a proposal. Med Care. 1996;34(12 Suppl):DS109–18.PubMed Llewellyn-Thomas HA. Health state descriptions. Purposes, issues, a proposal. Med Care. 1996;34(12 Suppl):DS109–18.PubMed
21.
go back to reference Schunemann HJ, Lerda D, Dimitrova N, Alonso-Coello P, Grawingholt A, Quinn C, et al. Methods for development of the European Commission initiative on breast cancer guidelines: recommendations in the era of guideline transparency. Ann Intern Med. 2019. https://doi.org/10.7326/M18-3445. Schunemann HJ, Lerda D, Dimitrova N, Alonso-Coello P, Grawingholt A, Quinn C, et al. Methods for development of the European Commission initiative on breast cancer guidelines: recommendations in the era of guideline transparency. Ann Intern Med. 2019. https://​doi.​org/​10.​7326/​M18-3445.
22.
go back to reference Berglund G, Bolund C, Fornander T, Rutqvist LE, Sjoden PO. Late effects of adjuvant chemotherapy and postoperative radiotherapy on quality of life among breast cancer patients. Eur J Cancer. 1991;27(9):1075–81.CrossRef Berglund G, Bolund C, Fornander T, Rutqvist LE, Sjoden PO. Late effects of adjuvant chemotherapy and postoperative radiotherapy on quality of life among breast cancer patients. Eur J Cancer. 1991;27(9):1075–81.CrossRef
23.
go back to reference Bilodeau BA, Degner LF. Information needs, sources of information, and decisional roles in women with breast cancer. Oncol Nurs Forum. 1996;23(4):691–6.PubMed Bilodeau BA, Degner LF. Information needs, sources of information, and decisional roles in women with breast cancer. Oncol Nurs Forum. 1996;23(4):691–6.PubMed
24.
go back to reference Dow KH, Ferrell BR, Leigh S, Ly J, Gulasekaram P. An evaluation of the quality of life among long-term survivors of breast cancer. Breast Cancer Res Treat. 1996;39(3):261–73.CrossRef Dow KH, Ferrell BR, Leigh S, Ly J, Gulasekaram P. An evaluation of the quality of life among long-term survivors of breast cancer. Breast Cancer Res Treat. 1996;39(3):261–73.CrossRef
25.
go back to reference Ferrell BR, Grant M, Funk B, Otis-Green S, Garcia N. Quality of life in breast cancer. Part I: physical and social well-being. Cancer Nurs. 1997;20(6):398–408.CrossRef Ferrell BR, Grant M, Funk B, Otis-Green S, Garcia N. Quality of life in breast cancer. Part I: physical and social well-being. Cancer Nurs. 1997;20(6):398–408.CrossRef
26.
go back to reference Ferrell BR, Grant M, Funk B, Otis-Green S, Garcia N. Quality of life in breast cancer. Part II: psychological and spiritual well-being. Cancer Nurs. 1998;21(1):1–9.CrossRef Ferrell BR, Grant M, Funk B, Otis-Green S, Garcia N. Quality of life in breast cancer. Part II: psychological and spiritual well-being. Cancer Nurs. 1998;21(1):1–9.CrossRef
27.
go back to reference Gram IT, Lund E, Slenker SE. Quality of life following a false positive mammogram. Br J Cancer. 1990;62(6):1018–22.CrossRef Gram IT, Lund E, Slenker SE. Quality of life following a false positive mammogram. Br J Cancer. 1990;62(6):1018–22.CrossRef
28.
go back to reference Hack TF, Degner LF, Watson P, Sinha L. Do patients benefit from participating in medical decision making? Longitudinal follow-up of women with breast cancer. Psychooncology. 2006;15(1):9–19.CrossRef Hack TF, Degner LF, Watson P, Sinha L. Do patients benefit from participating in medical decision making? Longitudinal follow-up of women with breast cancer. Psychooncology. 2006;15(1):9–19.CrossRef
29.
go back to reference Lerman C, Trock B, Rimer BK, Boyce A, Jepson C, Engstrom PF. Psychological and behavioral implications of abnormal mammograms. Ann Intern Med. 1991;114(8):657–61.CrossRef Lerman C, Trock B, Rimer BK, Boyce A, Jepson C, Engstrom PF. Psychological and behavioral implications of abnormal mammograms. Ann Intern Med. 1991;114(8):657–61.CrossRef
30.
go back to reference Lerman C, Trock B, Rimer BK, Jepson C, Brody D, Boyce A. Psychological side effects of breast cancer screening. Health Psychol. 1991;10(4):259–67.CrossRef Lerman C, Trock B, Rimer BK, Jepson C, Brody D, Boyce A. Psychological side effects of breast cancer screening. Health Psychol. 1991;10(4):259–67.CrossRef
31.
go back to reference Sutton S, Saidi G, Bickler G, Hunter J. Does routine screening for breast cancer raise anxiety? Results from a three wave prospective study in England. J Epidemiol Community Health. 1995;49(4):413–8.CrossRef Sutton S, Saidi G, Bickler G, Hunter J. Does routine screening for breast cancer raise anxiety? Results from a three wave prospective study in England. J Epidemiol Community Health. 1995;49(4):413–8.CrossRef
32.
go back to reference Braun V, Clarke V. What can “thematic analysis” offer health and wellbeing researchers? Int J Qual Stud Health Well-being. 2014;9:26152.CrossRef Braun V, Clarke V. What can “thematic analysis” offer health and wellbeing researchers? Int J Qual Stud Health Well-being. 2014;9:26152.CrossRef
34.
go back to reference Green C, Brazier J, Deverill M. Valuing health-related quality of life. A review of health state valuation techniques. Pharmacoeconomics. 2000;17(2):151–65.CrossRef Green C, Brazier J, Deverill M. Valuing health-related quality of life. A review of health state valuation techniques. Pharmacoeconomics. 2000;17(2):151–65.CrossRef
35.
go back to reference Torrance GW, Feeny D, Furlong W. Visual analog scales: do they have a role in the measurement of preferences for health states? Med Decis Mak. 2001;21(4):329–34.CrossRef Torrance GW, Feeny D, Furlong W. Visual analog scales: do they have a role in the measurement of preferences for health states? Med Decis Mak. 2001;21(4):329–34.CrossRef
36.
go back to reference Froberg DG, Kane RL. Methodology for measuring health-state preferences--III: population and context effects. J Clin Epidemiol. 1989;42(6):585–92.CrossRef Froberg DG, Kane RL. Methodology for measuring health-state preferences--III: population and context effects. J Clin Epidemiol. 1989;42(6):585–92.CrossRef
Metadata
Title
Development and use of health outcome descriptors: a guideline development case study
Authors
Tejan Baldeh
Zuleika Saz-Parkinson
Paola Muti
Nancy Santesso
Gian Paolo Morgano
Wojtek Wiercioch
Robby Nieuwlaat
Axel Gräwingholt
Mireille Broeders
Stephen Duffy
Solveig Hofvind
Lennarth Nystrom
Lydia Ioannidou-Mouzaka
Sue Warman
Helen McGarrigle
Susan Knox
Patricia Fitzpatrick
Paolo Giorgi Rossi
Cecily Quinn
Bettina Borisch
Annette Lebeau
Chris de Wolf
Miranda Langendam
Thomas Piggott
Livia Giordano
Cary van Landsveld-Verhoeven
Jacques Bernier
Peter Rabe
Holger J. Schünemann
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2020
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-020-01338-8

Other articles of this Issue 1/2020

Health and Quality of Life Outcomes 1/2020 Go to the issue