Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Health and Quality of Life Outcomes
Published in: Health and Quality of Life Outcomes 1/2006

Open Access 01-12-2006 | Research

Combining scores from different patient reported outcome measures in meta-analyses: when is it justified?

Authors: Milo A Puhan, Irene Soesilo, Gordon H Guyatt, Holger J Schünemann

Published in: Health and Quality of Life Outcomes | Issue 1/2006

Login to get access

Abstract

Background

Combining outcomes and the use of standardized effect measures such as effect size and standardized response mean across instruments allows more comprehensive meta-analyses and should avoid selection bias. However, such analysis ideally requires that the instruments correlate strongly and that the underlying assumption of similar responsiveness is fulfilled. The aim of the study was to assess the correlation between two widely used health-related quality of life instruments for patients with chronic obstructive pulmonary disease and to compare the instruments' responsiveness on a study level.

Methods

We systematically identified all longitudinal studies that used both the Chronic Respiratory Questionnaire (CRQ) and the St. George's Respiratory Questionnaire (SGRQ) through electronic searches of MEDLINE, EMBASE, CENTRAL and PubMed. We assessed the correlation between CRQ (scale 1 – 7) and SGRQ (scale 1 – 100) change scores and compared responsiveness of the two instruments by comparing standardized response means (change scores divided by their standard deviation).

Results

We identified 15 studies with 23 patient groups. CRQ change scores ranged from -0.19 to 1.87 (median 0.35, IQR 0.14–0.68) and from -16.00 to 3.00 (median -3.00, IQR -4.73–0.25) for SGRQ change scores. The correlation between CRQ and SGRQ change scores was 0.88. Standardized response means of the CRQ (median 0.51, IQR 0.19–0.98) were significantly higher (p < 0.001) than for the SGRQ (median 0.26, IQR -0.03–0.40).

Conclusion

Investigators should be cautious about pooling the results from different instruments in meta-analysis even if they appear to measure similar constructs. Despite high correlation in changes scores, responsiveness of instruments may differ substantially and could lead to important between-study heterogeneity and biased meta-analyses.
Appendix
Available only for authorised users
Literature
1.
Lacasse Y, Goldstein R, Lasserson TJ, Martin S: Pulmonary rehabilitation for chronic obstructive pulmonary disease. Cochrane Database Syst Rev 2006, CD003793.
2.
Appleton S, Poole P, Smith B, Veale A, Bara A: Long-acting beta2-agonists for chronic obstructive pulmonary disease patients with poorly reversible airflow limitation. Cochrane Database Syst Rev 2002, CD001104.
3.
Nannini L, Cates CJ, Lasserson TJ, Poole P: Combined corticosteroid and longacting beta-agonist in one inhaler for chronic obstructive pulmonary disease. CochraneDatabaseSystRev 2004, CD003794.
4.
Sin DD, McAlister FA, Man SF, Anthonisen NR: Contemporary management of chronic obstructive pulmonary disease: scientific review. JAMA 2003,290(17):2301–2312. 10.1001/jama.290.17.2301PubMedCrossRef
5.
Jones A, Fay JK, Burr M, Stone M, Hood K, Roberts G: Inhaled corticosteroid effects on bone metabolism in asthma and mild chronic obstructive pulmonary disease. Cochrane Database Syst Rev 2002, CD003537.
6.
Saint S, Bent S, Vittinghoff E, Grady D: Antibiotics in chronic obstructive pulmonary disease exacerbations. A meta-analysis. JAMA 1995,273(12):957–960. 10.1001/jama.273.12.957PubMedCrossRef
7.
Cummings P: Meta-analysis based on standardized effects is unreliable. Arch Pediatr Adolesc Med 2004,158(6):595–597. 10.1001/archpedi.158.6.595PubMedCrossRef
8.
Schunemann HJ, Griffith L, Jaeschke R, Goldstein R, Stubbing D, Guyatt GH: Evaluation of the minimal important difference for the feeling thermometer and the St. George's Respiratory Questionnaire in patients with chronic airflow obstruction. Journal of clinical epidemiology 2003,56(12):1170–1176. 10.1016/S0895-4356(03)00115-XPubMedCrossRef
9.
Rutten-van Molken M, Roos B, Van Noord JA: An empirical comparison of the St George's Respiratory Questionnaire (SGRQ) and the Chronic Respiratory Disease Questionnaire (CRQ) in a clinical trial setting. Thorax 1999,54(11):995–1003.PubMedCrossRef
10.
Schunemann JS, Griffith L, Jaeschke R, Goldstein R, Stubbing D, Guyatt GH: A Randomized Trial to Evaluate the Self-Administered Standardized CRQ. Europ Respir J 2005,25(1):31–40. 10.1183/09031936.04.00029704CrossRef
11.
Puhan MA, Behnke M, Laschke M, Lichtenschopf A, Brandli O, Guyatt GH, Schunemann HJ: Self-administration and standardisation of the chronic respiratory questionnaire: a randomised trial in three German-speaking countries. Respir Med 2004,98(4):342–350. 10.1016/j.rmed.2003.10.013PubMedCrossRef
12.
Singh SJ, Sodergren SC, Hyland ME, Williams J, Morgan MD: A comparison of three disease-specific and two generic health-status measures to evaluate the outcome of pulmonary rehabilitation in COPD. Resp Med 2001,95(1):71–77. 10.1053/rmed.2000.0976CrossRef
13.
Puhan MA, Guyatt GH, Goldstein R, Mador J, McKim D, Stahl E, Griffith L, Schunemann HJ: Relative responsiveness of the Chronic Respiratory Questionnaire, St. Georges Respiratory Questionnaire and four other health-related quality of life instruments for patients with chronic lung disease. Respir Med 2006.
14.
Bestall JC, Paul EA, Garrod R, Garnham R, Jones PW, Wedzicha JA: Longitudinal trends in exercise capacity and health status after pulmonary rehabilitation in patients with COPD. Respiratory Medicine 2003,97(2):173–180. 10.1053/rmed.2003.1397PubMedCrossRef
15.
Wedzicha JA, Bestall JC, Garrod R, Garnham R, Paul EA, Jones PW: Randomized controlled trial of pulmonary rehabilitation in severe chronic obstructive pulmonary disease patients, stratified with the MRC dyspnoea scale. EurRespirJ 1998,12(2):363–369.
16.
Connor MC, O'Shea FD, O'Driscoll MF, Concannon D, McDonnell TJ: Efficacy of pulmonary rehabilitation in an Irish population. IrMedJ 2001,94(2):46–48.
17.
Man SF, McAlister FA, Anthonisen NR, Sin DD: Contemporary management of chronic obstructive pulmonary disease: clinical applications 1. JAMA 2003,290(17):2313–2316. 10.1001/jama.290.17.2313PubMedCrossRef
18.
Barr JT, Schumacher GE, Freeman S, LeMoine M, Bakst AW, Jones PW: American translation, modification, and validation of the St. George's Respiratory Questionnaire. Clinical Therapeutics 2000,22(9):1121–1145. 10.1016/S0149-2918(00)80089-2PubMedCrossRef
19.
de Torres JP, Pinto-Plata V, Ingenito E, Bagley P, Gray A, Berger R, Celli B: Power of Outcome Measurements to Detect Clinically Significant Changes in Pulmonary Rehabilitation of Patients With COPD(*). Chest 2002,121(4):1092–1098. 10.1378/chest.121.4.1092PubMedCrossRef
20.
Griffiths TL, Burr ML, Campbell IA, Lewis-Jenkins V, Mullins J, Shiels K, Turner-Lawlor PJ, Payne N, Newcombe RG, Ionescu AA, Thomas J, Tunbridge J, Lonescu AA: Results at 1 year of outpatient multidisciplinary pulmonary rehabilitation: a randomised controlled trial. Lancet 2000,355(9201):362–368. 10.1016/S0140-6736(99)07042-7PubMedCrossRef
21.
Bourbeau J, Maltais F, Rouleau M, Guimont C: French-Canadian version of the Chronic Respiratory and St George's Respiratory questionnaires: an assessment of their psychometric properties in patients with chronic obstructive pulmonary disease. Can Respir J 2004,11(7):480–486.PubMed
22.
Desikan R, Mason HL, Rupp MT, Skehan M: Health-related quality of life and healthcare resource utilization by COPD patients: a comparison of three instruments. Qual Life Res 2002,11(8):739–751. 10.1023/A:1020836719321PubMedCrossRef
23.
Hajiro T, Nishimura K, Jones PW, Tsukino M, Ikeda A, Koyama H, Izumi T: A novel, short, and simple questionnaire to measure health-related quality of life in patients with chronic obstructive pulmonary disease. Am J Respir Crit Care Med 1999,159(6):1874–1878.PubMedCrossRef
24.
Harper R, Brazier JE, Waterhouse JC, Walters SJ, Jones NM, Howard P: Comparison of outcome measures for patients with chronic obstructive pulmonary disease (COPD) in an outpatient setting. Thorax 1997,52(10):879–887.PubMedCentralPubMedCrossRef
Metadata
Title
Combining scores from different patient reported outcome measures in meta-analyses: when is it justified?
Authors
Milo A Puhan
Irene Soesilo
Gordon H Guyatt
Holger J Schünemann
Publication date
01-12-2006
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2006
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-4-94

Other articles of this Issue 1/2006

Health and Quality of Life Outcomes 1/2006 Go to the issue

Research

Associations between health-related quality of life and demographics and health risks. Results from Rhode Island's 2002 behavioral risk factor survey

Research

Assessment of health-related quality of life in arthritis: conceptualization and development of five item banks using item response theory

Research

Health-related quality of life following a clinical weight loss intervention among overweight and obese adults: intervention and 24 month follow-up effects

Research

Validation of the Burden Index of Caregivers (BIC), a multidimensional short care burden scale from Japan

Research

Validation of a patient satisfaction questionnaire for anemia treatment, the PSQ-An

Commentary

Responsiveness and minimal important differences for patient reported outcomes