Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2011

Open Access 01-12-2011 | Review

Validity of instruments to measure physical activity may be questionable due to a lack of conceptual frameworks: a systematic review

Authors: Elena Gimeno-Santos, Anja Frei, Fabienne Dobbels, Katja Rüdell, Milo A Puhan, Judith Garcia-Aymerich, the PROactive consortium

Published in: Health and Quality of Life Outcomes | Issue 1/2011

Login to get access

Abstract

Background

Guidance documents for the development and validation of patient-reported outcomes (PROs) advise the use of conceptual frameworks, which outline the structure of the concept that a PRO aims to measure. It is unknown whether currently available PROs are based on conceptual frameworks. This study, which was limited to a specific case, had the following aims: (i) to identify conceptual frameworks of physical activity in chronic respiratory patients or similar populations (chronic heart disease patients or the elderly) and (ii) to assess whether the development and validation of PROs to measure physical activity in these populations were based on a conceptual framework of physical activity.

Methods

Two systematic reviews were conducted through searches of the Medline, Embase, PsycINFO, and Cinahl databases prior to January 2010.

Results

In the first review, only 2 out of 581 references pertaining to physical activity in the defined populations provided a conceptual framework of physical activity in COPD patients. In the second review, out of 103 studies developing PROs to measure physical activity or related constructs, none were based on a conceptual framework of physical activity.

Conclusions

These findings raise concerns about how the large body of evidence from studies that use physical activity PRO instruments should be evaluated by health care providers, guideline developers, and regulatory agencies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bottomley A, Jones D, Claassens L: Patient-reported outcomes: assessment and current perspectives of the guidelines of the Food and Drug Administration and the reflection paper of the European Medicines Agency. Eur J Cancer 2009, 45: 347–353. 10.1016/j.ejca.2008.09.032PubMedCrossRef Bottomley A, Jones D, Claassens L: Patient-reported outcomes: assessment and current perspectives of the guidelines of the Food and Drug Administration and the reflection paper of the European Medicines Agency. Eur J Cancer 2009, 45: 347–353. 10.1016/j.ejca.2008.09.032PubMedCrossRef
3.
go back to reference American Psychological Association, American Educational Research Association, National Council on Measurement in Education: Standards for educational and psychological testing. Whashington, DC: American Psychological Association; 1985. American Psychological Association, American Educational Research Association, National Council on Measurement in Education: Standards for educational and psychological testing. Whashington, DC: American Psychological Association; 1985.
4.
go back to reference Lohr KN, Aaronson NK, Alonso J, Burnam MA, Patrick DL, Perrin EB, Roberts JS: Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clin Ther 1996, 18: 979–992. 10.1016/S0149-2918(96)80054-3PubMedCrossRef Lohr KN, Aaronson NK, Alonso J, Burnam MA, Patrick DL, Perrin EB, Roberts JS: Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clin Ther 1996, 18: 979–992. 10.1016/S0149-2918(96)80054-3PubMedCrossRef
5.
go back to reference Lohr KN: Assessing health status and quality-of-life instruments: Attributes and review criteria. Quality of Life Research 2002, 11: 193–205. 10.1023/A:1015291021312PubMedCrossRef Lohr KN: Assessing health status and quality-of-life instruments: Attributes and review criteria. Quality of Life Research 2002, 11: 193–205. 10.1023/A:1015291021312PubMedCrossRef
6.
go back to reference Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. New York: Oxford University Press; 1995. Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. New York: Oxford University Press; 1995.
7.
go back to reference Rothman ML, Beltran P, Cappelleri JC, Lipscomb J, Teschendorf B: Patient-reported outcomes: conceptual issues. Value Health 2007,10(Suppl 2):S66-S75.PubMedCrossRef Rothman ML, Beltran P, Cappelleri JC, Lipscomb J, Teschendorf B: Patient-reported outcomes: conceptual issues. Value Health 2007,10(Suppl 2):S66-S75.PubMedCrossRef
8.
go back to reference Haskell WL, Lee IM, Pate RR, Powell KE, Blair SN, Franklin BA, Macera CA, Heath GW, Thompson PD, Bauman A: Physical activity and public health: updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. Med Sci Sports Exerc 2007, 39: 1423–1434. 10.1249/mss.0b013e3180616b27PubMedCrossRef Haskell WL, Lee IM, Pate RR, Powell KE, Blair SN, Franklin BA, Macera CA, Heath GW, Thompson PD, Bauman A: Physical activity and public health: updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. Med Sci Sports Exerc 2007, 39: 1423–1434. 10.1249/mss.0b013e3180616b27PubMedCrossRef
10.
go back to reference Garcia-Aymerich J, Lange P, Benet M, Schnohr P, Anto JM: Regular physical activity modifies smoking-related lung function decline and reduces risk of chronic obstructive pulmonary disease: a population-based cohort study. Am J Respir Crit Care Med 2007, 175: 458–463.PubMedCrossRef Garcia-Aymerich J, Lange P, Benet M, Schnohr P, Anto JM: Regular physical activity modifies smoking-related lung function decline and reduces risk of chronic obstructive pulmonary disease: a population-based cohort study. Am J Respir Crit Care Med 2007, 175: 458–463.PubMedCrossRef
11.
go back to reference Garcia-Aymerich J, Lange P, Benet M, Schnohr P, Anto JM: Regular physical activity reduces hospital admission and mortality in chronic obstructive pulmonary disease: a population based cohort study. Thorax 2006, 61: 772–778. 10.1136/thx.2006.060145PubMedCentralPubMedCrossRef Garcia-Aymerich J, Lange P, Benet M, Schnohr P, Anto JM: Regular physical activity reduces hospital admission and mortality in chronic obstructive pulmonary disease: a population based cohort study. Thorax 2006, 61: 772–778. 10.1136/thx.2006.060145PubMedCentralPubMedCrossRef
12.
go back to reference Garcia-Aymerich J, Varraso R, Anto JM, Camargo CA Jr: Prospective study of physical activity and risk of asthma exacerbations in older women. Am J Respir Crit Care Med 2009, 179: 999–1003. 10.1164/rccm.200812-1929OCPubMedCentralPubMedCrossRef Garcia-Aymerich J, Varraso R, Anto JM, Camargo CA Jr: Prospective study of physical activity and risk of asthma exacerbations in older women. Am J Respir Crit Care Med 2009, 179: 999–1003. 10.1164/rccm.200812-1929OCPubMedCentralPubMedCrossRef
15.
go back to reference Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med 2009, 151: W65-W94.PubMedCrossRef Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med 2009, 151: W65-W94.PubMedCrossRef
16.
go back to reference Caspersen CJ, Powell KE, Christenson GM: Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. Public Health Rep 1985, 100: 126–131.PubMedCentralPubMed Caspersen CJ, Powell KE, Christenson GM: Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. Public Health Rep 1985, 100: 126–131.PubMedCentralPubMed
17.
go back to reference Leidy NK: Subjective measurement of activity in chronic obstructive pulmonary disease. COPD 2007, 4: 243–249. 10.1080/15412550701480414PubMedCrossRef Leidy NK: Subjective measurement of activity in chronic obstructive pulmonary disease. COPD 2007, 4: 243–249. 10.1080/15412550701480414PubMedCrossRef
18.
go back to reference Leidy NK: Functional performance in people with chronic obstructive pulmonary disease. Image J Nurs Sch 1995, 27: 23–34. 10.1111/j.1547-5069.1995.tb00809.xPubMedCrossRef Leidy NK: Functional performance in people with chronic obstructive pulmonary disease. Image J Nurs Sch 1995, 27: 23–34. 10.1111/j.1547-5069.1995.tb00809.xPubMedCrossRef
19.
go back to reference Larson JL: Functional performance and physical activity in chronic obstructive pulmonary disease: theoretical perspectives. COPD 2007, 4: 237–242. 10.1080/15412550701480372PubMedCrossRef Larson JL: Functional performance and physical activity in chronic obstructive pulmonary disease: theoretical perspectives. COPD 2007, 4: 237–242. 10.1080/15412550701480372PubMedCrossRef
21.
go back to reference Leidy NK: Functional status and the forward progress of merry-go-rounds: toward a coherent analytical framework. Nurs Res 1994, 43: 196–202.PubMedCrossRef Leidy NK: Functional status and the forward progress of merry-go-rounds: toward a coherent analytical framework. Nurs Res 1994, 43: 196–202.PubMedCrossRef
22.
go back to reference Corbin C, Pangrazi R, Frank B: Definitions: Health, Fitness, and Physical Activity. Washington, DC: President's Council on Physical Fitness and Sports 2000. Corbin C, Pangrazi R, Frank B: Definitions: Health, Fitness, and Physical Activity. Washington, DC: President's Council on Physical Fitness and Sports 2000.
23.
go back to reference O'Brien KK, Bayoumi AM, Strike C, Young NL, Davis AM: Exploring disability from the perspective of adults living with HIV/AIDS: development of a conceptual framework. Health Qual Life Outcomes 2008, 6: 76. 10.1186/1477-7525-6-76PubMedCentralPubMedCrossRef O'Brien KK, Bayoumi AM, Strike C, Young NL, Davis AM: Exploring disability from the perspective of adults living with HIV/AIDS: development of a conceptual framework. Health Qual Life Outcomes 2008, 6: 76. 10.1186/1477-7525-6-76PubMedCentralPubMedCrossRef
24.
go back to reference Pollard B, Johnston M, Dixon D: Theoretical framework and methodological development of common subjective health outcome measures in osteoarthritis: a critical review. Health Qual Life Outcomes 2007, 5: 14. 10.1186/1477-7525-5-14PubMedCentralPubMedCrossRef Pollard B, Johnston M, Dixon D: Theoretical framework and methodological development of common subjective health outcome measures in osteoarthritis: a critical review. Health Qual Life Outcomes 2007, 5: 14. 10.1186/1477-7525-5-14PubMedCentralPubMedCrossRef
27.
go back to reference Arbuckle TY, Gold DP, Chaikelson JS, Lapidus S: Measurement of activity in the elderly: The Activities Checklist. Can J Aging 1994, 13: 550–65. 10.1017/S0714980800006395CrossRef Arbuckle TY, Gold DP, Chaikelson JS, Lapidus S: Measurement of activity in the elderly: The Activities Checklist. Can J Aging 1994, 13: 550–65. 10.1017/S0714980800006395CrossRef
28.
go back to reference Avlund K, Kreiner S, Schultz-Larsen K: Functional ability scales for the elderly: a validation study. Eur J Public Health 1996, 6: 35–42. 10.1093/eurpub/6.1.35CrossRef Avlund K, Kreiner S, Schultz-Larsen K: Functional ability scales for the elderly: a validation study. Eur J Public Health 1996, 6: 35–42. 10.1093/eurpub/6.1.35CrossRef
29.
go back to reference Carone M, Bertolotti G, Anchisi F, Zotti AM, Donner CF, Jones PW: Analysis of factors that characterize health impairment in patients with chronic respiratory failure. Quality of Life in Chronic Respiratory Failure Group. Eur Respir J 1999, 13: 1293–1300. 10.1183/09031936.99.13613019PubMedCrossRef Carone M, Bertolotti G, Anchisi F, Zotti AM, Donner CF, Jones PW: Analysis of factors that characterize health impairment in patients with chronic respiratory failure. Quality of Life in Chronic Respiratory Failure Group. Eur Respir J 1999, 13: 1293–1300. 10.1183/09031936.99.13613019PubMedCrossRef
30.
go back to reference Dunderdale K, Thompson DR, Beer SF, Furze G, Miles JNV: Development and validation of a patient-centered health-related quality-of-life measure: the Chronic Heart Failure Assessment Tool. J Cardiovasc Nurs 2008, 23: 364–70.PubMedCrossRef Dunderdale K, Thompson DR, Beer SF, Furze G, Miles JNV: Development and validation of a patient-centered health-related quality-of-life measure: the Chronic Heart Failure Assessment Tool. J Cardiovasc Nurs 2008, 23: 364–70.PubMedCrossRef
31.
go back to reference Eakman AM: A reliability and validity study of the Meaningful Activity Participation Assessment. PhD thesis. University of Southern California; 2007. Eakman AM: A reliability and validity study of the Meaningful Activity Participation Assessment. PhD thesis. University of Southern California; 2007.
32.
go back to reference Fillenbaum GG, Smyer MA: The development, validity, and reliability of the OARS multidimensional functional assessment questionnaire. J Gerontol 1981, 36: 428–34.PubMedCrossRef Fillenbaum GG, Smyer MA: The development, validity, and reliability of the OARS multidimensional functional assessment questionnaire. J Gerontol 1981, 36: 428–34.PubMedCrossRef
33.
go back to reference Kempen GI, Suurmeijer TP: The development of a hierarchical polychotomous ADL-IADL scale for noninstitutionalized elders. Gerontologist 1990, 30: 497–502. 10.1093/geront/30.4.497PubMedCrossRef Kempen GI, Suurmeijer TP: The development of a hierarchical polychotomous ADL-IADL scale for noninstitutionalized elders. Gerontologist 1990, 30: 497–502. 10.1093/geront/30.4.497PubMedCrossRef
34.
go back to reference Lareau SC, Carrieri-Kohlman V, Janson-Bjerklie S, Roos PJ: Development and testing of the Pulmonary Functional Status and Dyspnea Questionnaire (PFSDQ). Heart Lung 1994, 23: 242–50.PubMed Lareau SC, Carrieri-Kohlman V, Janson-Bjerklie S, Roos PJ: Development and testing of the Pulmonary Functional Status and Dyspnea Questionnaire (PFSDQ). Heart Lung 1994, 23: 242–50.PubMed
35.
go back to reference Lareau SC, Meek PM, Roos PJ: Development and testing of the modified version of the Pulmonary Functional Status and Dyspnea Questionnaire (PFSDQ-M). Heart Lung 1998, 27: 159–68. 10.1016/S0147-9563(98)90003-6PubMedCrossRef Lareau SC, Meek PM, Roos PJ: Development and testing of the modified version of the Pulmonary Functional Status and Dyspnea Questionnaire (PFSDQ-M). Heart Lung 1998, 27: 159–68. 10.1016/S0147-9563(98)90003-6PubMedCrossRef
36.
go back to reference Lee L, Friesen M, Lambert IR, Loudon RG: Evaluation of Dyspnea During Physical and Speech Activities in Patients With Pulmonary Diseases. Chest 1998, 113: 625–32. 10.1378/chest.113.3.625PubMedCrossRef Lee L, Friesen M, Lambert IR, Loudon RG: Evaluation of Dyspnea During Physical and Speech Activities in Patients With Pulmonary Diseases. Chest 1998, 113: 625–32. 10.1378/chest.113.3.625PubMedCrossRef
37.
go back to reference Leidy NK: Psychometric properties of the functional performance inventory in patients with chronic obstructive pulmonary disease. Nurs Res 1999, 48: 20–8. 10.1097/00006199-199901000-00004PubMedCrossRef Leidy NK: Psychometric properties of the functional performance inventory in patients with chronic obstructive pulmonary disease. Nurs Res 1999, 48: 20–8. 10.1097/00006199-199901000-00004PubMedCrossRef
38.
go back to reference Letrait M, Lurie A, Bean K, Mesbah M, Venot A, Strauch G, Grandordy BM, Chwalow J: The Asthma Impact Record (AIR) index: a rating scale to evaluate the quality of life of asthmatic patients in France. Eur Respir J 1996, 9: 1167–73. 10.1183/09031936.96.09061167PubMedCrossRef Letrait M, Lurie A, Bean K, Mesbah M, Venot A, Strauch G, Grandordy BM, Chwalow J: The Asthma Impact Record (AIR) index: a rating scale to evaluate the quality of life of asthmatic patients in France. Eur Respir J 1996, 9: 1167–73. 10.1183/09031936.96.09061167PubMedCrossRef
39.
go back to reference Maille AR, Koning CJM, Zwinderman AH, Willems LNA, Dijkman JH, Kaptein AA: The development of the Quality-of-Life for Respiratory Illness Questionnaire (QOL-RIQ): a disease-specific quality-of-life questionnaire for patients with mild to moderate chronic non-specific lung disease. Respir Med 1997, 91: 297–309. 10.1016/S0954-6111(97)90034-2PubMedCrossRef Maille AR, Koning CJM, Zwinderman AH, Willems LNA, Dijkman JH, Kaptein AA: The development of the Quality-of-Life for Respiratory Illness Questionnaire (QOL-RIQ): a disease-specific quality-of-life questionnaire for patients with mild to moderate chronic non-specific lung disease. Respir Med 1997, 91: 297–309. 10.1016/S0954-6111(97)90034-2PubMedCrossRef
40.
go back to reference Migliore Norweg A, Whiteson J, Demetis S, Rey M: A new functional status outcome measure of dyspnea and anxiety for adults with lung disease: the dyspnea management questionnaire. J Cardiopulm Rehabil 2006, 26: 395–404. 10.1097/00008483-200611000-00010PubMedCrossRef Migliore Norweg A, Whiteson J, Demetis S, Rey M: A new functional status outcome measure of dyspnea and anxiety for adults with lung disease: the dyspnea management questionnaire. J Cardiopulm Rehabil 2006, 26: 395–404. 10.1097/00008483-200611000-00010PubMedCrossRef
41.
go back to reference Morimoto M, Takai K, Nakajima K, Kagawa K: Development of the chronic obstructive pulmonary disease activity rating scale: reliability, validity and factorial structure. Nurs Health Sci 2003, 5: 23–30. 10.1046/j.1442-2018.2003.00131.xPubMedCrossRef Morimoto M, Takai K, Nakajima K, Kagawa K: Development of the chronic obstructive pulmonary disease activity rating scale: reliability, validity and factorial structure. Nurs Health Sci 2003, 5: 23–30. 10.1046/j.1442-2018.2003.00131.xPubMedCrossRef
42.
go back to reference Morris WW, Buckwalter KC, Cleary TA, Gilmer JS: Issues related to the validation of the Iowa Self-Assessment Inventory. Educ Psychol Meas 1989, 49: 853–61. 10.1177/001316448904900408CrossRef Morris WW, Buckwalter KC, Cleary TA, Gilmer JS: Issues related to the validation of the Iowa Self-Assessment Inventory. Educ Psychol Meas 1989, 49: 853–61. 10.1177/001316448904900408CrossRef
43.
go back to reference Schultz-Larsen K, Avlund K, Kreiner S: Functional ability of community dwelling elderly. Criterion-related validity of a new measure of functional ability. J Clin Epidemiol 1992, 45: 1315–26. 10.1016/0895-4356(92)90172-JPubMedCrossRef Schultz-Larsen K, Avlund K, Kreiner S: Functional ability of community dwelling elderly. Criterion-related validity of a new measure of functional ability. J Clin Epidemiol 1992, 45: 1315–26. 10.1016/0895-4356(92)90172-JPubMedCrossRef
44.
go back to reference Tu SP, McDonell MB, Spertus JA, Steele BG, Fihn SD: A new self-administered questionnaire to monitor health-related quality of life in patients with COPD. Ambulatory Care Quality Improvement Project (ACQUIP) Investigators. Chest 1997, 112: 614–22. 10.1378/chest.112.3.614PubMedCrossRef Tu SP, McDonell MB, Spertus JA, Steele BG, Fihn SD: A new self-administered questionnaire to monitor health-related quality of life in patients with COPD. Ambulatory Care Quality Improvement Project (ACQUIP) Investigators. Chest 1997, 112: 614–22. 10.1378/chest.112.3.614PubMedCrossRef
45.
go back to reference van der Molen T, Willemse BW, Schokker S, ten Hacken NH, Postma DS, Juniper EF: Development, validity and responsiveness of the Clinical COPD Questionnaire. Health Qual Life Outcomes 2003, 1: 13–23. 10.1186/1477-7525-1-13PubMedCentralPubMedCrossRef van der Molen T, Willemse BW, Schokker S, ten Hacken NH, Postma DS, Juniper EF: Development, validity and responsiveness of the Clinical COPD Questionnaire. Health Qual Life Outcomes 2003, 1: 13–23. 10.1186/1477-7525-1-13PubMedCentralPubMedCrossRef
46.
go back to reference Wigal JK, Creer TL, Kotses H: The COPD Self-Efficacy Scale. Chest 1991, 99: 1193–6. 10.1378/chest.99.5.1193PubMedCrossRef Wigal JK, Creer TL, Kotses H: The COPD Self-Efficacy Scale. Chest 1991, 99: 1193–6. 10.1378/chest.99.5.1193PubMedCrossRef
47.
go back to reference Zaragoza J, Lugli-Rivero Z: Development and Validation of a Quality of Life Questionnaire for Patients with Chronic Respiratory Disease (CV-PERC): Preliminary Results. Arch Bronconeumol 2009, 45: 81–6.PubMedCrossRef Zaragoza J, Lugli-Rivero Z: Development and Validation of a Quality of Life Questionnaire for Patients with Chronic Respiratory Disease (CV-PERC): Preliminary Results. Arch Bronconeumol 2009, 45: 81–6.PubMedCrossRef
48.
go back to reference Zisberg A: Influence of routine on functional status in elderly: development and validation of an instrument to measure routine. PhD thesis. University of Washington; 2005. Zisberg A: Influence of routine on functional status in elderly: development and validation of an instrument to measure routine. PhD thesis. University of Washington; 2005.
Metadata
Title
Validity of instruments to measure physical activity may be questionable due to a lack of conceptual frameworks: a systematic review
Authors
Elena Gimeno-Santos
Anja Frei
Fabienne Dobbels
Katja Rüdell
Milo A Puhan
Judith Garcia-Aymerich
the PROactive consortium
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2011
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-9-86

Other articles of this Issue 1/2011

Health and Quality of Life Outcomes 1/2011 Go to the issue