Top

Published in:

Open Access 01-04-2009

Evaluation of the methodological quality of systematic reviews of health status measurement instruments

Authors: Lidwine B. Mokkink, Caroline B. Terwee, Paul W. Stratford, Jordi Alonso, Donald L. Patrick, Ingrid Riphagen, Dirk L. Knol, Lex M. Bouter, Henrica C. W. de Vet

Published in: Quality of Life Research | Issue 3/2009

Abstract

A systematic review of measurement properties of health-status instruments is a tool for evaluating the quality of instruments. Our aim was to appraise the quality of the review process, to describe how authors assess the methodological quality of primary studies of measurement properties, and to describe how authors evaluate results of the studies. Literature searches were performed in three databases. One hundred and forty-eight reviews were included. The purpose of included reviews was to identify health status instruments used in an evaluative application and to report on the measurement properties of these instruments. Two independent reviewers selected the articles and extracted the data. Reviews were often of low quality: 22% of the reviews used one database, the search strategy was often poorly described, and in many cases it was not reported whether article selection (75%) and data extraction (71%) was done by two independent reviewers. In 11 reviews the methodological quality of the primary studies was evaluated for all measurement properties, and of these 11 reviews only 7 evaluated the results. Methods to evaluate the quality of the primary studies and the results differed widely. The poor quality of reviews hampers evidence-based selection of instruments. Guidelines for conducting and reporting systematic reviews of measurement properties should be developed.

Available only for authorised users

Marshall, M., Lockwood, A., Bradley, C., Adams, C., Joy, C., & Fenton, M. (2000). Unpublished rating scales: A major source of bias in randomised controlled trials of treatments for schizophrenia. The British Journal of Psychiatry, 176, 249–252. doi:10.1192/bjp.176.3.249.PubMed

Guyatt, G., Walter, S., & Norman, G. (1987). Measuring change over time: Assessing the usefulness of evaluative instruments. Journal of Chronic Diseases, 40, 171–178. doi:10.1016/0021-9681(87)90069-5.PubMed

Higgins, J. P. T., & Green, S. (Eds.). (2006). Cochrane handbook for systematic reviews of interventions. Version 5.0.1 (update September 2008). The Cochrane Collaboration, 2008. Available from www.cochrane-handbook.org.

Shea, B. J., Grimshaw, J. M., Wells, G. A., et al. (2007). Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews. BMC Medical Research Methodology, 7, 10. doi:10.1186/1471-2288-7-10.PubMed

Irwig, L. M., Tosteson, A. N. N., Gatsonis, C., et al. (1994). Guidelines for meta-analyses evaluating diagnostic tests. Annals of Internal Medicine, 120, 667–676.PubMed

Khan, K. S. (2005). Systematic reviews of diagnostic tests: A guide to methods and application. Best Practice & Research. Clinical Obstetrics & Gynaecology, 19, 37–46.

Edwards, P., Clarke, M., DiGuiseppi, C., Pratap, S., Roberts, I., & Wentz, R. (2002). Identification of randomized controlled trials in systematic reviews: Accuracy and reliability of screening records. Statistics in Medicine, 21, 1635–1640. doi:10.1002/sim.1190.PubMed

Van Tulder, M., Furlan, A., Bombardier, C., & Bouter, L. (2003). Updated method guidelines for systematic reviews in the Cochrane collaboration back review group. Spine, 28, 1290–1299. doi:10.1097/00007632-200306150-00014.PubMed

Verhagen, A. P., De Vet, H. C., De Bie, R. A., et al. (1998). The Delphi list: A criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi consensus. Journal of Clinical Epidemiology, 51, 1235–1241. doi:10.1016/S0895-4356(98)00131-0.PubMed

10.

Whiting, P., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. M., & Kleijnen, J. (2003). The development of QUADAS: A tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Medical Research Methodology, 3, 25. doi:10.1186/1471-2288-3-25.PubMed

11.

Lohr, K. N., Aaronson, N. K., Alonso, J., et al. (1996). Evaluating quality-of-life and health status instruments: Development of scientific review criteria. Clinical Therapeutics, 18, 979–992. doi:10.1016/S0149-2918(96)80054-3.PubMed

12.

Scientific Advisory Committee of the Medical Outcomes Trust. (2002). Assessing health status and quality-of-life instruments: Attributes and review criteria. Quality of Life Research, 11, 193–205. doi:10.1023/A:1015291021312.

13.

Terwee, C. B., Bot, S. D., De Boer, M. R., et al. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60, 34–42. doi:10.1016/j.jclinepi.2006.03.012.PubMed

14.

Wilson, I. B., & Cleary, P. D. (1995). Linking clinical variables with health-related quality of life. A conceptual model of patient outcomes. Journal of the American Medical Association, 273, 59–65. doi:10.1001/jama.273.1.59.PubMed

15.

U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health. (2006). Guidance for industry: Patient-reported outcome measures: Use in medical product development to support labeling claims: Draft guidance. Health and Quality of Life Outcomes, 4, 79. doi:10.1186/1477-7525-4-79.

16.

Patrick, D. L., Guyatt, G. H., & Acquadro, C. (2008). Patient-reported outcomes. In J. Higgins & S. Green (Eds.), The Cochrane library (Chap. 17, issue 7 ed.) Chichester: Wiley.

17.

Pickard, A. S., Topfer, L. A., & Feeny, D. H. (2004). A structured review of studies on health-related quality of life and economic evaluation in pediatric acute lymphoblastic leukemia. Journal of the National Cancer Institute. Monographs, 33, 102–125. doi:10.1093/jncimonographs/lgh002.PubMed

18.

Smith, M. (2005). Pain assessment in nonverbal older adults with advanced dementia. Perspectives in Psychiatric Care, 41, 99–113. doi:10.1111/j.1744-6163.2005.00021.x.PubMed

19.

Terwee, C. B., Mokkink, L. B., Steultjens, M. P., & Dekker, J. (2006). Performance-based methods for measuring the physical function of patients with osteoarthritis of the hip or knee: A systematic review of measurement properties. Rheumatology (Oxford, England), 45(7), 890–902. doi:10.1093/rheumatology/kei267.

20.

Van der Windt, D. A., Nagelkerke, A. F., Bouter, L. M., Dankert-Roelse, J. E., & Veerman, A. J. (1994). Clinical scores for acute asthma in pre-school children. A review of the literature. Journal of Clinical Epidemiology, 47, 635–646. doi:10.1016/0895-4356(94)90211-9.PubMed

21.

Arrington, R., Cofrancesco, J., & Wu, A. W. (2004). Questionnaires to measure sexual quality of life. Quality of Life Research, 13, 1643–1658. doi:10.1007/s11136-004-7625-z.PubMed

22.

Stanghellini, V., Armstrong, D., Monnikes, H., & Bardhan, K. D. (2004). Systematic review: Do we need a new gastro-oesophageal reflux disease questionnaire? Alimentary Pharmacology & Therapeutics, 19, 463–479. doi:10.1046/j.1365-2036.2004.01861.x.

23.

Platz, T., Eickhof, C., Nuyens, G., & Vuadens, P. (2005). Clinical scales for the assessment of spasticity, associated phenomena, and function: A systematic review of the literature. Disability and Rehabilitation, 27, 7–18. doi:10.1080/09638280400014634.PubMed

24.

Gruenewald, D. A., Higginson, I. J., Vivat, B., Edmonds, P., & Burman, R. E. (2004). Quality of life measures for the palliative care of people severely affected by multiple sclerosis: A systematic review. Multiple Sclerosis, 10, 690–704. doi:10.1191/1352458504ms1116rr.PubMed

25.

Ramaker, C., Marinus, J., Stiggelbout, A. M., & Van Hilten, B. J. (2002). Systematic evaluation of rating scales for impairment and disability in Parkinson’s disease. Movement Disorders, 17, 867–876. doi:10.1002/mds.10248.PubMed

26.

Drake, B. G., Callahan, C. M., Dittus, R. S., & Wright, J. G. (1994). Global rating systems used in assessing knee arthroplasty outcomes. The Journal of Arthroplasty, 9, 409–417. doi:10.1016/0883-5403(94)90052-3.PubMed

27.

De Boer, J. B., Van Dam, F. S., & Sprangers, M. A. (1995). Health-related quality-of-life evaluation in HIV-infected patients. A review of the literature. PharmacoEconomics, 8, 291–304.PubMed

28.

Grotle, M., Brox, J. I., & Vollestad, N. K. (2005). Functional status and disability questionnaires: What do they assess? A systematic review of back-specific outcome questionnaires. Spine, 30, 130–140.PubMed

29.

Law, M., & Letts, L. (1989). A critical review of scales of activities of daily living. The American Journal of Occupational Therapy, 43, 522–528.PubMed

30.

Veenhof, C., Bijlsma, J. W., Van den Ende, C. H., Van Dijk, G. M., Pisters, M. F., & Dekker, J. (2006). Psychometric evaluation of osteoarthritis questionnaires: A systematic review of the literature. Arthritis and Rheumatism, 55, 480–492. doi:10.1002/art.22001.PubMed

31.

Salek, S. S., Walker, M. D., & Bayer, A. J. (1998). A review of quality of life in Alzheimer’s disease. Part 2: Issues in assessing drug effects. PharmacoEconomics, 14, 613–627. doi:10.2165/00019053-199814060-00003.PubMed

32.

Walker, M. D., Salek, S. S., & Bayer, A. J. (1998). A review of quality of life in Alzheimer’s disease. Part 1: Issues in assessing disease impact. PharmacoEconomics, 14, 499–530. doi:10.2165/00019053-199814050-00004.PubMed

33.

Daker-White, G. (2002). Reliable and valid self-report outcome measures in sexual (dys)function: A systematic review. Archives of Sexual Behavior, 31, 197–209. doi:10.1023/A:1014743304566.PubMed

34.

De Boer, M. R., Moll, A. C., De Vet, H. C., Terwee, C. B., Volker-Dieben, H. J., & Van Rens, G. H. (2004). Psychometric properties of vision-related quality of life questionnaires: A systematic review. Ophthalmic & Physiological Optics, 24, 257–273. doi:10.1111/j.1475-1313.2004.00187.x.

35.

Neelakantan, D., Omojole, F., Clark, T. J., Gupta, J. K., & Khan, K. S. (2004). Quality of life instruments in studies of chronic pelvic pain: A systematic review. Journal of Obstetrics & Gynaecology, 24, 851–858. doi:10.1080/01443610400019138.

36.

Dorman, S., Byrne, A., & Edwards, A. (2007). Which measurement scales should we use to measure breathlessness in palliative care? A systematic review. Palliative Medicine, 21, 177–191. doi:10.1177/0269216307076398.PubMed

37.

Avery, K. N., Bosch, J. L., Gotoh, M., et al. (2007). Questionnaires to assess urinary and anal incontinence: Review and recommendations. The Journal of Urology, 177, 39–49. doi:10.1016/j.juro.2006.08.075.PubMed

38.

Dorey, G. (2002). Outcome measures for erectile dysfunction. 1: Literature review. British Journal of Nursing (Mark Allen Publishing), 11, 54–64.

39.

Haywood, K. L., Garratt, A. M., & Fitzpatrick, R. (2005). Quality of life in older people: A structured review of generic self-assessed health instruments. Quality of Life Research, 14, 1651–1668. doi:10.1007/s11136-005-1743-0.PubMed

40.

Van Tuijl, J. H., Janssen-Potten, Y. J., & Seelen, H. A. (2002). Evaluation of upper extremity motor function tests in tetraplegics. Spinal Cord, 40, 51–64. doi:10.1038/sj.sc.3101261.PubMed

41.

Bot, S. D., Terwee, C. B., Van der Windt, D. A., Bouter, L. M., Dekker, J., & De Vet, H. C. (2004). Clinimetric evaluation of shoulder disability questionnaires: A systematic review of the literature. Annals of the Rheumatic Diseases, 63, 335–341. doi:10.1136/ard.2003.007724.PubMed

42.

Eechaute, C., Vaes, P., Van Aerschot, L., Asman, S., & Duquet, W. (2007). The clinimetric qualities of patient-assessed instruments for measuring chronic ankle instability: A systematic review. BMC Musculoskeletal Disorders, 8, 6. doi:10.1186/1471-2474-8-6.PubMed

43.

Costa, L. O. P., Maher, C. G., & Latimer, J. (2007). Self-report outcome measures for low back pain—Searching for international cross-cultural adaptations. Spine, 32, 1028–1037. doi:10.1097/01.brs.0000261024.27926.0f.PubMed

44.

Leeflang, M. M., Scholten, R. J., Rutjes, A. W., Reitsma, J. B., & Bossuyt, P. M. (2006). Use of methodological search filters to identify diagnostic accuracy studies can lead to the omission of relevant studies. Journal of Clinical Epidemiology, 59, 234–240. doi:10.1016/j.jclinepi.2005.07.014.PubMed

45.

Lemeshow, A. R., Blum, R. E., Berlin, J. A., Stoto, M. A., & Colditz, G. A. (2005). Searching one or two databases was insufficient for meta-analysis of observational studies. Journal of Clinical Epidemiology, 58, 867–873. doi:10.1016/j.jclinepi.2005.03.004.PubMed

46.

Golomb, B. A., Vickrey, B. G., & Hays, R. D. (2001). A review of health-related quality-of-life measures in stroke. PharmacoEconomics, 19, 155–185. doi:10.2165/00019053-200119020-00004.PubMed

47.

Embretson, S. E., & Reise, S. P. (2000). Item Response Theory for psychologists. Mahwah, New Jersey: Lawrence Erlbaum Associates, Inc.

48.

Hambleton, R. K., & Jones, R. W. (1993). Comparison of classical test theory and item response theory and their applications to test development. Educational Measurement: Issues and Practice, 12, 38–47. doi:10.1111/j.1745-3992.1993.tb00543.x.

49.

Dorans, N. J. (2007). Linking scores from multiple health outcome instruments. Quality of Life Research, 16(S1), 85–94. doi:10.1007/s11136-006-9155-3.PubMed

50.

Mokkink, L. B., Terwee, C. B., Knol, D. L., et al. (2006). Protocol of the COSMIN study: COnsensus-based Standards for the selection of health Measurement INstruments. BMC Medical Research Methodology, 6, 2. doi:10.1186/1471-2288-6-2.PubMed

51.

Eiser, C., & Morse, R. (2001). Quality-of-life measures in chronic diseases of childhood. Health Technology Assessment, 5, 1–157.PubMed

52.

Pal, D. K. (1996). Quality of life assessment in children: A review of conceptual and methodological issues in multidimensional health status measures. Journal of Epidemiology and Community Health, 50, 391–396. doi:10.1136/jech.50.4.391.PubMed

53.

Schmidt, L. J., Garratt, A. M., & Fitzpatrick, R. (2002). Child/parent-assessed population health outcome measures: A structured review. Child: Care, Health and Development, 28, 227–237. doi:10.1046/j.1365-2214.2002.00266.x.

54.

Davis, E., Waters, E., Mackinnon, A., et al. (2006). Paediatric quality of life instruments: A review of the impact of the conceptual framework on outcomes. Developmental Medicine and Child Neurology, 48, 311–318. doi:10.1017/S0012162206000673.PubMed

55.

Hunter, J., Higginson, I., & Garralda, E. (1996). Systematic literature review: Outcome measures for child and adolescent mental health services. Journal of Public Health Medicine, 18, 197–206.PubMed

56.

Brouwer, C. N., Maille, A. R., Rovers, M. M., Grobbee, D. E., Sanders, E. A., & Schilder, A. G. (2005). Health-related quality of life in children with otitis media. International Journal of Pediatric Otorhinolaryngology, 69, 1031–1041. doi:10.1016/j.ijporl.2005.03.013.PubMed

57.

Haywood, K. L., Garratt, A. M., & Fitzpatrick, R. (2005). Older people specific health status and quality of life: A structured review of self-assessed instruments. Journal of Evaluation in Clinical Practice, 11, 315–327. doi:10.1111/j.1365-2753.2005.00538.x.PubMed

58.

Haywood, K. L., Garratt, A. M., & Fitzpatrick, R. (2006). Quality of life in older people: A structured review of self-assessed health instruments. Expert Review of Pharmacoeconomics & Outcomes Research, 6, 181–194. doi:10.1586/14737167.6.2.181.

59.

Hollifield, M., Warner, T. D., Lian, N., et al. (2002). Measuring trauma and health status in refugees: A critical review. Journal of the American Medical Association, 288, 611–621. doi:10.1001/jama.288.5.611.PubMed

60.

Haywood, K. L., Garratt, A. M., & Dawes, P. T. (2005). Patient-assessed health in ankylosing spondylitis: A structured review. Rheumatology (Oxford England), 44, 577–586. doi:10.1093/rheumatology/keh549.

61.

Namjoshi, M. A., & Buesching, D. P. (2001). A review of the health-related quality of life literature in bipolar disorder. Quality of Life Research, 10, 105–115. doi:10.1023/A:1016662018075.PubMed

62.

Michalak, E. E., Yatham, L. N., & Lam, R. W. (2005). Quality of life in bipolar disorder: A review of the literature. Health and Quality of Life Outcomes, 3, 72. doi:10.1186/1477-7525-3-72.PubMed

63.

Okamoto, T., Shimozuma, K., Katsumata, N., et al. (2003). Measuring quality of life in patients with breast cancer: A systematic review of reliable and valid instruments available in Japan. Breast Cancer (Tokyo, Japan), 10, 204–213. doi:10.1007/BF02966719.

64.

Edwards, B., & Ung, L. (2002). Quality of life instruments for caregivers of patients with cancer: A review of their psychometric properties. Cancer Nursing, 25, 342–349. doi:10.1097/00002820-200210000-00002.PubMed

65.

Ringash, J., & Bezjak, A. (2001). A structured review of quality of life instruments for head and neck cancer patients. Head & Neck, 23, 201–213. doi:10.1002/1097-0347(200103)23:3<201::AID-HED1019>3.0.CO;2-M.

66.

Van Korlaar, I., Vossen, C., Rosendaal, F., Cameron, L., Bovill, E., & Kaptein, A. (2003). Quality of life in venous disease. Thrombosis and Haemostasis, 90, 27–35.PubMed

67.

Riemsma, R. P., Forbes, C. A., Glanville, J. M., Eastwood, A. J., & Kleijnen, J. (2001). General health status measures for people with cognitive impairment: Learning disability and acquired brain injury. Health Technology Assessment, 5, 1–100.

68.

Jones, G. L., Kennedy, S. H., & Jenkinson, C. (2002). Health-related quality of life measurement in women with common benign gynecologic conditions: A systematic review. American Journal of Obstetrics and Gynecology, 187, 501–511. doi:10.1067/mob.2002.124940.PubMed

69.

Ettema, T. P., Droes, R. M., Lange, J. D., Mellenbergh, G. J., & Ribbe, M. W. (2005). A review of quality of life instruments used in dementia. Quality of Life Research, 14, 675–686. doi:10.1007/s11136-004-1258-0.PubMed

70.

De Tiedra, A. G., Mercadal, J., Badia, X., Mascaro, J. M., & Lozano, R. (1998). A method to select an instrument for measurement of HR-QOL for cross-cultural adaptation applied to dermatology. PharmacoEconomics, 14, 405–422. doi:10.2165/00019053-199814040-00007.PubMed

71.

Garratt, A. M., Schmidt, L., & Fitzpatrick, R. (2002). Patient-assessed health outcome measures for diabetes: A structured review. Diabetic Medicine, 19, 1–11. doi:10.1046/j.1464-5491.2002.00650.x.PubMed

72.

Luscombe, F. A. (2000). Health-related quality of life measurement in type 2 diabetes. Value in Health, 3(1), 15–28. doi:10.1046/j.1524-4733.2000.36032.x.PubMed

73.

Cagney, K. A., Wu, A. W., Fink, N. E., et al. (2000). Formal literature review of quality-of-life instruments used in end- stage renal disease. American Journal of Kidney Diseases, 36, 327–336. doi:10.1053/ajkd.2000.8982.PubMed

74.

Edgell, E. T., Coons, S. J., Carter, W. B., et al. (1996). A review of health-related quality-of-life measures used in end-stage renal disease. Clinical Therapeutics, 18, 887–938. doi:10.1016/S0149-2918(96)80049-X.PubMed

75.

Kline, L. N., Rentz, A. M., & Grace, E. M. (1998). Evaluating health-related quality of life outcomes in clinical trials of antiepileptic drug therapy. Epilepsia, 39, 965–977. doi:10.1111/j.1528-1157.1998.tb01446.x.

76.

Leone, M. A., Beghi, E., Righini, C., Apolone, G., & Mosconi, P. (2005). Epilepsy and quality of life in adults: A review of instruments. Epilepsy Research, 66, 23–44. doi:10.1016/j.eplepsyres.2005.02.009.PubMed

77.

Szende, A., Schramm, W., Flood, E., et al. (2003). Health-related quality of life assessment in adult haemophilia patients: A systematic review and evaluation of instruments. Haemophilia, 9, 678–687. doi:10.1046/j.1351-8216.2003.00823.x.PubMed

78.

De Kleijn, P., Heijnen, L., & Van Meeteren, N. L. U. (2002). Clinimetric instruments to assess functional health status in patients with haemophilia: A literature review. Haemophilia, 8, 419–427. doi:10.1046/j.1365-2516.2002.00640.x.PubMed

79.

Clayson, D. J., Wild, D. J., Quarterman, P., Duprat-Lomon, I., Kubin, M., & Coons, S. J. (2006). A comparative review of health-related quality-of-life measures for use in HIV/AIDS clinical trials. PharmacoEconomics, 24, 751–765. doi:10.2165/00019053-200624080-00003.PubMed

80.

Bonomi, A. E., Shikiar, R., & Legro, M. W. (2000). Quality-of-life assessment in acute, chronic, and cancer pain: A pharmacist’s guide. Journal of the American Pharmaceutical Association (Wash.), 40, 402–416.

81.

Symonds, T. (2003). A review of condition-specific instruments to assess the impact of urinary incontinence on health-related quality of life. European Urology, 43, 219–225. doi:10.1016/S0302-2838(03)00045-9.PubMed

82.

Pallis, A. G., & Mouzas, I. A. (2000). Instruments for quality of life assessment in patients with inflammatory bowel disease. Digestive and Liver Disease, 32, 682–688. doi:10.1016/S1590-8658(00)80330-8.PubMed

83.

Cummins, R. A. (1997). Self-rated quality of life scales for people with an intellectual disability: A review. Journal of Applied Research in Intellectual Disabilities, 10, 199–216.CrossRef

84.

Garratt, A. M., Brealey, S., & Gillespie, W. J. (2004). Patient-assessed health instruments for the knee: A structured review. Rheumatology (Oxford, England), 43, 1414–1423. doi:10.1093/rheumatology/keh362.

85.

Zanoli, G., Stromqvist, B., Padua, R., & Romanini, E. (2000). Lessons learned searching for a HRQoL instrument to assess the results of treatment in persons with lumbar disorders. Spine, 25, 3178–3185. doi:10.1097/00007632-200012150-00013.PubMed

86.

Clark, T. J., Khan, K. S., Foon, R., Pattison, H., Bryan, S., & Gupta, J. K. (2002). Quality of life instruments in studies of menorrhagia: A systematic review. European Journal of Obstetrics, Gynecology, and Reproductive Biology, 104, 96–104. doi:10.1016/S0301-2115(02)00076-3.PubMed

87.

Van Nieuwenhuizen, C., Schene, A. H., Boevink, W. A., & Wolf, J. R. (1997). Measuring the quality of life of clients with severe mental illness: A review of instruments. Psychiatric Rehabilitation Journal, 20, 33–41.

88.

Lehman, A. F. (1996). Measures of quality of life among persons with severe and persistent mental disorders. Social Psychiatry and Psychiatric Epidemiology, 31, 78–88. doi:10.1007/BF00801903.PubMed

89.

Marinus, J., Ramaker, C., Van Hilten, J. J., & Stiggelbout, A. M. (2002). Health related quality of life in Parkinson’s disease: A systematic review of disease specific instruments. Journal of Neurology, Neurosurgery, and Psychiatry, 72, 241–248. doi:10.1136/jnnp.72.2.241.PubMed

90.

Heffernan, C., & Jenkinson, C. (2005). Measuring outcomes for neurological disorders: A review of disease-specific health status instruments for three degenerative neurological conditions. Chronic Illness, 1, 131–142.PubMed

91.

Jorstad, E. C., Hauer, K., Becker, C., & Lamb, S. E. (2005). Measuring the psychological outcomes of falling: A systematic review. Journal of the American Geriatrics Society, 53, 501–510. doi:10.1111/j.1532-5415.2005.53172.x.PubMed

92.

Rannard, A., Buck, D., Jones, D. E., James, O. F., & Jacoby, A. (2004). Assessing quality of life in primary biliary cirrhosis. Clinical Gastroenterology and Hepatology, 2, 164–174. doi:10.1016/S1542-3565(03)00323-9.PubMed

93.

De Korte, J., Mombers, F. M., Sprangers, M. A., & Bos, J. D. (2002). The suitability of quality-of-life questionnaires for psoriasis research: A systematic literature review. Archives of Dermatology, 138, 1221–1227. doi:10.1001/archderm.138.9.1221.PubMed

94.

Lewis, V. J., & Finlay, A. Y. (2005). A critical review of Quality-of-Life Scales for Psoriasis. Dermatologic Clinics, 23, 707–716. doi:10.1016/j.det.2005.05.016.PubMed

95.

Hallin, P., Sullivan, M., & Kreuter, M. (2000). Spinal cord injury and quality of life measures: A review of instrument psychometric quality. Spinal Cord, 38, 509–523. doi:10.1038/sj.sc.3101054.PubMed

96.

Matza, L. S., Zyczynski, T. M., & Bavendam, T. (2004). A review of quality-of-life questionnaires for urinary incontinence and overactive bladder: Which ones to use and why? Current Urology Reports, 5, 336–342. doi:10.1007/s11934-004-0079-6.PubMed

97.

Buck, D., Jacoby, A., Massey, A., & Ford, G. (2000). Evaluation of measures used to assess quality of life after stroke. Stroke, 31, 2004–2010.PubMed

98.

Prasad, M., Wahlqvist, P., Shikiar, R., & Shih, Y. C. (2004). A review of self-report instruments measuring health-related work productivity: A patient-reported outcomes perspective. PharmacoEconomics, 22, 225–244. doi:10.2165/00019053-200422040-00002.PubMed

99.

Lofland, J. H., Pizzi, L., & Frick, K. D. (2004). A review of health-related workplace productivity loss instruments. PharmacoEconomics, 22, 165–184. doi:10.2165/00019053-200422030-00003.PubMed

100.

Lundstrom, M., & Wendel, E. (2006). Assessment of vision-related quality of life measures in ophthalmic conditions. Expert Review of Pharmacoeconomics & Outcomes Research, 6, 691–724. doi:10.1586/14737167.6.6.691.

101.

Tripop, S., Pratheepawanit, N., Asawaphureekorn, S., Anutangkoon, W., & Inthayung, S. (2005). Health related quality of life instruments for glaucoma: A comprehensive review. Journal of the Medical Association of Thailand, 88(S9), S155–S162.PubMed

102.

Franic, D. M., Bramlett, R. E., & Bothe, A. C. (2005). Psychometric evaluation of disease specific quality of life instruments in voice disorders. Journal of Voice, 19, 300–315. doi:10.1016/j.jvoice.2004.03.003.PubMed

103.

Morley, A. D., & Sharp, H. R. (2006). A review of sinonasal outcome scoring systems—Which is best? Clinical Otolaryngology, 31, 103–109. doi:10.1111/j.1749-4486.2006.01155.x.PubMed

104.

Watt, T., Groenvold, M., Rasmussen, A. K., et al. (2006). Quality of life in patients with benign thyroid disorders. A review. European Journal of Endocrinology, 154, 501–510. doi:10.1530/eje.1.02124.PubMed

105.

Ketelaar, M., Vermeer, A., & Helders, P. J. (1998). Functional motor abilities of children with cerebral palsy: A systematic literature review of assessment measures. Clinical Rehabilitation, 12, 369–380. doi:10.1191/026921598673571117.PubMed

106.

Boyce, W. F., Gowland, C., Rosenbaum, P. L., et al. (1991). Measuring quality of movement in cerebral palsy: A review of instruments. Physical Therapy, 71, 813–819.PubMed

107.

Buffart, L. M., Roebroeck, M. E., Pesch-Batenburg, J. M., Janssen, W. G., & Stam, H. J. (2006). Assessment of arm/hand functioning in children with a congenital transverse or longitudinal reduction deficiency of the upper limb. Disability and Rehabilitation, 28, 85–95. doi:10.1080/09638280500158406.PubMed

108.

Pakulis, P. J., Young, N. L., & Davis, A. M. (2005). Evaluating physical function in an adolescent bone tumor population. Pediatric Blood & Cancer, 45, 635–643. doi:10.1002/pbc.20383.

109.

Moore, D. J., Palmer, B., Patterson, T. L., & Jeste, D. V. (2007). A review of performance-based measures of functional living skills. Journal of Psychiatric Research, 41, 97–118. doi:10.1016/j.jpsychires.2005.10.008.PubMed

110.

MacKnight, C., & Rockwood, K. (1995). Assessing mobility in elderly people. A review of performance-based measures of balance, gait and mobility for bedside use. Reviews in Clinical Gerontology, 5, 464–486. doi:10.1017/S0959259800004895.

111.

Wind, H., Gouttebarge, V., Kuijer, P. P. F. M., & Frings-Dresen, M. H. W. (2005). Assessment of functional capacity of the musculoskeletal system in the context of work, daily living, and sport: A systematic review. Journal of Occupational Rehabilitation, 15, 253–272. doi:10.1007/s10926-005-1223-y.PubMed

112.

Mannerkorpi, K., & Ekdahl, C. (1997). Assessment of functional limitation and disability in patients with fibromyalgia. Scandinavian Journal of Rheumatology, 26, 4–13.PubMedCrossRef

113.

Millard, R. W., Beattie, P. F., & Jones, R. H. (1997). A comprehensive review of questionnaires to evaluate chronic pain-related disability. Critical Reviews in Physical and Rehabilitation Medicine, 9, 35–52.

114.

Dowrick, A. S., Gabbe, B. J., Williamson, O. D., & Cameron, P. A. (2005). Outcome instruments for the assessment of the upper extremity following trauma: A review. Injury, 36, 468–476. doi:10.1016/j.injury.2004.06.014.PubMed

115.

Dziedzic, K. S., Thomas, E., & Hay, E. M. (2005). A systematic search and critical review of measures of disability for use in a population survey of hand osteoarthritis (OA). Osteoarthritis and Cartilage, 13, 1–12. doi:10.1016/j.joca.2004.09.010.PubMed

116.

Swinkels, R. A., Dijkstra, P. U., & Bouter, L. M. (2005). Reliability, validity and responsiveness of instruments to assess disabilities in personal care in patients with rheumatic disorders. A systematic review. Clinical and Experimental Rheumatology, 23, 71–79.PubMed

117.

Swinkels, R. A., Bouter, L. M., Oostendorp, R. A., & Van den Ende, C. H. (2005). Impairment measures in rheumatic disorders for rehabilitation medicine and allied health care: A systematic review. Rheumatology International, 25, 501–512. doi:10.1007/s00296-005-0603-0.PubMed

118.

Swinkels, R. A., Bouter, L. M., Oostendorp, R. A., Swinkels-Meewisse, I. J., Dijkstra, P. U., & De Vet, H. C. (2006). Construct validity of instruments measuring impairments in body structures and function in rheumatic disorders: Which constructs are selected for validation? A systematic review. Clinical and Experimental Rheumatology, 24, 93–102.PubMed

119.

Swinkels, R. A., Oostendorp, R. A., & Bouter, L. M. (2004). Which are the best instruments for measuring disabilities in gait and gait-related activities in patients with rheumatic disorders. Clinical and Experimental Rheumatology, 22, 25–33.PubMed

120.

McKibbin, C. L., Brekke, J. S., Sires, D., Jeste, D. V., & Patterson, T. L. (2004). Direct assessment of functional abilities: Relevance to persons with schizophrenia. Schizophrenia Research, 72, 53–67. doi:10.1016/j.schres.2004.09.011.PubMed

121.

Keskula, D. R., & Lott, J. (2001). Defining and measuring functional limitations and disability in the athletic shoulder. Journal of Sport Rehabilitation, 10, 221–231.

122.

Michener, L. A., & Leggin, B. G. (2001). A review of self-report scales for the assessment of functional limitation and disability of the shoulder. Journal of Hand Therapy, 14, 68–76.PubMed

123.

Salerno, D. F., Copley-Merriman, C., Taylor, T. N., Shinogle, J., & Schulz, R. M. (2002). A review of functional status measures for workers with upper extremity disorders. Occupational and Environmental Medicine, 59, 664–670. doi:10.1136/oem.59.10.664.PubMed

124.

Chong, D. K. (1995). Measurement of instrumental activities of daily living in stroke. Stroke, 26, 1119–1122.PubMed

125.

Croarkin, E., Danoff, J., & Barnes, C. (2004). Evidence-based rating of upper-extremity motor function tests used for people following a stroke. Physical Therapy, 84, 62–74.PubMed

126.

McGee, H. M., Hevey, D., & Horgan, J. H. (1999). Psychosocial outcome assessments for use in cardiac rehabilitation service evaluation: A 10-year systematic review. Social Science & Medicine, 48, 1373–1393. doi:10.1016/S0277-9536(98)00428-6.

127.

Sakzewski, L., Boyd, R., & Ziviani, J. (2007). Clinimetric properties of participation measures for 5- to 13-year-old children with cerebral palsy: A systematic review. Developmental Medicine and Child Neurology, 49, 232–240.PubMedCrossRef

128.

Morris, C., Kurinczuk, J. J., & Fitzpatrick, R. (2005). Child or family assessed measures of activity performance and participation for children with cerebral palsy: A structured review. Child: Care, Health and Development, 31, 397–407. doi:10.1111/j.1365-2214.2005.00519.x.

129.

Eadie, T. L., Yorkston, K. M., Klasner, E. R., et al. (2006). Measuring communicative participation: A review of self-report instruments in speech-language pathology. American Journal of Speech-Language Pathology, 15, 307–320. doi:10.1044/1058-0360(2006/030).PubMed

130.

Brooks, S. J., & Kutcher, S. (2003). Diagnosis and measurement of anxiety disorder in adolescents: A review of commonly used instruments. Journal of Child and Adolescent Psychopharmacology, 13, 351–400. doi:10.1089/104454603322572688.PubMed

131.

Duhn, L. J., & Medves, J. M. (2004). A systematic integrative review of infant pain assessment tools. Advances in Neonatal Care, 4, 126–140. doi:10.1016/j.adnc.2004.04.005.PubMed

132.

Ramelet, A. S., Abu-Saad, H. H., Rees, N., & McDonald, S. (2004). The challenges of pain measurement in critically ill young children: A comprehensive review. Australian Critical Care, 17, 33–45. doi:10.1016/S1036-7314(05)80048-7.PubMed

133.

Stinson, J. N., Kavanagh, T., Yamada, J., Gill, N., & Stevens, B. (2006). Systematic review of the psychometric properties, interpretability and feasibility of self-report pain intensity measures for use in clinical trials in children and adolescents. Pain, 125, 143–157. doi:10.1016/j.pain.2006.05.006.PubMed

134.

Eccleston, C., Jordan, A. L., & Crombez, G. (2006). The Impact of Chronic Pain on Adolescents: A Review of Previously Used Measures. Journal of Pediatric Psychology, 31, 684–697. doi:10.1093/jpepsy/jsj061.PubMed

135.

Birken, C. S., Parkin, P. C., & Macarthur, C. (2004). Asthma severity scores for preschoolers displayed weaknesses in reliability, validity, and responsiveness. Journal of Clinical Epidemiology, 57, 1177–1181. doi:10.1016/j.jclinepi.2004.02.016.PubMed

136.

Linder, L. A. (2005). Measuring physical symptoms in children and adolescents with cancer. Cancer Nursing, 28, 16–26. doi:10.1097/00002820-200501000-00003.PubMed

137.

Stover, C. S., & Berkowitz, S. (2005). Assessing violence exposure and trauma symptoms in young children: A critical review of measures. Journal of Traumatic Stress, 18, 707–717. doi:10.1002/jts.20079.PubMed

138.

Devine, E. B., Hakim, Z., & Green, J. (2005). A systematic review of patient-reported outcome instruments measuring sleep dysfunction in adults. PharmacoEconomics, 23, 889–912. doi:10.2165/00019053-200523090-00003.PubMed

139.

Kirkova, J., Davis, M. P., Walsh, D., et al. (2006). Cancer symptom assessment instruments: A systematic review. Journal of Clinical Oncology, 24, 1459–1473. doi:10.1200/JCO.2005.02.8332.PubMed

140.

Vadaparampil, S. T., Ropka, M., & Stefanek, M. E. (2005). Measurement of psychological factors associated with genetic testing for hereditary breast, ovarian and colon cancers. Familial Cancer, 4, 195–206. doi:10.1007/s10689-004-1446-7.PubMed

141.

Van Herk, R., Van Dijk, M., Baar, F. P., Tibboel, D., & De Wit, R. (2007). Observation scales for pain assessment in older adults with cognitive impairments or communication difficulties. Nursing Research, 56, 34–43. doi:10.1097/00006199-200701000-00005.PubMed

142.

Stolee, P., Hillier, L. M., Esbaugh, J., Bol, N., McKellar, L., & Gauthier, N. (2005). Instruments for the assessment of pain in older persons with cognitive impairment. Journal of the American Geriatrics Society, 53, 319–326. doi:10.1111/j.1532-5415.2005.53121.x.PubMed

143.

Zwakhalen, S. M., Hamers, J. P., Abu-Saad, H. H., & Berger, M. P. (2006). Pain in elderly people with severe dementia: A systematic review of behavioural pain assessment tools. BMC Geriatrics, 6, 3. doi:10.1186/1471-2318-6-3.PubMed

144.

Herr, K., Bjoro, K., & Decker, S. (2006). Tools for assessment of pain in nonverbal older adults with dementia: A state-of-the-science review. Journal of Pain and Symptom Management, 31, 170–192. doi:10.1016/j.jpainsymman.2005.07.001.PubMed

145.

Schofield, P., Clarke, A., Faulkner, M., Ryan, T., Dunham, M., & Howarth, A. (2005). Assessment of pain in adults with cognitive impairment: A review of the tools. The Journal of Endocrine Genetics, 4, 59–66.

146.

Schuurmans, M. J., Deschamps, P. I., Markham, S. W., Shortridge-Baggett, L. M., & Duursma, S. A. (2003). The measurement of delirium: Review of scales. Research and Theory for Nursing Practice, 17, 207–224. doi:10.1891/rtnp.17.3.207.53186.PubMed

147.

Fraser, A., Delaney, B., & Moayyedi, P. (2005). Symptom-based outcome measures for dyspepsia and GERD trials: A systematic review. The American Journal of Gastroenterology, 100, 442–452. doi:10.1111/j.1572-0241.2005.40122.x.PubMed

148.

Bouchard, S., Pelletier, M. H., Gauthier, J. G., Cote, G., & Laberge, B. (1997). The assessment of panic using self-report: A comprehensive survey of validated instruments. Journal of Anxiety Disorders, 11, 89–111. doi:10.1016/S0887-6185(96)00037-0.PubMed

149.

Bausewein, C., Farquhar, M., Booth, S., Gysels, M., & Higginson, I. J. (2007). Measurement of breathlessness in advanced disease: A systematic review. Respiratory Medicine, 101, 399–410. doi:10.1016/j.rmed.2006.07.003.PubMed

150.

Dittner, A. J., Wessely, S. C., & Brown, R. G. (2004). The assessment of fatigue: A practical guide for clinicians and researchers. Journal of Psychosomatic Research, 56, 157–170. doi:10.1016/S0022-3999(03)00371-4.PubMed

151.

Mota, D. D., & Pimenta, C. A. (2006). Self-report instruments for fatigue assessment: A systematic review. Research and Theory for Nursing Practice, 20, 49–78. doi:10.1891/rtnp.20.1.49.PubMed

152.

Moreau, C. E., Green, B. N., Johnson, C. D., & Moreau, S. R. (2001). Isometric back extension endurance tests: A review of the literature. Journal of Manipulative and Physiological Therapeutics, 24, 110–122. doi:10.1067/mmt.2001.112563.PubMed

153.

Charman, C., & Williams, H. (2000). Outcome measures of disease severity in atopic eczema. Archives of Dermatology, 136, 763–769. doi:10.1001/archderm.136.6.763.PubMed

154.

Sun, Y., Sturmer, T., Gunther, K. P., & Brenner, H. (1997). Reliability and validity of clinical outcome measurements of osteoarthritis of the hip and knee—A review of the literature. Clinical Rheumatology, 16, 185–198. doi:10.1007/BF02247849.PubMed

155.

Innes, E. (1999). Handgrip strength testing: A review of the literature. Australian Occupational Therapy Journal, 46, 120–140. doi:10.1046/j.1440-1630.1999.00182.x.

156.

Kettler, A., & Wilke, H. J. (2006). Review of existing grading systems for cervical or lumbar disc and facet joint degeneration. European Spine Journal, 15, 705–718. doi:10.1007/s00586-005-0954-y.PubMed

157.

Hudson, M., Steele, R., & Baron, M. (2007). Update on indices of disease activity in systemic sclerosis. Seminars in Arthritis and Rheumatism, 37, 93–98. doi:10.1016/j.semarthrit.2007.01.005.PubMed

158.

Cremeens, J., Eiser, C., & Blades, M. (2006). Characteristics of Health-related Self-report Measures for Children Aged Three to Eight Years: A Review of the Literature. Quality of Life Research, 15, 739–754. doi:10.1007/s11136-005-4184-x.PubMed

159.

Hayes, J. A., Black, N. A., Jenkinson, C., et al. (2000). Outcome measures for adult critical care: A systematic review. Health Technology Assessment, 4, 1–111.PubMed

160.

Pietrobon, R., Coeytaux, R. R., Carey, T. S., Richardson, W. J., & DeVellis, R. F. (2002). Standard scales for measurement of functional outcome for cervical pain or dysfunction: A systematic review. Spine, 27, 515–522. doi:10.1097/00007632-200203010-00012.PubMed

161.

Linder, J. A., Singer, D. E., Ancker, M., & Atlas, S. J. (2003). Measures of health-related quality of life for adults with acute sinusitis. A systematic review. Journal of General Internal Medicine, 18, 390–401. doi:10.1046/j.1525-1497.2003.20744.x.PubMed

162.

Hearn, J., & Higginson, I. J. (1997). Outcome measures in palliative care for advanced cancer patients: A review. Journal of Public Health Medicine, 19, 193–199.PubMed

163.

Razvi, S., McMillan, C. V., & Weaver, J. U. (2005). Instruments used in measuring symptoms, health status and quality of life in hypothyroidism: A systematic qualitative review. Clinical Endocrinology, 63, 617–624. doi:10.1111/j.1365-2265.2005.02381.x.PubMed

164.

Bijkerk, C. J., De Wit, N. J., Muris, J. W., Jones, R. H., Knottnerus, J. A., & Hoes, A. W. (2003). Outcome measures in irritable bowel syndrome: Comparison of psychometric and methodological characteristics. The American Journal of Gastroenterology, 98, 122–127. doi:10.1111/j.1572-0241.2003.07158.x.PubMed

165.

Haywood, K. L., Hargreaves, J., & Lamb, S. E. (2004). Multi-item outcome measures for lateral ligament injury of the ankle: A structured review. Journal of Evaluation in Clinical Practice, 10, 339–352. doi:10.1111/j.1365-2753.2003.00435.x.PubMed

166.

Poolsup, N., Li Wan, P. A., & Oyebode, F. (1999). Measuring mania and critical appraisal of rating scales. Journal of Clinical Pharmacy and Therapeutics, 24, 433–443. doi:10.1046/j.1365-2710.1999.00250.x.PubMed

167.

D’Olhaberriague, L., Litvan, I., Mitsias, P., & Mansbach, H. H. (1996). A reappraisal of reliability and validity studies in stroke. Stroke, 27, 2331–2336.PubMed

168.

Margolis, M. K., Coyne, K., Kennedy-Martin, T., Baker, T., Schein, O., & Revicki, D. A. (2002). Vision-specific instruments for the assessment of health-related quality of life and visual functioning: A literature review. PharmacoEconomics, 20, 791–812. doi:10.2165/00019053-200220120-00001.PubMed

169.

Ashcroft, D. M., Wan Po, A. L., Williams, H. C., & Griffiths, C. E. (1999). Clinical measures of disease severity and outcome in psoriasis: A critical appraisal of their quality. The British Journal of Dermatology, 141, 185–191. doi:10.1046/j.1365-2133.1999.02963.x.PubMed

170.

Bialocerkowski, A. E., Grimmer, K. A., & Bain, G. I. (2000). A systematic review of the content and quality of wrist outcome instruments. International Journal for Quality in Health Care, 12, 149–157. doi:10.1093/intqhc/12.2.149.PubMed

Title: Evaluation of the methodological quality of systematic reviews of health status measurement instruments
Authors: Lidwine B. Mokkink
Caroline B. Terwee
Paul W. Stratford
Jordi Alonso
Donald L. Patrick
Ingrid Riphagen
Dirk L. Knol
Lex M. Bouter
Henrica C. W. de Vet
Publication date: 01-04-2009
Publisher: Springer Netherlands
Published in: Quality of Life Research / Issue 3/2009
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI: https://doi.org/10.1007/s11136-009-9451-9

At a glance: The STEP trials

Springer Medicine

Evaluation of the methodological quality of systematic reviews of health status measurement instruments

Abstract

At a glance: The STEP trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 3/2009

Differential item functioning (DIF) in the EORTC QLQ-C30: a comparison of baseline, on-treatment and off-treatment data

Measuring global physical health in children with cerebral palsy: illustration of a multidimensional bi-factor model and computerized adaptive testing

Effects of two weight-loss diets on health-related quality of life

Discrimination experience and quality of life among rural-to-urban migrants in China: the mediation effect of expectation–reality discrepancy

Measurement invariance of the Mini Asthma Quality of Life Questionnaire across African–American and Latino adult asthma patients

Measures of asthma control and quality of life: longitudinal data provide practical insights into their relative usefulness in different research contexts