Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2006

Open Access 01-12-2006 | Study protocol

Protocol of the COSMIN study: COnsensus-based Standards for the selection of health Measurement INstruments

Authors: LB Mokkink, CB Terwee, DL Knol, PW Stratford, J Alonso, DL Patrick, LM Bouter, HCW de Vet

Published in: BMC Medical Research Methodology | Issue 1/2006

Login to get access

Abstract

Background

Choosing an adequate measurement instrument depends on the proposed use of the instrument, the concept to be measured, the measurement properties (e.g. internal consistency, reproducibility, content and construct validity, responsiveness, and interpretability), the requirements, the burden for subjects, and costs of the available instruments. As far as measurement properties are concerned, there are no sufficiently specific standards for the evaluation of measurement properties of instruments to measure health status, and also no explicit criteria for what constitutes good measurement properties. In this paper we describe the protocol for the COSMIN study, the objective of which is to develop a checklist that contains COnsensus-based Standards for the selection of health Measurement INstruments, including explicit criteria for satisfying these standards. We will focus on evaluative health related patient-reported outcomes (HR-PROs), i.e. patient-reported health measurement instruments used in a longitudinal design as an outcome measure, excluding health care related PROs, such as satisfaction with care or adherence. The COSMIN standards will be made available in the form of an easily applicable checklist.

Method

An international Delphi study will be performed to reach consensus on which and how measurement properties should be assessed, and on criteria for good measurement properties. Two sources of input will be used for the Delphi study: (1) a systematic review of properties, standards and criteria of measurement properties found in systematic reviews of measurement instruments, and (2) an additional literature search of methodological articles presenting a comprehensive checklist of standards and criteria. The Delphi study will consist of four (written) Delphi rounds, with approximately 30 expert panel members with different backgrounds in clinical medicine, biostatistics, psychology, and epidemiology. The final checklist will subsequently be field-tested by assessing the inter-rater reproducibility of the checklist.

Discussion

Since the study will mainly be anonymous, problems that are commonly encountered in face-to-face group meetings, such as the dominance of certain persons in the communication process, will be avoided. By performing a Delphi study and involving many experts, the likelihood that the checklist will have sufficient credibility to be accepted and implemented will increase.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kirshner B, Guyatt G: A methodological framework for assessing health indices. J Chronic Dis. 1985, 38: 27-36. 10.1016/0021-9681(85)90005-0.CrossRefPubMed Kirshner B, Guyatt G: A methodological framework for assessing health indices. J Chronic Dis. 1985, 38: 27-36. 10.1016/0021-9681(85)90005-0.CrossRefPubMed
2.
go back to reference Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002, 11: 193-205. 10.1023/A:1015291021312. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002, 11: 193-205. 10.1023/A:1015291021312.
3.
go back to reference Lohr KN, Aaronson NK, Alonso J, Burnam MA, Patrick DL, Perrin EB, Roberts JS: Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clinical Therapeutics. 1996, 18: 979-992. 10.1016/S0149-2918(96)80054-3.CrossRefPubMed Lohr KN, Aaronson NK, Alonso J, Burnam MA, Patrick DL, Perrin EB, Roberts JS: Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clinical Therapeutics. 1996, 18: 979-992. 10.1016/S0149-2918(96)80054-3.CrossRefPubMed
4.
go back to reference Bombardier C, Tugwell P: Methodological considerations in functional assessment. J Rheumatol Suppl. 1987, 14 Suppl 15: 6-10.PubMed Bombardier C, Tugwell P: Methodological considerations in functional assessment. J Rheumatol Suppl. 1987, 14 Suppl 15: 6-10.PubMed
5.
go back to reference Andresen EM, Meyers AR: Health-related quality of life outcomes measures. Arch Phys Med Rehabil. 2000, 81: S30-S45. 10.1053/apmr.2000.20621.CrossRefPubMed Andresen EM, Meyers AR: Health-related quality of life outcomes measures. Arch Phys Med Rehabil. 2000, 81: S30-S45. 10.1053/apmr.2000.20621.CrossRefPubMed
6.
go back to reference Chassany O, Sagnier P, Marquis P, Fullerton S, Aaronson NK, for the European Regularoty Issues on Quality of Life Assessment Group: Patient-reported outcomes: the example of health-related quality of life - a European guidance document for the improved integration of health-related quality of life assessment in the drug regulatory process. Drug Information Journal. 2002, 36: 209-238.CrossRef Chassany O, Sagnier P, Marquis P, Fullerton S, Aaronson NK, for the European Regularoty Issues on Quality of Life Assessment Group: Patient-reported outcomes: the example of health-related quality of life - a European guidance document for the improved integration of health-related quality of life assessment in the drug regulatory process. Drug Information Journal. 2002, 36: 209-238.CrossRef
7.
go back to reference McDowell I, Jenkinson C: Development standards for health measures. J Health Serv Res Policy. 1996, 1: 238-246.PubMed McDowell I, Jenkinson C: Development standards for health measures. J Health Serv Res Policy. 1996, 1: 238-246.PubMed
8.
go back to reference Streiner DL, Norman GR: Health measurement scales. A practical guide to their development and use. 1995, Oxford, University Press, second Streiner DL, Norman GR: Health measurement scales. A practical guide to their development and use. 1995, Oxford, University Press, second
9.
go back to reference Husted JA, Cook RJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000, 53: 459-468. 10.1016/S0895-4356(99)00206-1.CrossRefPubMed Husted JA, Cook RJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000, 53: 459-468. 10.1016/S0895-4356(99)00206-1.CrossRefPubMed
10.
go back to reference Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM: On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003, 12: 349-362. 10.1023/A:1023499322593.CrossRefPubMed Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM: On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003, 12: 349-362. 10.1023/A:1023499322593.CrossRefPubMed
11.
go back to reference Stratford PW, Riddle DL: Assessing sensitivity to change: choosing the appropriate change coefficient. Health Qual Life Outcomes. 2005, 3: 23-10.1186/1477-7525-3-23.CrossRefPubMedPubMedCentral Stratford PW, Riddle DL: Assessing sensitivity to change: choosing the appropriate change coefficient. Health Qual Life Outcomes. 2005, 3: 23-10.1186/1477-7525-3-23.CrossRefPubMedPubMedCentral
12.
go back to reference Bialocerkowski AE, Grimmer KA, Bain GI: A systematic review of the content and quality of wrist outcome instruments. Int J Qual Health Care. 2000, 12: 149-157. 10.1093/intqhc/12.2.149.CrossRefPubMed Bialocerkowski AE, Grimmer KA, Bain GI: A systematic review of the content and quality of wrist outcome instruments. Int J Qual Health Care. 2000, 12: 149-157. 10.1093/intqhc/12.2.149.CrossRefPubMed
13.
go back to reference Daker-White G: Reliable and valid self-report outcome measures in sexual (dys)function: a systematic review. Arch Sex Behav. 2002, 31: 197-209. 10.1023/A:1014743304566.CrossRefPubMed Daker-White G: Reliable and valid self-report outcome measures in sexual (dys)function: a systematic review. Arch Sex Behav. 2002, 31: 197-209. 10.1023/A:1014743304566.CrossRefPubMed
14.
go back to reference Hayes JA, Black NA, Jenkinson C, Young JD, Rowan KM, Daly K, Ridley S: Outcome measures for adult critical care: a systematic review. Health Technol Assess. 2000, 4: 1-111.PubMed Hayes JA, Black NA, Jenkinson C, Young JD, Rowan KM, Daly K, Ridley S: Outcome measures for adult critical care: a systematic review. Health Technol Assess. 2000, 4: 1-111.PubMed
15.
go back to reference Hearn J, Higginson IJ: Outcome measures in palliative care for advanced cancer patients: a review. J Public Health Med. 1997, 19: 193-199.CrossRefPubMed Hearn J, Higginson IJ: Outcome measures in palliative care for advanced cancer patients: a review. J Public Health Med. 1997, 19: 193-199.CrossRefPubMed
16.
go back to reference Sun Y, Sturmer T, Gunther KP, Brenner H: Reliability and validity of clinical outcome measurements of osteoarthritis of the hip and knee: a review of the literature. Clin Rheumatol. 1997, 16: 185-198. 10.1007/BF02247849.CrossRefPubMed Sun Y, Sturmer T, Gunther KP, Brenner H: Reliability and validity of clinical outcome measurements of osteoarthritis of the hip and knee: a review of the literature. Clin Rheumatol. 1997, 16: 185-198. 10.1007/BF02247849.CrossRefPubMed
17.
go back to reference Buck D, Jacoby A, Massey A, Ford G: Evaluation of measures used to assess quality of life after stroke. Stroke. 2000, 31: 2004-2010.CrossRefPubMed Buck D, Jacoby A, Massey A, Ford G: Evaluation of measures used to assess quality of life after stroke. Stroke. 2000, 31: 2004-2010.CrossRefPubMed
18.
go back to reference Clark TJ, Khan KS, Foon R, Pattison H, Bryan S, Gupta JK: Quality of life instruments in studies of menorrhagia: a systematic review. Eur J Obstet Gynecol Reprod Biol. 2002, 104: 96-104. 10.1016/S0301-2115(02)00076-3.CrossRefPubMed Clark TJ, Khan KS, Foon R, Pattison H, Bryan S, Gupta JK: Quality of life instruments in studies of menorrhagia: a systematic review. Eur J Obstet Gynecol Reprod Biol. 2002, 104: 96-104. 10.1016/S0301-2115(02)00076-3.CrossRefPubMed
19.
go back to reference Connolly MA, Johnson JA: Measuring quality of life in paediatric patients. Pharmacoeconomics. 1999, 16: 605-625. 10.2165/00019053-199916060-00002.CrossRefPubMed Connolly MA, Johnson JA: Measuring quality of life in paediatric patients. Pharmacoeconomics. 1999, 16: 605-625. 10.2165/00019053-199916060-00002.CrossRefPubMed
20.
go back to reference Coons SJ, Rao S, Keininger DL, Hays RD: A comparative review of generic quality-of-life instruments. Pharmacoeconomics. 2000, 17: 13-35. 10.2165/00019053-200017010-00002.CrossRefPubMed Coons SJ, Rao S, Keininger DL, Hays RD: A comparative review of generic quality-of-life instruments. Pharmacoeconomics. 2000, 17: 13-35. 10.2165/00019053-200017010-00002.CrossRefPubMed
21.
go back to reference De Boer MR, Moll AC, De Vet HC, Terwee CB, Volker-Dieben HJ, Van Rens GH: Psychometric properties of vision-related quality of life questionnaires: a systematic review. Ophthalmic Physiol Opt. 2004, 24: 257-273. 10.1111/j.1475-1313.2004.00187.x.CrossRefPubMed De Boer MR, Moll AC, De Vet HC, Terwee CB, Volker-Dieben HJ, Van Rens GH: Psychometric properties of vision-related quality of life questionnaires: a systematic review. Ophthalmic Physiol Opt. 2004, 24: 257-273. 10.1111/j.1475-1313.2004.00187.x.CrossRefPubMed
22.
go back to reference De Korte J, Mombers FM, Sprangers MA, Bos JD: The suitability of quality-of-life questionnaires for psoriasis research: a systematic literature review. Arch Dermatol. 2002, 138: 1221-1227. 10.1001/archderm.138.9.1221.CrossRefPubMed De Korte J, Mombers FM, Sprangers MA, Bos JD: The suitability of quality-of-life questionnaires for psoriasis research: a systematic literature review. Arch Dermatol. 2002, 138: 1221-1227. 10.1001/archderm.138.9.1221.CrossRefPubMed
23.
go back to reference De Tiedra AG, Mercadal J, Badia X, Mascaro JM, Lozano R: A method to select an instrument for measurement of HR-QOL for cross-cultural adaptation applied to dermatology. Pharmacoeconomics. 1998, 14: 405-422. 10.2165/00019053-199814040-00007.CrossRefPubMed De Tiedra AG, Mercadal J, Badia X, Mascaro JM, Lozano R: A method to select an instrument for measurement of HR-QOL for cross-cultural adaptation applied to dermatology. Pharmacoeconomics. 1998, 14: 405-422. 10.2165/00019053-199814040-00007.CrossRefPubMed
24.
go back to reference Edwards B, Ung L: Quality of life instruments for caregivers of patients with cancer: a review of their psychometric properties. Cancer Nurs. 2002, 25: 342-349. 10.1097/00002820-200210000-00002.CrossRefPubMed Edwards B, Ung L: Quality of life instruments for caregivers of patients with cancer: a review of their psychometric properties. Cancer Nurs. 2002, 25: 342-349. 10.1097/00002820-200210000-00002.CrossRefPubMed
25.
go back to reference Hallin P, Sullivan M, Kreuter M: Spinal cord injury and quality of life measures: a review of instrument psychometric quality. Spinal Cord. 2000, 38: 509-523. 10.1038/sj.sc.3101054.CrossRefPubMed Hallin P, Sullivan M, Kreuter M: Spinal cord injury and quality of life measures: a review of instrument psychometric quality. Spinal Cord. 2000, 38: 509-523. 10.1038/sj.sc.3101054.CrossRefPubMed
26.
go back to reference Margolis MK, Coyne K, Kennedy-Martin T, Baker T, Schein O, Revicki DA: Vision-specific instruments for the assessment of health-related quality of life and visual functioning: a literature review. Pharmacoeconomics. 2002, 20: 791-812. 10.2165/00019053-200220120-00001.CrossRefPubMed Margolis MK, Coyne K, Kennedy-Martin T, Baker T, Schein O, Revicki DA: Vision-specific instruments for the assessment of health-related quality of life and visual functioning: a literature review. Pharmacoeconomics. 2002, 20: 791-812. 10.2165/00019053-200220120-00001.CrossRefPubMed
27.
go back to reference Marinus J, Ramaker C, Van Hilten JJ, Stiggelbout AM: Health related quality of life in Parkinson's disease: a systematic review of disease specific instruments. J Neurol Neurosurg Psychiatry. 2002, 72: 241-248. 10.1136/jnnp.72.2.241.CrossRefPubMedPubMedCentral Marinus J, Ramaker C, Van Hilten JJ, Stiggelbout AM: Health related quality of life in Parkinson's disease: a systematic review of disease specific instruments. J Neurol Neurosurg Psychiatry. 2002, 72: 241-248. 10.1136/jnnp.72.2.241.CrossRefPubMedPubMedCentral
28.
go back to reference Pallis AG, Mouzas IA: Instruments for quality of life assessment in patients with inflammatory bowel disease. Dig Liver Dis. 2000, 32: 682-688. 10.1016/S1590-8658(00)80330-8.CrossRefPubMed Pallis AG, Mouzas IA: Instruments for quality of life assessment in patients with inflammatory bowel disease. Dig Liver Dis. 2000, 32: 682-688. 10.1016/S1590-8658(00)80330-8.CrossRefPubMed
29.
go back to reference Ringash J, Bezjak A: A structured review of quality of life instruments for head and neck cancer patients. Head Neck. 2001, 23: 201-213. 10.1002/1097-0347(200103)23:3<201::AID-HED1019>3.0.CO;2-M.CrossRefPubMed Ringash J, Bezjak A: A structured review of quality of life instruments for head and neck cancer patients. Head Neck. 2001, 23: 201-213. 10.1002/1097-0347(200103)23:3<201::AID-HED1019>3.0.CO;2-M.CrossRefPubMed
30.
go back to reference Bot SD, Terwee CB, Van der Windt DA, Bouter LM, Dekker J, De Vet HC: Clinimetric evaluation of shoulder disability questionnaires: a systematic review of the literature. Ann Rheum Dis. 2004, 63: 335-341. 10.1136/ard.2003.007724.CrossRefPubMedPubMedCentral Bot SD, Terwee CB, Van der Windt DA, Bouter LM, Dekker J, De Vet HC: Clinimetric evaluation of shoulder disability questionnaires: a systematic review of the literature. Ann Rheum Dis. 2004, 63: 335-341. 10.1136/ard.2003.007724.CrossRefPubMedPubMedCentral
31.
go back to reference Michener LA, Leggin BG: A review of self-report scales for the assessment of functional limitation and disability of the shoulder. J Hand Ther. 2001, 14: 68-76.CrossRefPubMed Michener LA, Leggin BG: A review of self-report scales for the assessment of functional limitation and disability of the shoulder. J Hand Ther. 2001, 14: 68-76.CrossRefPubMed
32.
go back to reference Salerno DF, Copley-Merriman C, Taylor TN, Shinogle J, Schulz RM: A review of functional status measures for workers with upper extremity disorders. Occup Environ Med. 2002, 59: 664-670. 10.1136/oem.59.10.664.CrossRefPubMedPubMedCentral Salerno DF, Copley-Merriman C, Taylor TN, Shinogle J, Schulz RM: A review of functional status measures for workers with upper extremity disorders. Occup Environ Med. 2002, 59: 664-670. 10.1136/oem.59.10.664.CrossRefPubMedPubMedCentral
33.
go back to reference Swinkels RA, Oostendorp RA, Bouter LM: Which are the best instruments for measuring disabilities in gait and gait-related activities in patients with rheumatic disorders. Clin Exp Rheumatol. 2004, 22: 25-33.PubMed Swinkels RA, Oostendorp RA, Bouter LM: Which are the best instruments for measuring disabilities in gait and gait-related activities in patients with rheumatic disorders. Clin Exp Rheumatol. 2004, 22: 25-33.PubMed
34.
go back to reference De Groot V, Beckerman H, Lankhorst GJ, Bouter LM: How to measure comorbidity. a critical review of available methods. J Clin Epidemiol. 2003, 56: 221-229. 10.1016/S0895-4356(02)00585-1.CrossRefPubMed De Groot V, Beckerman H, Lankhorst GJ, Bouter LM: How to measure comorbidity. a critical review of available methods. J Clin Epidemiol. 2003, 56: 221-229. 10.1016/S0895-4356(02)00585-1.CrossRefPubMed
35.
go back to reference Bot SD, Terwee CB, Van der Windt DA, Bouter LM, Dekker J, De Vet HC: Psychometric evaluation of self-report questionnaires - the development of a checklist. Second workshop on research methodology. Edited by: Ader HJ and Mellenbergh GJ. 2003, Amsterdam: VU University, June 25-27, 161-168- Bot SD, Terwee CB, Van der Windt DA, Bouter LM, Dekker J, De Vet HC: Psychometric evaluation of self-report questionnaires - the development of a checklist. Second workshop on research methodology. Edited by: Ader HJ and Mellenbergh GJ. 2003, Amsterdam: VU University, June 25-27, 161-168-
36.
go back to reference Willke RJ, Burke LB, Erickson P: Measuring treatment impact: a review of patient-reported outcomes and other efficacy endpoints in approved product labels. Control Clin Trials. 2004, 25: 535-552. 10.1016/j.cct.2004.09.003.CrossRefPubMed Willke RJ, Burke LB, Erickson P: Measuring treatment impact: a review of patient-reported outcomes and other efficacy endpoints in approved product labels. Control Clin Trials. 2004, 25: 535-552. 10.1016/j.cct.2004.09.003.CrossRefPubMed
37.
go back to reference Powell C: The Delphi technique: myths and realities. J Adv Nurs. 2003, 41: 376-382. 10.1046/j.1365-2648.2003.02537.x.CrossRefPubMed Powell C: The Delphi technique: myths and realities. J Adv Nurs. 2003, 41: 376-382. 10.1046/j.1365-2648.2003.02537.x.CrossRefPubMed
38.
go back to reference Moore CM: Group techniques for idea building. Applied Social Research Methods Series. 1987, Newbury Park: Sage Publicantions, Inc. Moore CM: Group techniques for idea building. Applied Social Research Methods Series. 1987, Newbury Park: Sage Publicantions, Inc.
39.
go back to reference Evers S, Goossens M, De Vet H, Van Tulder M, Ament A: Criteria list for assessment of methodological quality of economic evaluations: Consensus on Health Economic Criteria. Int J Technol Assess Health Care. 2005, 21: 240-245.PubMed Evers S, Goossens M, De Vet H, Van Tulder M, Ament A: Criteria list for assessment of methodological quality of economic evaluations: Consensus on Health Economic Criteria. Int J Technol Assess Health Care. 2005, 21: 240-245.PubMed
40.
go back to reference Verhagen AP, De Vet HC, De Bie RA, Kessels AG, Boers M, Bouter LM, Knipschild PG: The Delphi list: a criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi consensus. J Clin Epidemiol. 1998, 51: 1235-1241. 10.1016/S0895-4356(98)00131-0.CrossRefPubMed Verhagen AP, De Vet HC, De Bie RA, Kessels AG, Boers M, Bouter LM, Knipschild PG: The Delphi list: a criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi consensus. J Clin Epidemiol. 1998, 51: 1235-1241. 10.1016/S0895-4356(98)00131-0.CrossRefPubMed
41.
go back to reference Fried BJ, Boers M, Baker PR: A method for achieving consensus on rheumatoid arthritis outcome measures: the OMERACT conference process. J Rheumatol. 1993, 20: 548-551.PubMed Fried BJ, Boers M, Baker PR: A method for achieving consensus on rheumatoid arthritis outcome measures: the OMERACT conference process. J Rheumatol. 1993, 20: 548-551.PubMed
Metadata
Title
Protocol of the COSMIN study: COnsensus-based Standards for the selection of health Measurement INstruments
Authors
LB Mokkink
CB Terwee
DL Knol
PW Stratford
J Alonso
DL Patrick
LM Bouter
HCW de Vet
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2006
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-6-2

Other articles of this Issue 1/2006

BMC Medical Research Methodology 1/2006 Go to the issue