Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Health and Quality of Life Outcomes
Published in: Health and Quality of Life Outcomes 1/2017

Open Access 01-12-2017 | Research

Psychometric validation of a multi-dimensional capability instrument for outcome measurement in mental health research (OxCAP-MH)

Authors: Francis Vergunst, Crispin Jenkinson, Tom Burns, Paul Anand, Alastair Gray, Jorun Rugkåsa, Judit Simon

Published in: Health and Quality of Life Outcomes | Issue 1/2017

Login to get access

Abstract

Background

Patient reported outcome measures (PROMs) are widely used in mental healthcare research for quality of life assessment but most fail to capture the breadth of health and non-health domains that can be impacted. We report the psychometric validation of a novel, multi-dimensional instrument based on Amartya Sen’s capability approach intended for use as an outcome measure in mental health research.

Methods

The Oxford Capabilities Questionnaire for Mental Health (OxCAP-MH) is a 16-item self-complete capability measure that covers multiple domains of functioning and welfare. Data for validation of the instrument were collected through a national randomised controlled trial of community treatment orders for patients with psychosis. Complete OxCAP-MH data were available for 172 participants. Internal consistency was established with Cronbach’s alpha; an interclass correlation coefficient was used to assess test-retest reliability in a sub-sample (N = 50) tested one week apart. Construct validity was established by comparing OxCAP-MH total scores with established instruments of illness severity and functioning: EuroQol (EQ-5D), Brief Psychiatric Rating Scale (BPRS), Global Assessment of Functioning (GAF) and Objective Social Outcomes Index (SIX). Sensitivity was established by calculating standard error of measurement using distributional methods.

Results

The OxCAP-MH showed good internal consistency (Cronbach’s alpha 0.79) and test-retest reliability (ICC = 0.86). Convergent validity was evidenced by strong correlations with the EQ-5D (VAS 0.52, p < .001) (Utility 0.45, p < .001), and divergent validity through more modest associations with the BPRS (−0.41, p < .001), GAF (0.24, p < .001) and SIX (0.12, p = ns). A change of 9.2 points on a 0–100 scale was found to be meaningful on statistical grounds.

Conclusions

The OxCAP-MH has demonstrable reliability and construct validity and represents a promising multi-dimensional alternative to existing patient-reported outcome measures for quality of life used in mental health research.
Appendix
Available only for authorised users
Literature
1.
Black N. Patient reported outcome measures could help transform healthcare. Br Med J. 2013;346:f167.CrossRef
2.
Nelson EC, Eftimovska E, Lind C, Hager A, Wasson JH, Lindblad S. Patient reported outcome measures in practice. Br Med J. 2015;350:g7818.CrossRef
3.
Ahles TA, Wasson JH, Seville JL, Johnson DJ, Cole BF, Hanscom B, et al. A controlled trial of methods for managing pain in primary care patients with or without co-occurring psychosocial problems. Ann Fam Med. 2006;4:341–50.CrossRefPubMedPubMedCentral
4.
Chen J, Ou L, Hollis SJ. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Serv Res. 2013;13:211.CrossRefPubMedPubMedCentral
5.
Marshall S, Haywood K, Fitzpatrick R. Impact of patient-reported outcome measures on routine practice: a structured review. J Eval Clin Pract. 2006;12:559–68.CrossRefPubMed
6.
Santana M-J, Feeny D. Framework to assess the effects of using patient-reported outcome measures in chronic care management. Qual Life Res. 2014;23:1505–13.CrossRefPubMed
7.
Valderas J, Kotzeva A, Espallargues M, Guyatt G, Ferrans C, Halyard M, et al. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Qual Life Res. 2008;17:179–93.CrossRefPubMed
8.
Wasson JH, Stukel TA, Weiss JE, Hays RD, Jette AM, Nelson EC. A randomized trial of using patient self-assessment data to improve community practices. Eff Clin Pract. 1999;2:1–10.PubMed
9.
10.
11.
EuroQol-Group. EuroQol - a new facility for the measurement of health-related quality of life. Health Policy. 1990;16:199–208.CrossRef
12.
Lorgelly PK, Lawson KD, Fenwick EA, Briggs AH. Outcome measurement in economic evaluations of public health interventions: a role for the capability approach? Int J Environ Res Public Health. 2010;7:2274–89.CrossRefPubMedPubMedCentral
13.
14.
Janssen M, Pickard AS, Golicki D, Gudex C, Niewada M, Scalone L, et al. Measurement properties of the EQ-5D-5L compared to the EQ-5D-3L across eight patient groups: a multi-country study. Qual Life Res. 2013;22:1717–27.CrossRefPubMed
15.
Sen A. Choice, welfare and measurement. Cambridge, MA: Harvard University Press; 1982.
16.
Sen A. Capability and well-being. In: Nussbaum MC and Sen A, editors. The Quality of Life. Oxford: Clarendon Press; 1993.
17.
Sen A. Development as freedom. Oxford: Oxford University Press; 1999.
18.
Coast J, Kinghorn P, Mitchell P. The development of capability measures in health economics: opportunities, challenges and progress. Patient Patient-Centered Outcomes Res. 2015;8:119–26.CrossRef
19.
Verkerk MA, Busschbach JJ, Karssing ED. Health-related quality of life research and the capability approach of Amartya Sen. Qual Life Res. 2001;10:49–55.CrossRefPubMed
20.
21.
Prah RJ. Health capability: conceptualization and Operationalization. Am J Public Health. 2010;100:41–9.CrossRef
22.
Robeyns I. The capability approach: a theoretical survey. J Hum Dev. 2005;6:93–117.CrossRef
23.
Francis J, Byford S. SCIE’s approach to economic evaluation in social care. London: SCIE; 2011.
24.
Nussbaum M. Capabilities as fundamental entitlements: Sen and social justice. Fem Econ. 2003;9:33–59.CrossRef
25.
Alkire S. Valuing freedoms: Sen’s capability approach and poverty reduction. Oxford: Oxford University Press; 2005.
26.
Simon J, Anand P, Gray A, Rugkåsa J, Yeeles K, Burns T. Operationalising the capability approach for outcome measurement in mental health research. Soc Sci Med. 2013;98:187–96.CrossRefPubMed
27.
Vergunst F, Jenkinson C, Burns T, Simon J. Application of Sen’s capability approach to outcome measurement in mental health research: psychometric validation of a novel multi-dimensional instrument (OxCAP-MH). Hum Welf. 2014;3:1–4.
28.
Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press; 2008.
29.
Guyatt G, Walter S, Norman G. Measuring change over time: assessing the usefulness of evaluative instruments. J Chronic Dis. 1987;40:171–8.CrossRefPubMed
30.
Revicki DA, Osoba D, Fairclough D, Barofsky I, Berzon R, Leidy NK, et al. Recommendations on health-related quality of life research to support labeling and promotional claims in the United States. Qual Life Res. 2000;9:887–900.CrossRefPubMed
31.
32.
Kazis LE, Anderson JJ, Meenan RF. Effect sizes for interpreting changes in health status. Med Care. 1989;27:S178–89.CrossRefPubMed
33.
Fitzpatrick R, Norquist JM, Jenkinson C. Distribution-based criteria for change in health-related quality of life in Parkinson’s disease. J Clin Epidemiol. 2004;57:40–4.CrossRefPubMed
34.
Wyrwich KW, Tierney WM, Wolinsky FD. Further evidence supporting an SEM-based criterion for identifying meaningful intra-individual changes in health-related quality of life. J Clin Epidemiol. 1999;52:861–73.CrossRefPubMed
35.
Wyrwich KW, Nienaber NA, Tierney WM, Wolinsky FD. Linking clinical relevance and statistical significance in evaluating intra-individual changes in health-related quality of life. Med Care. 1999;37:469–78.CrossRefPubMed
36.
Norquist J, Fitzpatrick R, Jenkinson C. Health-related quality of life in amyotrophic lateral sclerosis: determining a meaningful deterioration. Qual Life Res. 2004;13:1409–14.CrossRefPubMed
37.
Iverson GL. Interpreting change on the WAIS-III/WMS-III in clinical samples. Arch Clin Neuropsychol. 2001;16:183–91.CrossRefPubMed
38.
Burns T, Rugkåsa J, Molodynski A, Dawson J, Yeeles K, Vazquez-Montes M, et al. Community treatment orders for patients with psychosis (OCTET): a randomised controlled trial. Lancet. 2013;381:1627–33.CrossRefPubMed
39.
Marx RG, Menezes A, Horovitz L, Jones EC, Warren RF. A comparison of two time intervals for test-retest reliability of health status instruments. J Clin Epidemiol. 2003;56:730–5.CrossRefPubMed
40.
Glick HA, Polsky D, Willke RJ, Schulman KA. A comparison of preference assessment instruments used in a clinical trial: responses to the visual analogue scale from the EuroQol, EQ-5D and the health utility index. Med Decis Mak. 1999;19:265–75.CrossRef
41.
Overall JE, Gorham DR. The brief psychiatric rating scale. Psychol Rep. 1962;10:799–812.CrossRef
42.
Mortimer AM. Symptom rating scales and outcome in schizophrenia. Br J Psychiatry. 2007;191:s7–14.CrossRef
43.
44.
Priebe S, Watzke S, Hansson L, Burns T. Objective social outcomes index (SIX): a method to summarise objective indicators of social outcomes in mental health care. Acta Psychiatr Scand. 2008;118:57–63.CrossRefPubMed
45.
Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.CrossRefPubMed
46.
Mitchell CR, Vernon JA, Creedon TA. Measuring tinnitus parameters: loudness, pitch, and maskability. J Am Acad Audiol. 1993;4:139–51.PubMed
47.
Sloan DA, Donnelly MB, Schwartz RW, Felts JL, Blue AV, Strodel WE. The use of the objective structured clinical examination (OSCE) for evaluation and instruction in graduate medical education. J Surg Res. 1996;63:225–30.CrossRefPubMed
48.
SPSS, IBM Corp. Released 2011. IBM SPSS statistics for windows, version 20.0. Armonk, NY: IBM Corp; 2011.
49.
Dyer MT, Goldsmith KA, Sharples LS, Buxton MJ. A review of health utilities using the EQ-5D in studies of cardiovascular disease. Health Qual Life Outcomes. 2010;8:1–12.CrossRef
50.
Janssen M, Lubetkin E, Sekhobo J, Pickard A. The use of the EQ-5D preference-based health status measure in adults with type 2 diabetes mellitus. Diabet Med. 2011;28:395–413.CrossRefPubMed
51.
Johnson JA, Coons SJ. Comparison of the EQ-5D and SF-12 in an adult US sample. Qual Life Res. 1998;7:155–66.CrossRefPubMed
52.
Johnson JA, Pickard AS. Comparison of the EQ-5D and SF-12 health surveys in a general population survey in Alberta. Canada Med Care. 2000;38:115–21.CrossRefPubMed
53.
Pickard AS, Wilke C, Jung E, Patel S, Stavem K, Lee TA. Use of a preference-based measure of health (EQ-5D) in COPD and asthma. Respir Med. 2008;102:519–36.CrossRefPubMed
54.
Pickard AS, Wilke CT, Lin HW, Lloyd A. Health utilities using the EQ-5D in studies of cancer. PharmacoEconomics. 2007;25:365–84.CrossRefPubMed
55.
Rugkåsa J, Molodynski A, Yeeles K, Vazquez Montes M, Visser C, Burns T, et al. Community treatment orders: clinical and social outcomes, and a subgroup analysis from the OCTET RCT. Acta Psychiatr Scand. 2015;131:321–9.CrossRefPubMed
56.
Burns T, Yeeles K, Koshiaris C, Vazquez-Montes M, Molodynski A, Puntis S, et al. Effect of increased compulsion on readmission to hospital or disengagement from community services for patients with psychosis: follow-up of a cohort from the OCTET trial. Lancet Psychiatry. 2015;2:881–90.CrossRefPubMed
57.
Wyrwich KW, Tierney WM, Wolinsky FD. Using the standard error of measurement to identify important changes on the asthma quality of life questionnaire. Qual Life Res. 2002;11:1–7.CrossRefPubMed
58.
König HH, Bernert S, Angermeyer MC, Matschinger H, Martinez M, Vilagut G, et al. Comparison of population health status in six european countries: results of a representative survey using the EQ-5D questionnaire. Med Care. 2009;47:255–61.CrossRefPubMed
59.
Aas IHM. Guidelines for rating global assessment of functioning (GAF). Ann General Psychiatry. 2011;10:2–2.CrossRef
60.
Loevdahl H, Friis S. Routine evaluation of mental health: reliable information or worthless “guesstimates”? Acta Psychiatr Scand. 1996;93:125–8.CrossRefPubMed
61.
Yamauchi K, Ono Y, Baba K, Ikegami N. The actual process of rating the global assessment of functioning scale. Compr Psychiatry. 2001;42:403–9.CrossRefPubMed
62.
Priebe S. Social outcomes in schizophrenia. Br J Psychiatry. 2007;191:s15–20.CrossRef
63.
Coast J, Flynn TN, Natarajan L, Sproston K, Lewis J, Louviere JJ, et al. Valuing the ICECAP capability index for older people. Soc Sci Med. 2008;67:874–82.CrossRefPubMed
64.
Comans TA, Peel NM, Gray LC, Scuffham PA. Quality of life of older frail persons receiving a post-discharge program. Health Qual Life Outcomes. 2013;11:1–7.CrossRef
65.
Flynn TN, BCom EH, Joanna Coast B. Change in capability-related quality of life resulting from hip or knee replacement: results from a cohort study using the ICECAP-O instrument. Unpubl Manuscr 2013;1–16.
66.
Parsons N, Griffin XL, Achten J, Costa ML. Outcome assessment after hip fracture is EQ-5D the answer? Bone Jt Res. 2014;3:69–75.CrossRef
Metadata
Title
Psychometric validation of a multi-dimensional capability instrument for outcome measurement in mental health research (OxCAP-MH)
Authors
Francis Vergunst
Crispin Jenkinson
Tom Burns
Paul Anand
Alastair Gray
Jorun Rugkåsa
Judit Simon
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2017
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-017-0825-3

Other articles of this Issue 1/2017

Health and Quality of Life Outcomes 1/2017 Go to the issue

Research

Psychometric properties of the SDM-Q-9 questionnaire for shared decision-making in multiple sclerosis: item response theory modelling and confirmatory factor analysis

Research

Effects of home-based long-term care services on caregiver health according to age

Research

Quality of life improvement in Latinas receiving combined substance use disorders and trauma-specific treatment: a cohort evaluation report

Research

Psychometric properties of the painDETECT questionnaire in rheumatoid arthritis, psoriatic arthritis and spondyloarthritis: Rasch analysis and test-retest reliability

Research

The chinese version of achilles tendon total rupture score: cross-cultural adaptation, reliability and validity

Research

The Patient Assessment of Chronic Illness Care produces measurements along a single dimension: results from a Mokken analysis