Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

The development and evaluation of a five-language multi-perspective standardised measure: clinical decision-making involvement and satisfaction (CDIS)

Authors: Mike Slade, Harriet Jordan, Eleanor Clarke, Paul Williams, Helena Kaliniecka, Katrin Arnold, Andrea Fiorillo, Domenico Giacco, Mario Luciano, Anikó Égerházi, Marietta Nagy, Malene Krogsgaard Bording, Helle Østermark Sørensen, Wulf Rössler, Wolfram Kawohl, Bernd Puschner, the CEDAR Study Group

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

The aim of this study was to develop and evaluate a brief quantitative five-language measure of involvement and satisfaction in clinical decision-making (CDIS) – with versions for patients (CDIS-P) and staff (CDIS-S) – for use in mental health services.

Methods

An English CDIS was developed by reviewing existing measures, focus groups, semistructured interviews and piloting. Translations into Danish, German, Hungarian and Italian followed the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) Task Force principles of good practice for translation and cultural adaptation. Psychometricevaluation involved testing the measure in secondary mental health services in Aalborg, Debrecen, London, Naples, Ulm and Zurich.

Results

After appraising 14 measures, the Control Preference Scale and Satisfaction With Decision-making English-language scales were modified and evaluated in interviews (n = 9), focus groups (n = 22) and piloting (n = 16). Translations were validated through focus groups (n = 38) and piloting (n = 61). A total of 443 service users and 403 paired staff completed CDIS. The Satisfaction sub-scale had internal consistency of 0.89 (0.86-0.89 after item-level deletion) for staff and 0.90 (0.87-0.90) for service users, both continuous and categorical (utility) versions were associated with symptomatology and both staff-rated and service userrated therapeutic alliance (showing convergent validity), and not with social disability (showing divergent validity), and satisfaction predicted staff-rated (OR 2.43, 95%CI 1.54- 3.83 continuous, OR 5.77, 95%CI 1.90-17.53 utility) and service user-rated (OR 2.21, 95%CI 1.51-3.23 continuous, OR 3.13, 95%CI 1.10-8.94 utility) decision implementation two months later. The Involvement sub-scale had appropriate distribution and no floor or ceiling effects, was associated with stage of recovery, functioning and quality of life (staff only) (showing convergent validity), and not with symptomatology or social disability (showing divergent validity), and staff-rated passive involvement by the service user predicted implementation (OR 3.55, 95%CI 1.53-8.24). Relationships remained after adjusting for clustering by staff.

Conclusions

CDIS demonstrates adequate internal consistency, no evidence of item redundancy, appropriate distribution, and face, content, convergent, divergent and predictive validity. It can be recommended for research and clinical use. CDIS-P and CDIS-S in all 3 five languages can be downloaded at http://​www.​cedar-net.​eu/​instruments.

Trial registration

ISRCTN75841675.
Literature
1.
Karnieli-Miller O, Eisikovits Z: Physician as partner or salesman? Shared decision-making in real-time encounters. Soc Sci Med. 2009, 69 (1): 1-8.CrossRefPubMed
2.
Puschner B, Steffen S, Slade M, Kaliniecka H, Maj M, Fiorillo A, Munk-Jorgensen P, Larsen JI, Egerhazi A, Nemes Z, Rossler W, Kawohl W, Becker T: Clinical decision making and outcome in routine care for people with severe mental illness (CEDAR): study protocol. BMC Psychiatry. 2010, 10: 90.CrossRefPubMedPubMedCentral
3.
Goossensen A, Zijlstra P, Koopmanschap M: Measuring shared decision making processes in psychiatry: skills versus patient satisfaction. Patient Educ Couns. 2007, 67 (1–2): 50-56.CrossRefPubMed
4.
Wakefield P, Read S, Firth W, Lindesay J: Clients’ perceptions of outcome following contact with a community mental health team. J Ment Health. 1998, 7 (4): 375-384.CrossRef
5.
Hamann J, Leucht S, Kissling W: Shared decision making in psychiatry. Acta Psychiatr. 2003, 107: 403-409.CrossRef
6.
Shared Decision-Making in Health Care. Edited by: Edwards A, Elwyn G. 2009, Oxford: Oxford University Press, 2
7.
Hamann J, Langer B, Winkler V, Busch R, Cohen R, Leucht S, Kissling W: Shared decision making for in-patients with schizophrenia. Acta Psychiatr Scand. 2006, 114 (4): 265-273.CrossRefPubMed
8.
Charles C, Gafni A, Whelan T: Shared decision-making in the medical encounter: what does it mean? (or it takes at least two to tango). Soc Sci Med. 1997, 44 (5): 681-692.CrossRefPubMed
9.
National Institute for Health and Clinical Excellence: CG136. Service User Experience in Adult Mental Health: Improving the Experience of Care for People Using Adult NHS Mental Health Services. 2011, London: National Institute for Health and Clinical Excellence
10.
Duncan E, Best C, Hagen S: Shared decision making interventions for people with mental health conditions. Cochrane Database Syst Rev. 2010, 1: CD007297.PubMed
11.
12.
Le Boutillier C, Leamy M, Bird VJ, Davidson L, Williams J, Slade M: What does recovery mean in practice? A qualitative analysis of international recovery-oriented practice guidance. Psychiatr Serv. 2011, 62: 1470-1476.CrossRefPubMed
13.
Bird V, Leamy M, Le Boutillier C, Williams J, Slade M: REFOCUS: Promoting Recovery in Community Mental Health Services. 2011, London: Rethink (researchintorecovery.com/refocus)
14.
Seale C, Chaplin R, Lelliott P, Quirk A: Sharing decisions in consultations involving anti-psychotic medication: a qualitative study of psychiatrists’ experiences. Soc Sci Med. 2006, 62 (11): 2861-2873.CrossRefPubMed
15.
Junghan UM, Leese M, Priebe S, Slade M: Staff and patient perspectives on unmet need and therapeutic alliance in community mental health services. Br J Psychiatry. 2007, 191: 543-547.CrossRefPubMed
16.
Melbourne E, Sinclair K, Durand M-A, Legare F, Elwyn G: Developing a dyadic OPTION scale to measure perceptions of shared decision making. Patient Educ Couns. 2010, 78 (2): 177-183.CrossRefPubMed
17.
Attkisson CC, Zwick R: The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann. 1982, 5 (3): 233-237.CrossRefPubMed
18.
Ruggeri M, Lasalvia A, Dall’Agnola R, van Wijngaarden B, Knudsen HC, Leese M, Gaite L, Tansella M: Development, internal consistency and reliability of the Verona Service Satisfaction Scale–European Version. EPSILON Study 7. European Psychiatric Services: inputs linked to outcome domains and needs. Br J Psychiatry Suppl. 2000, 39: s41-s48.CrossRefPubMed
19.
Scholl I, Koelewijn-van Loon M, Sepucha K, Elwyn G, Legare F, Harter M, Dirmaier J: Measurement of shared decision making – a review of instruments. Z Arztl Fortbild Qual Gesundhwes. 2011, 105: 313-324.CrossRef
20.
Shepherd A, Shorthouse O, Gask L: Consultant psychiatrists’ experiences of and attitudes towards shared decision making in antipsychotic prescribing, a qualitative study. BMC Psychiatry. 2014, 14: 127.CrossRefPubMedPubMedCentral
21.
Macpherson R, Varah M, Summerfield L, Foy C, Slade M: Staff and patient assessments of need in an epidemiologically representative sample of patients with psychosis. Soc Psychiatry Psychiatr Epidemiol. 2003, 38 (11): 662-667.CrossRefPubMed
22.
Slade M, Phelan M, Thornicroft G: A comparison of needs assessed by staff and by an epidemiologically representative sample of patients with psychosis. Psychol Med. 1998, 28 (3): 543-550.CrossRefPubMed
23.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P: Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005, 8 (2): 94-104.CrossRefPubMed
24.
First MS R, Gibbon M, Williams J: Structured Clinical Interviews for DSM-IV Axis I Disorders - Clinical Version (SCID-CV). 1997, Washington DC: American Psychiatric Association
25.
Slade M, Powell R, Rosen A, Strathdee G: Threshold Assessment Grid (TAG): the development of a valid and brief scale to assess the severity of mental illness. Soc Psychiatry Psychiatr Epidemiol. 2000, 35 (2): 78-85.CrossRefPubMed
26.
Slade M, Cahill S, Kelsey W, Powell R, Strathdee G: Threshold 2: the reliability, validity and sensitivity to change of the Threshold Assessment Grid (TAG). Acta Psychiatr Scand. 2002, 106 (6): 453-460.CrossRefPubMed
27.
Slade M, Cahill S, Kelsey W, Powell R, Strathdee G, Valiakalayil A: Threshold 3: the feasibility of the Threshold Assessment Grid (TAG) for routine assessment of the severity of mental health problems. Soc Psychiatry Psychiatr Epidemiol. 2001, 36 (10): 516-521.CrossRefPubMed
28.
Slade M, Cahill S, Kelsey W, Leese M, Powell R, Strathdee G: Threshold 4: an evaluation of the threshold assessment grid as an aid to mental health referrals. Prim Care Mental Health. 2003, 1: 45-54.
29.
Slade M, Thornicroft G, Glover G: The feasibility of routine outcome measures in mental health. Soc Psychiatry Psychiatr Epidemiol. 1999, 34 (5): 243-249.CrossRefPubMed
30.
Watts D, Bindman J, Slade M, Holloway F, Rosen A, Thornicroft G: Clinical Assessment of Risk Decision Support (CARDS): the development and evaluation of a feasible violence risk assessment for routine psychiatric practice. J Ment Health. 2004, 13: 569-581.CrossRef
31.
Wolstencoft K, Oades L, Caputi P, Andresen R: Development of a structured interview schedule to assess stage of psychological recovery from enduring mental illness. Int J Psychiatry Clin Pract. 2010, 14: 182-189.CrossRef
32.
Association AP: Diagnostic and Statistical Manual of Mental Disorders (4th edn.). 1994, Washington DC: American Psychiatric Association
33.
Wing JK, Beevor AS, Curtis RH, Park SB, Hadden S, Burns A: Health of the Nation Outcome Scales (HoNOS). Research and development. Br J Psychiatry. 1998, 172: 11-18.CrossRefPubMed
34.
Priebe S, Gruyters T: The role of the helping alliance in psychiatric community care: a prospective study. J Nerv Ment Dis. 1993, 181: 552-557.CrossRefPubMed
35.
Lambert MJ, Burlingame GM, Umphress V, Hansen NB, Vermeersch DA, Clouse GC, Yanchar SC: The reliability and validity of the outcome questionnaire. Clin Psychol Psychother. 1996, 3 (4): 249-258.CrossRef
36.
Priebe S, Huxley P, Knight S, Evans S: Application and results of the manchester short assessment of quality of life (MANSA). Int J Soc Psychiatry. 1999, 45: 7-12.CrossRefPubMed
37.
Andresen R, Caputi P, Oades L: The stages of recovery instrument: development of a measure of recovery from serious mental illness. Aust N Z J Psychiatry. 2006, 40: 972-980.CrossRefPubMed
38.
Weeks G, Slade M, Hayward M: A UK validation of the stages of recovery instrument. Int J Soc Psychiatry. 2011, 57: 446-454.CrossRefPubMed
39.
Gale C, Mullen R, Patterson T: Letter. Int J Soc Psychiatry. 2011, 58: 449-450.
40.
Grant MJ, Booth A: A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009, 26 (2): 91-108.CrossRefPubMed
41.
Bradley JG, Zia MJ, Hamilton N: Patient preferences for control in medical decision making: a scenario-based approach. Fam Med. 1996, 28 (7): 496-501.PubMed
42.
Degner LFS JA: Decision-making during serious illness - what role do patients really want to play?. J Clin Epidemiol. 1992, 45: 941-950.CrossRef
43.
Martin LR, DiMatteo MR, Lepper HS: Facilitation of patient involvement in care: development and validation of a scale. Behav Med. 2001, 27 (3): 111-120.CrossRefPubMed
44.
Golin CE, DiMatteo MR, Leake B, Duan N, Gelberg L: A diabetes-specific measure of patient desire to participate in medical decision making. Diabetes Educ. 2001, 27 (6): 875-886.CrossRefPubMed
45.
Cranney A, O’Connor AM, Jacobsen MJ, Tugwell P, Adachi JD, Ooi DS, Waldegger L, Goldstein R, Wells GA: Development and pilot testing of a decision aid for postmenopausal women with osteoporosis. Patient Educ Couns. 2002, 47 (3): 245-255.CrossRefPubMed
46.
Holmes-Rovner M, Kroll J, Schmitt N, Rovner DR, Breer ML, Rothert ML, Padonu G, Talarczyk G: Patient satisfaction with health care decisions: the satisfaction with decision scale. Med Decis Making. 1996, 16 (1): 58-64.CrossRefPubMed
47.
48.
Ende J, Kazis L, Ash A, Moskowitz MA: Measuring patients’ desire for autonomy: decision making and information-seeking preferences among medical patients. J Gen Intern Med. 1989, 4 (1): 23-30.CrossRefPubMed
49.
Loos S, Neumann P, Arnold K, Slade M, Fiorillo A, Frøkjær Krogsgaard Bording M, Ivanka T, Kawohl W, Puschner B: Gemeinsame Entscheidungsfindung in der Behandlung von Patienten mit schweren psychischen Erkrankungen: Eine Fokusgruppen-Untersuchung [Shared decision-making in the treatment of people with severe mental illness: a focus group study]. Psychiatr Prax. 2013, 40: 23-29.CrossRefPubMed
50.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC: Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007, 60 (1): 34-42.CrossRefPubMed
51.
Grogan S, Conner M, Willits D, Norman P: Development of a questionnaire to measure patients’ satisfaction with general practitioners’ services. Br J Gen Pract. 1995, 45 (399): 525-529.PubMedPubMedCentral
52.
Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD: Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979, 2 (3): 197-207.CrossRefPubMed
53.
Meakin R, Weinman J: The “Medical Interview Satisfaction Scale” (MISS-21) adapted for British general practice. Fam Pract. 2002, 19 (3): 257-263.CrossRefPubMed
54.
Ahlfors UG, Lewander T, Lindstrom E, Malt UF, Lublin H, Malm U: Assessment of patient satisfaction with psychiatric care - development and clinical evaluation of a brief consumer satisfaction rating scale (UKU-ConSat). Nordic J Psychiatry. 2001, 55: 71-90.CrossRef
55.
Horvath AO, Greenberg LS: Development and validation of the working alliance inventory. J Couns Psychol. 1989, 36 (2): 223-233.CrossRef
56.
Elwyn G, Hutchings H, Edwards A, Rapport F, Wensing M, Cheung WY, Grol R: The OPTION scale: measuring the extent that clinicians involve patients in decision-making tasks. Health Expect. 2005, 8 (1): 34-42.CrossRefPubMed
57.
O’Neal EL, Adams JR, McHugo GJ, Van Citters AD, Drake RE, Bartels SJ: Preferences of older and younger adults with serious mental illness for involvement in decision-making in medical and psychiatric settings. Am J Geriatr Psychiatry. 2008, 16 (10): 826-833.CrossRefPubMed
58.
59.
Wills CE, Holmes-Rovner M: Preliminary validation of the satisfaction with decision scale with depressed primary care patients. Health Expect. 2003, 6 (2): 149-159.CrossRefPubMed
60.
Simon D, Loh A, Harter M: Measuring (shared) decision-making - a review of psychometric instruments. Z Arztl Fortbild Qual Gesundhwes. 2007, 101: 259-267.
61.
Goss C, Moretti F, Mazzi MA, Del Piccolo L, Rimondini M, Zimmermann C: Involving patients in decisions during psychiatric consultations. Br J Psychiatry. 2008, 193 (5): 416-421.CrossRefPubMed
62.
Valenstein M, Mitchinson A, Ronis DL, Alexander JA, Duffy SA, Craig TJ, Barry KL: Quality indicators and monitoring of mental health services: what Do frontline providers think?. AJ Psychiatry. 2004, 161: 146-153.CrossRef
63.
Couture S, Roberts D, Penn D, Cather C, Otto M, Goff D: Do baseline client characteristics predict the therapeutic alliance in the treatment of schizophrenia?. J Nerv Ment Dis. 2006, 194: 10-14.CrossRefPubMed
64.
Garner B, Godley S, Funk R: Predictors of early therapeutic alliance among adolescents in Substance abuse treatment. J Psychoactive Drugs. 2008, 40: 55-65.CrossRefPubMed
65.
Lysaker P, Davis L, Buck K, Outcalt S, Ringer J: Negative symptoms and poor insight as predictors of the similarity between client and therapist ratings of therapeutic alliance in cognitive behavior therapy for patients with schizophrenia. J Nerv Ment Dis. 2011, 199: 191-195.CrossRefPubMed
66.
McCabe R, Priebe S: Are therapeutic relationships in psychiatry explained by patients’ symptoms? Factors influencing patient ratings. Eur Psychiatry. 2003, 18: 220-225.CrossRefPubMed
67.
McCabe R, Priebe S: The therapeutic relationship in the treatment of severe mental illness: a review of methods and findings. Int J Soc Psychiatry. 2004, 50: 115-128.CrossRefPubMed
68.
Wittorf A, Jakobi U, Bechdolf A, Müller B, Sartory G, Wagner M, Wiedemann G, Wölwer W, Herrlich J, Buchkremer G, Klingberg S: The influence of baseline symptoms and insight on the therapeutic alliance early in the treatment of schizophrenia. Eur Psychiatry. 2009, 24: 259-267.CrossRefPubMed
69.
Brown S, Evans Y, Espenschade K, O’Connor M: An examination of two brief stigma reduction strategies: Filmed personal contact and hallucination simulations. Community Ment Health J. 2010, 46: 494-499.CrossRefPubMed
70.
71.
Crumlish N, Kelly B: How psychiatrists think. Adv Psychiatr Treat. 2009, 15: 72-79.CrossRef
72.
Puschner B, Neumann P, Jordan H, Slade M, Fiorillo A, Giacco D, Egerhazi A, Ivanka T, Bording MK, Sorensen HO, Bar A, Kawohl W, Loos S, Arnold K, Ay E, Becker T, Konrad J, Steffen S, Zentner N, Clarke E, Maj M, Luciano M, De Rosa C, Sampogna G, Del Vecchio V, Cozzolino P, Del Vecchio HG, Salzano A, Nagy M, Cs group, et al: Development and psychometric properties of a five-language multiperspective instrument to assess clinical decision making style in the treatment of people with severe mental illness (CDMS). BMC Psychiatry. 2013, 13: 48.CrossRefPubMedPubMedCentral
73.
74.
Deegan P, Rapp C, Holter M, Riefer M: A program to support shared decision making in an outpatient psychiatric medication clinic. Psychiatr Serv. 2008, 59: 603-605.CrossRefPubMed
75.
Gilburt H, Rose D, Slade M: The importance of relationships in mental health care: a qualitative study of service users’ experiences of psychiatric hospital admission in the UK. BMC Health Serv Res. 2008, 8: 92.CrossRefPubMedPubMedCentral
76.
Leamy M, Bird V, Le Boutillier C, Williams J, Slade M: A conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J Psychiatry. 2011, 199: 445-452.CrossRefPubMed
Metadata
Title
The development and evaluation of a five-language multi-perspective standardised measure: clinical decision-making involvement and satisfaction (CDIS)
Authors
Mike Slade
Harriet Jordan
Eleanor Clarke
Paul Williams
Helena Kaliniecka
Katrin Arnold
Andrea Fiorillo
Domenico Giacco
Mario Luciano
Anikó Égerházi
Marietta Nagy
Malene Krogsgaard Bording
Helle Østermark Sørensen
Wulf Rössler
Wolfram Kawohl
Bernd Puschner
the CEDAR Study Group
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-14-323

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue

Research article

Elements of effective palliative care models: a rapid review

Research article

Governing the implementation of Emergency Obstetric Care: experiences of Rural District Health Managers, Tanzania

Research article

A qualitative exploration of discharge destination as an outcome or a driver of acute stroke care

Research article

Using intervention mapping to deconstruct cognitive work hardening: a return-to-work intervention for people with depression

Research article

Quality of care and health status in Ukraine

Research article

Organizing medical oncology care at a regional level and its subsequent impact on the quality of early breast cancer management: a before-after study