Skip to main content
Top
Published in: BMC Health Services Research 1/2023

Open Access 01-12-2023 | Psycho-oncology | Research

Developing quality indicators for cross-sectoral psycho-oncology in Germany: combining the RAND/UCLA appropriateness method with a Delphi technique

Authors: Lisa Derendorf, Stephanie Stock, Dusan Simic, Clarissa Lemmen

Published in: BMC Health Services Research | Issue 1/2023

Login to get access

Abstract

Background

Internationally, the need for appropriately structured, high-quality care in psycho-oncology is more and more recognized and quality-oriented care is to be established. Quality indicators are becoming increasingly important for a systematic development and improvement of the quality of care. The aim of this study was to develop a set of quality indicators for a new form of care, a cross-sectoral psycho-oncological care program in the German health care system.

Methods

The widely established RAND/UCLA Appropriateness Method was combined with a modified Delphi technique. A systematic literature review was conducted to identify existing indicators. All identified indicators were evaluated and rated in a two-round Delphi process. Expert panels embedded in the Delphi process assessed the indicators in terms of relevance, data availability and feasibility. An indicator was accepted by consensus if at least 75% of the ratings corresponded to category 4 or 5 on a five-point Likert scale.

Results

Of the 88 potential indicators derived from a systematic literature review and other sources, 29 were deemed relevant in the first Delphi round. After the first expert panel, 28 of the dissented indicators were re-rated and added. Of these 57 indicators, 45 were found to be feasible in terms of data availability by the second round of expert panel. In total, 22 indicators were transferred into a quality report, implemented and tested within the care networks for participatory quality improvement. In the second Delphi round, the embedded indicators were tested for their practicability. The final set includes 16 indicators that were operationalized in care practice and rated by the expert panel as relevant, comprehensible, and suitable for care practice.

Conclusion

The developed set of quality indicators has proven in practical testing to be a valid quality assurance tool for internal and external quality management. The study findings could contribute to traceable high quality in cross-sectoral psycho-oncology by providing a valid and comprehensive set of quality indicators.

Trial registration

“Entwicklung eines Qualitätsmanagementsystems in der integrierten, sektorenübergreifenden Psychoonkologie—AP “Qualitätsmanagement und Versorgungsmanagement” zur Studie "integrierte, sektorenübergreifende Psychoonkologie (isPO)" a sub-project of the “integrierte, sektorenübergreifende Psychoonkologie (isPO)”, was registered in the German Clinical Trials Register (DRKS) (DRKS-ID: DRKS00021515) on 3rd September 2020. The main project was registered on 30th October 2018 (DRKS-ID: DRKS00015326).
Appendix
Available only for authorised users
Literature
1.
go back to reference World Health Organization. WHO report on cancer: setting priorities, investing wisely and providing care for all. Genf; 2020. World Health Organization. WHO report on cancer: setting priorities, investing wisely and providing care for all. Genf; 2020.
3.
go back to reference Erdmann F, Spix C, Katalinic A, Christ M, Folkerts J, Hansmann J, et al. Krebs in Deutschland für 2017/2018: Robert Koch-Institut; 2021. Erdmann F, Spix C, Katalinic A, Christ M, Folkerts J, Hansmann J, et al. Krebs in Deutschland für 2017/2018: Robert Koch-Institut; 2021.
7.
go back to reference Mehnert A, Vehling S, Scheffold K, Ladehoff N, Schön G, Wegscheider K, et al. Prävalenz von Anpassungsstörung, Akuter und Posttraumati-scher Belastungsstörung sowie somatoformen Störungen bei Krebspatienten. [Prevalence of adjustment disorder, acute and posttraumatic stress disorders as well as somatoform disorders in cancer patients]. Psychother Psychosom Med Psychol. 2013;63:466–72. https://doi.org/10.1055/s-0033-1347197. Mehnert A, Vehling S, Scheffold K, Ladehoff N, Schön G, Wegscheider K, et al. Prävalenz von Anpassungsstörung, Akuter und Posttraumati-scher Belastungsstörung sowie somatoformen Störungen bei Krebspatienten. [Prevalence of adjustment disorder, acute and posttraumatic stress disorders as well as somatoform disorders in cancer patients]. Psychother Psychosom Med Psychol. 2013;63:466–72. https://​doi.​org/​10.​1055/​s-0033-1347197.
9.
14.
go back to reference Deutscher Bundestag. Sozialgesetzbuch (SGB) Fünftes Buch (V) - Gesetzliche Krankenversicherung - (Artikel 1 des Gesetzes v. 20. Dezember 1988, BGBl. I S. 2477) § 135a Verpflichtung der Leistungserbringer zur Qualitätssicherung; 20.12.1988. Deutscher Bundestag. Sozialgesetzbuch (SGB) Fünftes Buch (V) - Gesetzliche Krankenversicherung - (Artikel 1 des Gesetzes v. 20. Dezember 1988, BGBl. I S. 2477) § 135a Verpflichtung der Leistungserbringer zur Qualitätssicherung; 20.12.1988.
15.
go back to reference Joint Commission on Accreditation of Healthcare Organizations (JCAHO). Primer on indicator Development and Application: Measuring Quality in Health Care. 1st ed. Oakbrook Terrace; 1990. Joint Commission on Accreditation of Healthcare Organizations (JCAHO). Primer on indicator Development and Application: Measuring Quality in Health Care. 1st ed. Oakbrook Terrace; 1990.
16.
go back to reference Großimlinghaus I, Falkai P, Gaebel W, Hasan A, Jänner M, Janssen B, et al. Erhebung von Qualitätsindikatoren anhand von Routinedaten : Darstellung eines Machbarkeitstests in 10 Fachkliniken für Psychiatrie und Psychotherapie. [Assessment of quality indicators with routine data: Presentation of a feasibility test in ten specialist clinics for psychiatry and psychotherapy]. Nervenarzt. 2015;86:1393–9. doi:https://doi.org/10.1007/s00115-015-4357-y. Großimlinghaus I, Falkai P, Gaebel W, Hasan A, Jänner M, Janssen B, et al. Erhebung von Qualitätsindikatoren anhand von Routinedaten : Darstellung eines Machbarkeitstests in 10 Fachkliniken für Psychiatrie und Psychotherapie. [Assessment of quality indicators with routine data: Presentation of a feasibility test in ten specialist clinics for psychiatry and psychotherapy]. Nervenarzt. 2015;86:1393–9. doi:https://​doi.​org/​10.​1007/​s00115-015-4357-y.
37.
go back to reference Joint Commission on Accreditation of Healthcare Organizations (JCAHO). Guide to Quality Assurance. Chicago: JCAHO; 1998. Joint Commission on Accreditation of Healthcare Organizations (JCAHO). Guide to Quality Assurance. Chicago: JCAHO; 1998.
42.
go back to reference Kallus WK. Erstellung von Fragebogen. 1st ed. Wien: facultas.wuv; 2010. Kallus WK. Erstellung von Fragebogen. 1st ed. Wien: facultas.wuv; 2010.
44.
go back to reference Hermes-Moll K, Klein G, Buschmann-Maiworm RE, Baumann W, Otremba B, Lebahn H, et al. WINHO-Qualitätsindikatoren für die ambulante onkologische Versorgung in Deutschland. [WINHO quality indicators for outpatient oncology care in Germany]. Z Evid Fortbild Qual Gesundhwes. 2013;107:548–59. https://doi.org/10.1016/j.zefq.2013.09.002. Hermes-Moll K, Klein G, Buschmann-Maiworm RE, Baumann W, Otremba B, Lebahn H, et al. WINHO-Qualitätsindikatoren für die ambulante onkologische Versorgung in Deutschland. [WINHO quality indicators for outpatient oncology care in Germany]. Z Evid Fortbild Qual Gesundhwes. 2013;107:548–59. https://​doi.​org/​10.​1016/​j.​zefq.​2013.​09.​002.
48.
go back to reference Pirl WF, Greer JA, Gregorio SW-D, Deshields T, Irwin S, Fasciano K, et al. Framework for planning the delivery of psychosocial oncology services: An American psychosocial oncology society task force report. Psychooncology. 2020;29:1982–7. doi:https://doi.org/10.1002/pon.5409. Pirl WF, Greer JA, Gregorio SW-D, Deshields T, Irwin S, Fasciano K, et al. Framework for planning the delivery of psychosocial oncology services: An American psychosocial oncology society task force report. Psychooncology. 2020;29:1982–7. doi:https://​doi.​org/​10.​1002/​pon.​5409.
49.
go back to reference Egidi G. Das Methodenpapier des AQUA-Institutes zu sektorenübergreifenden Qualitätsindikatoren - eine Kritik. Zeitschrift für Allgemeinmedizin. 2010. Egidi G. Das Methodenpapier des AQUA-Institutes zu sektorenübergreifenden Qualitätsindikatoren - eine Kritik. Zeitschrift für Allgemeinmedizin. 2010.
50.
52.
go back to reference Adler NE, Page AEK. Cancer Care for the Whole Patient: Meeting Psychosocial Health Needs. In: Institute of Medicine (US) Committee on Psychosocial Services to Cancer Patients/Families in a Country Setting, editor. Washington, DC: National Academies Press (US); 2008. Adler NE, Page AEK. Cancer Care for the Whole Patient: Meeting Psychosocial Health Needs. In: Institute of Medicine (US) Committee on Psychosocial Services to Cancer Patients/Families in a Country Setting, editor. Washington, DC: National Academies Press (US); 2008.
61.
go back to reference Keeney S, Hasson F, McKenna H. The Delphi technique in nursing and health research. Chichester: Wiley-Blackwell; 2011.CrossRef Keeney S, Hasson F, McKenna H. The Delphi technique in nursing and health research. Chichester: Wiley-Blackwell; 2011.CrossRef
65.
go back to reference Hsu CC, Sandford BA. Minimizing Non-Response in The Delphi Process: How to Respond to Non-Response. Pract Assess Res Eval. 2007;12(17);1-6. Hsu CC, Sandford BA. Minimizing Non-Response in The Delphi Process: How to Respond to Non-Response. Pract Assess Res Eval. 2007;12(17);1-6.
Metadata
Title
Developing quality indicators for cross-sectoral psycho-oncology in Germany: combining the RAND/UCLA appropriateness method with a Delphi technique
Authors
Lisa Derendorf
Stephanie Stock
Dusan Simic
Clarissa Lemmen
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2023
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-023-09604-3

Other articles of this Issue 1/2023

BMC Health Services Research 1/2023 Go to the issue