Skip to main content
Top
Published in: BMC Medicine 1/2023

Open Access 01-12-2023 | Care | Research article

Validation of patient- and GP-reported core sets of quality indicators for older adults with multimorbidity in primary care: results of the cross-sectional observational MULTIqual validation study

Authors: Ingmar Schäfer, Josefine Schulze, Katharina Glassen, Amanda Breckner, Heike Hansen, Anja Rakebrandt, Jessica Berg, Eva Blozik, Joachim Szecsenyi, Dagmar Lühmann, Martin Scherer

Published in: BMC Medicine | Issue 1/2023

Login to get access

Abstract

Background

Older adults with multimorbidity represent a growing segment of the population. Metrics to assess quality, safety and effectiveness of care can support policy makers and healthcare providers in addressing patient needs. However, there is a lack of valid measures of quality of care for this population. In the MULTIqual project, 24 general practitioner (GP)-reported and 14 patient-reported quality indicators for the healthcare of older adults with multimorbidity were developed in Germany in a systematic approach. This study aimed to select, validate and pilot core sets of these indicators.

Methods

In a cross-sectional observational study, we collected data in general practices (n = 35) and patients aged 65 years and older with three or more chronic conditions (n = 346). One-dimensional core sets for both perspectives were selected by stepwise backward selection based on corrected item-total correlations. We established structural validity, discriminative capacity, feasibility and patient-professional agreement for the selected indicators. Multilevel multivariable linear regression models adjusted for random effects at practice level were calculated to examine construct validity.

Results

Twelve GP-reported and seven patient-reported indicators were selected, with item-total correlations ranging from 0.332 to 0.576. Fulfilment rates ranged from 24.6 to 89.0%. Between 0 and 12.7% of the values were missing. Seventeen indicators had agreement rates between patients and professionals of 24.1% to 75.9% and one had 90.7% positive and 5.1% negative agreement. Patients who were born abroad (− 1.04, 95% CI =  − 2.00/ − 0.08, p = 0.033) and had higher health-related quality of life (− 1.37, 95% CI =  − 2.39/ − 0.36, p = 0.008), fewer contacts with their GP (0.14, 95% CI = 0.04/0.23, p = 0.007) and lower willingness to use their GPs as coordinators of their care (0.13, 95% CI = 0.06/0.20, p < 0.001) were more likely to have lower GP-reported healthcare quality scores. Patients who had fewer GP contacts (0.12, 95% CI = 0.04/0.20, p = 0.002) and were less willing to use their GP to coordinate their care (0.16, 95% CI = 0.10/0.21, p < 0.001) were more likely to have lower patient-reported healthcare quality scores.

Conclusions

The quality indicator core sets are the first brief measurement tools specifically designed to assess quality of care for patients with multimorbidity. The indicators can facilitate implementation of treatment standards and offer viable alternatives to the current practice of combining disease-related metrics with poor applicability to patients with multimorbidity.
Appendix
Available only for authorised users
Literature
19.
go back to reference Pillay M, Dennis S, Harris MF. Quality of care measures in multimorbidity. Aust Fam Physician. 2014;43:132–6.PubMed Pillay M, Dennis S, Harris MF. Quality of care measures in multimorbidity. Aust Fam Physician. 2014;43:132–6.PubMed
21.
go back to reference Schmitt J, Petzold T, Eberlein-Gonska M, Neugebauer EAM. Requirements for quality indicators. The relevance of current developments in outcomes research for quality management. [Anforderungsprofil an Qualitätsindikatoren. Relevanz aktueller Entwicklungen der Outcomes Forschung für das Qualitätsmanagement]. Z Evid Fortbild Qual Gesundhwes. 2013;107:516–22. https://doi.org/10.1016/j.zefq.2013.09.014.CrossRefPubMed Schmitt J, Petzold T, Eberlein-Gonska M, Neugebauer EAM. Requirements for quality indicators. The relevance of current developments in outcomes research for quality management. [Anforderungsprofil an Qualitätsindikatoren. Relevanz aktueller Entwicklungen der Outcomes Forschung für das Qualitätsmanagement]. Z Evid Fortbild Qual Gesundhwes. 2013;107:516–22. https://​doi.​org/​10.​1016/​j.​zefq.​2013.​09.​014.CrossRefPubMed
32.
go back to reference Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York, NY: McGraw-Hill; 2008. Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York, NY: McGraw-Hill; 2008.
35.
go back to reference Zijlmans EAO, Tijmstra J, van der Ark LA, Sijtsma K. Item-Score Reliability as a Selection Tool in Test Construction. Front Psychol. 2019;9:2298. Zijlmans EAO, Tijmstra J, van der Ark LA, Sijtsma K. Item-Score Reliability as a Selection Tool in Test Construction. Front Psychol. 2019;9:2298.
37.
go back to reference International Classification of Functioning, Disability, and Health: ICF. Geneva: World Health Organization; 2001. International Classification of Functioning, Disability, and Health: ICF. Geneva: World Health Organization; 2001.
42.
go back to reference Wensing M, Mainz J, Grol R. A standardised instrument for patient evaluations of general practice care in Europe. Eur J Gen Practice. 2000;6:82–7.CrossRef Wensing M, Mainz J, Grol R. A standardised instrument for patient evaluations of general practice care in Europe. Eur J Gen Practice. 2000;6:82–7.CrossRef
49.
go back to reference Violan C, Foguet-Boreu Q, Flores-Mateo G, Salisbury C, Blom J, Freitag M, Glynn L, Muth C, Valderas JM. Prevalence, determinants and patterns of multimorbidity in primary care: a systematic review of observational studies. PLoS One. 2014;9:e102149. Violan C, Foguet-Boreu Q, Flores-Mateo G, Salisbury C, Blom J, Freitag M, Glynn L, Muth C, Valderas JM. Prevalence, determinants and patterns of multimorbidity in primary care: a systematic review of observational studies. PLoS One. 2014;9:e102149.
59.
go back to reference Jonitz G, Mansky T, Scriba PC, Selbmann H-K, editors. Ergebnisverbesserung durch Qualitätsmanagement: Aktuelle Maßnahmen, Nachweise, Stand der Evaluierung. Report Versorgungsforschung Bd. 8. Köln: Dt. Ärzte-Verl.; 2014 Jonitz G, Mansky T, Scriba PC, Selbmann H-K, editors. Ergebnisverbesserung durch Qualitätsmanagement: Aktuelle Maßnahmen, Nachweise, Stand der Evaluierung. Report Versorgungsforschung Bd. 8. Köln: Dt. Ärzte-Verl.; 2014
62.
go back to reference Harris MF, Dennis S, Pillay M. Multimorbidity: negotiating priorities and making progress. Aust Fam Physician. 2013;42:850–4.PubMed Harris MF, Dennis S, Pillay M. Multimorbidity: negotiating priorities and making progress. Aust Fam Physician. 2013;42:850–4.PubMed
66.
go back to reference Ouwens M, Marres HAM, Hermens RRP, Hulscher MME, van den Hoogen, Frank JA, Grol RP, Wollersheim HCH. Quality of integrated care for patients with head and neck cancer: development and measurement of clinical indicators. Head Neck. 2007;29:378-86. https://doi.org/10.1002/hed.20532. Ouwens M, Marres HAM, Hermens RRP, Hulscher MME, van den Hoogen, Frank JA, Grol RP, Wollersheim HCH. Quality of integrated care for patients with head and neck cancer: development and measurement of clinical indicators. Head Neck. 2007;29:378-86. https://​doi.​org/​10.​1002/​hed.​20532.
68.
go back to reference Matusiewicz D, Pittelkau C, Elmer A. Die Digitale Transformation im Gesundheitswesen: Transformation, Innovation, Disruption. Berlin: MWV Medizinisch Wissenschaftliche Verlagsgesellschaft; 2018. Matusiewicz D, Pittelkau C, Elmer A. Die Digitale Transformation im Gesundheitswesen: Transformation, Innovation, Disruption. Berlin: MWV Medizinisch Wissenschaftliche Verlagsgesellschaft; 2018.
69.
Metadata
Title
Validation of patient- and GP-reported core sets of quality indicators for older adults with multimorbidity in primary care: results of the cross-sectional observational MULTIqual validation study
Authors
Ingmar Schäfer
Josefine Schulze
Katharina Glassen
Amanda Breckner
Heike Hansen
Anja Rakebrandt
Jessica Berg
Eva Blozik
Joachim Szecsenyi
Dagmar Lühmann
Martin Scherer
Publication date
01-12-2023
Publisher
BioMed Central
Keyword
Care
Published in
BMC Medicine / Issue 1/2023
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-023-02856-0

Other articles of this Issue 1/2023

BMC Medicine 1/2023 Go to the issue