Skip to main content
Top
Published in: BMC Health Services Research 1/2010

Open Access 01-12-2010 | Debate

The Dutch Consumer Quality Index: an example of stakeholder involvement in indicator development

Authors: Diana MJ Delnoij, Jany JDJM Rademakers, Peter P Groenewegen

Published in: BMC Health Services Research | Issue 1/2010

Login to get access

Abstract

Background

Like in several other Western countries, in the Dutch health care system regulated competition has been introduced. In order to make this work, comparable information is required about the performance of health care providers in terms of effectiveness, safety and patient experiences. Without further coordination, external actors will all try to force health care providers to be transparent. For health care providers this might result in a situation in which they have to deliver data for several sets of indicators, defined by different actors. Therefore, in the Netherlands an effort is made to define national sets of performance indicators and related measuring instruments. In this article, the following questions are addressed, using patient experiences as an example:
- When and how are stakeholders involved in the development of indicators and instruments that measure the patients' experiences with health care providers?
- Does this involvement lead to indicators and instruments that match stakeholders' information needs?

Discussion

The Dutch experiences show that it is possible to implement national indicator sets and to reach consensus about what needs to be measured. Preliminary evaluations show that for health care providers and health insurers the benefits of standardization outweigh the possible loss of tailor-made information. However, it has also become clear that particular attention should be given to the participation of patient/consumer organisations.

Summary

Stakeholder involvement is complex and time-consuming. However, it is the only way to balance the information needs of all the parties that ask for and benefit from transparency, without frustrating the health care system.
Appendix
Available only for authorised users
Literature
1.
go back to reference Van de Ven WPMM, Schut FT: Universal Mandatory Health Insurance in The Netherlands: A Model for the United States?. Health Affairs. 2008, 27 (3): 771-81. 10.1377/hlthaff.27.3.771.CrossRefPubMed Van de Ven WPMM, Schut FT: Universal Mandatory Health Insurance in The Netherlands: A Model for the United States?. Health Affairs. 2008, 27 (3): 771-81. 10.1377/hlthaff.27.3.771.CrossRefPubMed
2.
go back to reference Rosenau PV, Lako CJ: An Experiment with Regulated Competition and Individual Mandates for Universal Health Care: The New Dutch Health Insurance System. J Health Polit Policy Law. 2008, 33 (6): 1031-55. 10.1215/03616878-2008-033.CrossRefPubMed Rosenau PV, Lako CJ: An Experiment with Regulated Competition and Individual Mandates for Universal Health Care: The New Dutch Health Insurance System. J Health Polit Policy Law. 2008, 33 (6): 1031-55. 10.1215/03616878-2008-033.CrossRefPubMed
3.
go back to reference Schut FT, van Doorslaer EK: Towards a reinforced agency role of health insurers in Belgium and The Netherlands. Health Policy. 1999, 48 (1): 47-67. 10.1016/S0168-8510(99)00027-5.CrossRefPubMed Schut FT, van Doorslaer EK: Towards a reinforced agency role of health insurers in Belgium and The Netherlands. Health Policy. 1999, 48 (1): 47-67. 10.1016/S0168-8510(99)00027-5.CrossRefPubMed
4.
go back to reference Carter N, Day P, Klein R: How organisations measure success: The use of performance indicators in government. 1995, London: Routledge Carter N, Day P, Klein R: How organisations measure success: The use of performance indicators in government. 1995, London: Routledge
5.
go back to reference Bouckaert G, Halligan J: Managing performance: international comparisons. 2008, London: Routledge Bouckaert G, Halligan J: Managing performance: international comparisons. 2008, London: Routledge
11.
go back to reference Van de Ven WP, Schut FT: Universal mandatory health insurance in the Netherlands: a model for the United States?. Health Affairs. 2008, 27 (3): 771-81. 10.1377/hlthaff.27.3.771.CrossRefPubMed Van de Ven WP, Schut FT: Universal mandatory health insurance in the Netherlands: a model for the United States?. Health Affairs. 2008, 27 (3): 771-81. 10.1377/hlthaff.27.3.771.CrossRefPubMed
12.
go back to reference Maarse H, Bartholomée Y: A public-private analysis of the new Dutch health insurance system. Eur J Health Econ. 2007, 8: 77-82. 10.1007/s10198-006-0009-2.CrossRefPubMed Maarse H, Bartholomée Y: A public-private analysis of the new Dutch health insurance system. Eur J Health Econ. 2007, 8: 77-82. 10.1007/s10198-006-0009-2.CrossRefPubMed
13.
go back to reference Custers T, Arah OA, Klazinga NS: Is there a business case for quality in The Netherlands? A critical analysis of the recent reforms of the health care system. Health Policy. 2007, 82 (2): 226-39. 10.1016/j.healthpol.2006.09.005.CrossRefPubMed Custers T, Arah OA, Klazinga NS: Is there a business case for quality in The Netherlands? A critical analysis of the recent reforms of the health care system. Health Policy. 2007, 82 (2): 226-39. 10.1016/j.healthpol.2006.09.005.CrossRefPubMed
14.
go back to reference de Silva A: A framework for measuring responsiveness. Global Programme on Evidence for Health Policy Discussion Paper Series: No. 32. 2000, Geneva: World Health Organization de Silva A: A framework for measuring responsiveness. Global Programme on Evidence for Health Policy Discussion Paper Series: No. 32. 2000, Geneva: World Health Organization
15.
go back to reference Sixma HJ, Delnoij DMJ, (eds): Handboek CQI Meetinstrumenten. Een handleiding voor de ontwikkeling en het gebruik van Consumer Quality Index (CQI) meetinstrumenten. 2007, Utrecht: Centrum KlantervaringZorg Sixma HJ, Delnoij DMJ, (eds): Handboek CQI Meetinstrumenten. Een handleiding voor de ontwikkeling en het gebruik van Consumer Quality Index (CQI) meetinstrumenten. 2007, Utrecht: Centrum KlantervaringZorg
18.
go back to reference Stubbe JH, Brouwer W, Delnoij DMJ: Patients' experiences with quality of hospital care: the Consumer Quality Index Cataract Questionnaire. BMC Ophthalmol. 2007, 7: 14-10.1186/1471-2415-7-14.CrossRefPubMedPubMedCentral Stubbe JH, Brouwer W, Delnoij DMJ: Patients' experiences with quality of hospital care: the Consumer Quality Index Cataract Questionnaire. BMC Ophthalmol. 2007, 7: 14-10.1186/1471-2415-7-14.CrossRefPubMedPubMedCentral
19.
go back to reference Stubbe JH, Gelsema T, Delnoij DMJ: The Consumer Quality Index Hip Knee Questionnaire measuring patients' experiences with quality of care after a total hip or knee arthroplasty. BMC Health Serv Res. 2007, 7: 60-10.1186/1472-6963-7-60.CrossRefPubMedPubMedCentral Stubbe JH, Gelsema T, Delnoij DMJ: The Consumer Quality Index Hip Knee Questionnaire measuring patients' experiences with quality of care after a total hip or knee arthroplasty. BMC Health Serv Res. 2007, 7: 60-10.1186/1472-6963-7-60.CrossRefPubMedPubMedCentral
20.
go back to reference Rupp I, Smulders A, Klazinga NS, Delnoij DMJ, Spreeuwenberg P: Ervaringenvragenlijst diabetes: onderzoek naar het discriminerend vermogen. AMC Afdeling Sociale Geneeskunde. 2006 Rupp I, Smulders A, Klazinga NS, Delnoij DMJ, Spreeuwenberg P: Ervaringenvragenlijst diabetes: onderzoek naar het discriminerend vermogen. AMC Afdeling Sociale Geneeskunde. 2006
21.
go back to reference Schee van der E, Friele RD, Delnoij DMJ: Weinig mensen veranderen van ziekenfonds. 2005, Utrecht: NIVEL Schee van der E, Friele RD, Delnoij DMJ: Weinig mensen veranderen van ziekenfonds. 2005, Utrecht: NIVEL
22.
go back to reference Hibbard JH, Peters E, Dixon A, Tusler M: Consumer Competencies and the Use of Comparative Quality Information: It Isn't Just about Literacy. Med Care Res Rev. 2007, 64: 379-10.1177/1077558707301630.CrossRefPubMed Hibbard JH, Peters E, Dixon A, Tusler M: Consumer Competencies and the Use of Comparative Quality Information: It Isn't Just about Literacy. Med Care Res Rev. 2007, 64: 379-10.1177/1077558707301630.CrossRefPubMed
23.
go back to reference Peters E, Hibbard JH, Slovic P, Dieckmann N: Numeracy skill and the communication, comprehension, and use of risk-benefit information. Health Affairs. 2007, 26 (3): 741-748. 10.1377/hlthaff.26.3.741.CrossRefPubMed Peters E, Hibbard JH, Slovic P, Dieckmann N: Numeracy skill and the communication, comprehension, and use of risk-benefit information. Health Affairs. 2007, 26 (3): 741-748. 10.1377/hlthaff.26.3.741.CrossRefPubMed
24.
go back to reference Schwartz B: The Paradox of Choice: Why more is less. 2004, New York: Harper Collins Publishers Inc Schwartz B: The Paradox of Choice: Why more is less. 2004, New York: Harper Collins Publishers Inc
25.
go back to reference Groenewoud S: It's your choice! A study of search and selection processes, and the use of performance indicators in different patient groups (thesis). 2008, Rotterdam: Erasmus University Groenewoud S: It's your choice! A study of search and selection processes, and the use of performance indicators in different patient groups (thesis). 2008, Rotterdam: Erasmus University
26.
go back to reference Custers T, Hurley J, Klazinga NS, Brown AD: Selecting effective incentive structures in health care: A decision framework to support health care purchasers in finding the right incentives to drive performance. BMC Health Services Research. 2008, 8: 66-10.1186/1472-6963-8-66.CrossRefPubMedPubMedCentral Custers T, Hurley J, Klazinga NS, Brown AD: Selecting effective incentive structures in health care: A decision framework to support health care purchasers in finding the right incentives to drive performance. BMC Health Services Research. 2008, 8: 66-10.1186/1472-6963-8-66.CrossRefPubMedPubMedCentral
27.
go back to reference ten Asbroek AHA: Health Services Research at work for National Health Policy (thesis). 2006, Amsterdam: Universityof Amsterdam ten Asbroek AHA: Health Services Research at work for National Health Policy (thesis). 2006, Amsterdam: Universityof Amsterdam
28.
go back to reference Hibbard JH, Peters E, Slovic P, Finucane ML, Tusler M: Making health care quality reports easier to use. The Joint Commission Journal on Quality Improvement. 2001, 27: 591-604.PubMed Hibbard JH, Peters E, Slovic P, Finucane ML, Tusler M: Making health care quality reports easier to use. The Joint Commission Journal on Quality Improvement. 2001, 27: 591-604.PubMed
29.
go back to reference Hibbard JH, Slovic P, Peters E, Finucane ML: Strategies for reporting health plan performance information to consumers: evidence from controlled studies. Health Services Research. 2002, 37: 291-313. 10.1111/1475-6773.024.CrossRefPubMedPubMedCentral Hibbard JH, Slovic P, Peters E, Finucane ML: Strategies for reporting health plan performance information to consumers: evidence from controlled studies. Health Services Research. 2002, 37: 291-313. 10.1111/1475-6773.024.CrossRefPubMedPubMedCentral
30.
go back to reference Hibbard JH, Peters E: Supporting informed consumer health care decisions: data presentation approaches that facilitate the use of information in choice. Annual Review of Public Health. 2003, 24: 413-433. 10.1146/annurev.publhealth.24.100901.141005.CrossRefPubMed Hibbard JH, Peters E: Supporting informed consumer health care decisions: data presentation approaches that facilitate the use of information in choice. Annual Review of Public Health. 2003, 24: 413-433. 10.1146/annurev.publhealth.24.100901.141005.CrossRefPubMed
31.
go back to reference Peters E, Dieckman N, Dixon A, Hibbard JH, Mertz CK: Less is more in presenting quality information to consumers. Medical Care Research and Review. 2007, 64 (2): 169-190. 10.1177/10775587070640020301.CrossRefPubMed Peters E, Dieckman N, Dixon A, Hibbard JH, Mertz CK: Less is more in presenting quality information to consumers. Medical Care Research and Review. 2007, 64 (2): 169-190. 10.1177/10775587070640020301.CrossRefPubMed
33.
go back to reference Damman OC, Hendriks M, Rademakers JJDJM, Delnoij DMJ, Groenewegen PP: Presenting comparative information on the quality of health care to consumers. Abstract: ISQUA "Healthcare Quality and Safety: Meeting the Next Challenges" oktober Copenhagen, Denmark. 2008, 19-22. Damman OC, Hendriks M, Rademakers JJDJM, Delnoij DMJ, Groenewegen PP: Presenting comparative information on the quality of health care to consumers. Abstract: ISQUA "Healthcare Quality and Safety: Meeting the Next Challenges" oktober Copenhagen, Denmark. 2008, 19-22.
34.
go back to reference Marshall MN, Shekelle PG, Leatherman S, Brook RH: The public release of performance data: what do we expect to gain? A review of theevidence. JAMA. 2000, 283 (14): 1866-74. 10.1001/jama.283.14.1866.CrossRefPubMed Marshall MN, Shekelle PG, Leatherman S, Brook RH: The public release of performance data: what do we expect to gain? A review of theevidence. JAMA. 2000, 283 (14): 1866-74. 10.1001/jama.283.14.1866.CrossRefPubMed
35.
go back to reference Van Nie NC, Hollands LJM, Hamers JPH: Consumenteninformatie en transparantie van zorg in verpleeg- en verzorgingshuizen in opdracht van de Inspectie voor de Gezondheidszorg. 2007, Maastricht: Universiteitvan Maastricht Van Nie NC, Hollands LJM, Hamers JPH: Consumenteninformatie en transparantie van zorg in verpleeg- en verzorgingshuizen in opdracht van de Inspectie voor de Gezondheidszorg. 2007, Maastricht: Universiteitvan Maastricht
36.
go back to reference Hoeymans N, Gommer AM, Poos MJJC: Wat is de ziektelast in Nederland?. Volksgezondheid Toekomst Verkenning, Nationaal Kompas Volksgezondheid. Bilthoven: RIVM, Gezondheid en ziekte\Sterfte, levensverwachting en DALY's\Ziektelast in DALY's accessed December 7, 2006, [http://www.nationaalkompas.nl] Hoeymans N, Gommer AM, Poos MJJC: Wat is de ziektelast in Nederland?. Volksgezondheid Toekomst Verkenning, Nationaal Kompas Volksgezondheid. Bilthoven: RIVM, Gezondheid en ziekte\Sterfte, levensverwachting en DALY's\Ziektelast in DALY's accessed December 7, 2006, [http://​www.​nationaalkompas.​nl]
37.
go back to reference Trappenburg M: Genoeg is genoeg. 2008, Amsterdam: Amsterdam University PressCrossRef Trappenburg M: Genoeg is genoeg. 2008, Amsterdam: Amsterdam University PressCrossRef
38.
go back to reference Brown J, et al: Patient Reported Outcome Measures (PROMs) in Elective Surgery. Report to the Department of Health. 2007, Health Services Research Unit, London School of Hygiene & Tropical Medicine & Clinical Effectiveness Unit, Royal College of Surgeons of England Brown J, et al: Patient Reported Outcome Measures (PROMs) in Elective Surgery. Report to the Department of Health. 2007, Health Services Research Unit, London School of Hygiene & Tropical Medicine & Clinical Effectiveness Unit, Royal College of Surgeons of England
40.
go back to reference van Oers H, Verkleij H, (eds): Spectrum: De CQ-index, bruikbaar voor aanbieder en verzekeraar [The CQ-index, useful for healthcare-providers and health-insurance companies]. Tijdschrift Sociale Gezondheidszorg. 2008, 86 (8): 426-430. van Oers H, Verkleij H, (eds): Spectrum: De CQ-index, bruikbaar voor aanbieder en verzekeraar [The CQ-index, useful for healthcare-providers and health-insurance companies]. Tijdschrift Sociale Gezondheidszorg. 2008, 86 (8): 426-430.
41.
go back to reference Bensing JM, Caris-Verhallen WM, Dekker J, Delnoij DM, Groenewegen PP: Doing the right thing and doing it right: toward a framework for assessing the policy relevance of health services research. Int J Technol Assess Health Care. 2003, 19 (4): 604-12. 10.1017/S0266462303000564.CrossRefPubMed Bensing JM, Caris-Verhallen WM, Dekker J, Delnoij DM, Groenewegen PP: Doing the right thing and doing it right: toward a framework for assessing the policy relevance of health services research. Int J Technol Assess Health Care. 2003, 19 (4): 604-12. 10.1017/S0266462303000564.CrossRefPubMed
Metadata
Title
The Dutch Consumer Quality Index: an example of stakeholder involvement in indicator development
Authors
Diana MJ Delnoij
Jany JDJM Rademakers
Peter P Groenewegen
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2010
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-10-88

Other articles of this Issue 1/2010

BMC Health Services Research 1/2010 Go to the issue