Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

Validity of a questionnaire measuring the world health organization concept of health system responsiveness with respect to perinatal services in the dutch obstetric care system

Authors: Jacoba van der Kooy, Nicole B Valentine, Erwin Birnie, Marijana Vujkovic, Johanna P de Graaf, Semiha Denktaş, Eric AP Steegers, Gouke J Bonsel

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

The concept of responsiveness, introduced by the World Health Organization (WHO), addresses non-clinical aspects of health service quality that are relevant regardless of provider, country, health system or health condition. Responsiveness refers to “aspects related to the way individuals are treated and the environment in which they are treated” during health system interactions. This paper assesses the psychometric properties of a newly developed responsiveness questionnaire dedicated to evaluating maternal experiences of perinatal care services, called the Responsiveness in Perinatal and Obstetric Health Care Questionnaire (ReproQ), using the eight-domain WHO concept.

Methods

The ReproQ was developed between October 2009 and February 2010 by adapting the WHO Responsiveness Questionnaire items to the perinatal care context. The psychometric properties of feasibility, construct validity, and discriminative validity were empirically assessed in a sample of Dutch women two weeks post partum.

Results

A total of 171 women consented to participation. Feasibility: the interviews lasted between 20 and 40 minutes and the overall missing rate was 8%. Construct validity: mean Cronbach’s alphas for the antenatal, birth and postpartum phase were: 0.73 (range 0.57-0.82), 0.84 (range 0.66-0.92), and 0.87 (range 0.62-0.95) respectively. The item-own scale correlations within all phases were considerably higher than most of the item-other scale correlations. Within the antenatal care, birth care and post partum phases, the eight factors explained 69%, 69%, and 76% of variance respectively. Discriminative validity: overall responsiveness mean sum scores were higher for women whose children were not admitted. This confirmed the hypothesis that dissatisfaction with health outcomes is transferred to their judgement on responsiveness of the perinatal services.

Conclusions

The ReproQ interview-based questionnaire demonstrated satisfactory psychometric properties to describe the quality of perinatal care in the Netherlands, with the potential to discriminate between different levels of quality of care. In view of the relatively small sample, further testing and research is recommended.
Appendix
Available only for authorised users
Literature
1.
Ravelli AC, Tromp M, van Huis M, Steegers EA, Tamminga P, Eskes M, Bonsel GJ: Decreasing perinatal mortality in The Netherlands, 2000–2006: a record linkage study. J Epidemiol Community Health. 2009, 63 (9): 761-765. 10.1136/jech.2008.080440.CrossRefPubMed
2.
Campbell SM, Roland MO, Buetow SA: Defining quality of care. Soc Sci Med. 2000, 51 (11): 1611-1625. 10.1016/S0277-9536(00)00057-5.CrossRefPubMed
3.
Sitzia J, Wood N: Patient satisfaction: a review of issues and concepts. Soc Sci Med. 1997, 45 (12): 1829-1843. 10.1016/S0277-9536(97)00128-7.CrossRefPubMed
4.
Wensing M, Jung HP, Mainz J, Olesen F, Grol R: A systematic review of the literature on patient priorities for general practice care. Part 1: description of the research domain. Soc Sci Med. 1998, 47 (10): 1573-1588. 10.1016/S0277-9536(98)00222-6.CrossRefPubMed
5.
McPake B: User charges for health services in developing countries: a review of the economic literature. Soc Sci Med. 1993, 36 (11): 1397-1405. 10.1016/0277-9536(93)90382-E.CrossRefPubMed
6.
Ware JE, Snyder MK, Wright WR, Davies AR: Defining and measuring patient satisfaction with medical care. Evaluation and Program Planning. 1983, 6: 247-293. 10.1016/0149-7189(83)90005-8.CrossRefPubMed
7.
Wouters A: Essential national health research in developing countries: heath care financing and the quality of care. Int J Health Manag. 1991, 6: 253-271.
8.
Gilson L, Alilio M, Heggenhougen K: Community satisfaction with primary health care services: an evaluation undertaken in the Morogoro region of Tanzania. Soc Sci Med. 1994, 39 (6): 767-780. 10.1016/0277-9536(94)90038-8.CrossRefPubMed
9.
10.
Greener I: Towards a history of choice in UK health policy. Sociol Health Illn. 2009, 31 (3): 309-324. 10.1111/j.1467-9566.2008.01135.x.CrossRefPubMed
11.
Christiaens W, Gouwy A, Bracke P: Does a referral from home to hospital affect satisfaction with childbirth? A cross-national comparison. BMC Health Serv Res. 2007, 7: 109-10.1186/1472-6963-7-109.CrossRefPubMedPubMedCentral
12.
Wiegers TA: The quality of maternity care services as experienced by women in the Netherlands. BMC Pregn Childbirth. 2009, 9: 18-10.1186/1471-2393-9-18.CrossRef
13.
Wiegers TA, van der Zee J, Keirse MJ: Transfer from home to hospital: what is its effect on the experience of childbirth?. Birth. 1998, 25 (1): 19-24. 10.1046/j.1523-536x.1998.00019.x.CrossRefPubMed
14.
Valentine NB, de Silva A, Kawabata K, Darby C, Murray CJL, Evans DB: Health System Responsiveness: Concepts, Domains and Measurement. 2003, World Health Organisation, Geneva
15.
de Silva A: A framework for measuring responsiveness. Global Programme on Evidence for Health Policy Discussion Paper. No. 32. 2000, World Health Organisation, Geneva
16.
Gostin L: The Domains of Health Responsiveness: a Human Rights Assessment. 2002, World Health Organisation, Geneva
17.
Blendon RJ, Kim M, Benson JM: The public versus the world health organization on health system performance. Health Aff (Millwood). 2001, 20 (3): 10-20. 10.1377/hlthaff.20.3.10.CrossRef
18.
Hall JA, Irish JT, Roter DL, Ehrlich CM, Miller LH: Satisfaction, gender, and communication in medical visits. Med Care. 1994, 32 (12): 1216-1231. 10.1097/00005650-199412000-00005.CrossRefPubMed
19.
Murphy-Cullen CL, Larsen LC: Interaction between the socio-demographic variables of physicians and their patients: its impact upon patient satisfaction. Soc Sci Med. 1984, 19 (2): 163-166. 10.1016/0277-9536(84)90283-1.CrossRefPubMed
20.
Murray CJ, Kawabata K, Valentine N: People's experience versus people's expectations. Health Aff (Millwood). 2001, 20 (3): 21-24. 10.1377/hlthaff.20.3.21.CrossRef
21.
Valentine NB, Bonsel GJ, Murray CJ: Measuring quality of health care from the user's perspective in 41 countries: psychometric properties of WHO's questions on health systems responsiveness. Qual Life Res. 2007, 16 (7): 1107-1125. 10.1007/s11136-007-9189-1.CrossRefPubMed
22.
THE STEIN GROUP: An update on the community tracking study: a focus on the changing health system. Issue Brief Cent Stud Health Syst Change 1999, (18):1–4..
23.
Cleary PD, Edgman-Levitan S, Walker JD, Gerteis M, Delbanco TL: Using patient reports to improve medical care: a preliminary report from 10 hospitals. Qual Manag Health Care. 1993, 2 (1): 31-38. 10.1097/00019514-199302010-00007.CrossRefPubMed
24.
Sixma HJ, van Campen C, Kerssens JJ, Peters L: Quality of care from the perspective of elderly people: the QUOTE-elderly instrument. Age Ageing. 2000, 29 (2): 173-178. 10.1093/ageing/29.2.173.CrossRefPubMed
25.
Hargraves JL, Hays RD, Cleary PD: Psychometric properties of the consumer assessment of health plans study (CAHPS) 2.0 adult core survey. Health Serv Res. 2003, 38 (6 Pt 1): 1509-1527. 10.1111/j.1475-6773.2003.00190.x.CrossRefPubMed
26.
Nunnally JCB, Bernstein IH: Psychometric Theory. 1994, McGraw-Hill, New York, 3
27.
Gandek B, Ware JE, Aaronson NK, Alonso J, Apolone G, Bjorner J, Brazier J, Bullinger M, Fukuhara S, Kaasa S, Leplège A, Sullivan M: Tests of data quality, scaling assumptions, and reliability of the SF-36 in eleven countries: results from the IQOLA project. International Quality of Life Assessment. J Clin Epidemiol. 1998, 51 (11): 1149-1158. 10.1016/S0895-4356(98)00106-1.CrossRefPubMed
28.
Valentine NB, de Silva A, Kawabata K, Darby C, Murray CJL, Evans DB: Health System Performance Assessment: Debates, Methods and Empiricism. 2003, World Health Organisation, Geneva
29.
Frechtling J, Sharp L: User friendly Handbook for mixed evaluations. In NSF Program Officer Conrad Katzenmeyer; 1997.
30.
Smith LF: Development of a multidimensional labour satisfaction questionnaire: dimensions, validity, and internal reliability. Qual Health Care. 2001, 10 (1): 17-22. 10.1136/qhc.10.1.17.CrossRefPubMedPubMedCentral
31.
Smith LF: Postnatal care: development of a psychometric multidimensional satisfaction questionnaire (the WOMBPNSQ) to assess women's views. Br J Gen Pract. 2011, 61 (591): e628-e637. 10.3399/bjgp11X601334.CrossRefPubMedPubMedCentral
32.
33.
Jenkinson C, Coulter A, Bruster S: The picker patient experience questionnaire: development and validation using data from in-patient surveys in five countries. Int J Qual Health Care. 2002, 14 (5): 353-358. 10.1093/intqhc/14.5.353.CrossRefPubMed
34.
Biemer PP, Lyberg LE: Introduction to Survey Quality. 2003, John Wiley, New YorkCrossRef
35.
36.
Couper M: Web surveys: a review of issues and approaches. Public Opin Q. 2000, 64 (4): 464-494. 10.1086/318641.CrossRefPubMed
37.
Dillman DA: Mail and Internet surveys: The Tailored Design Method. 2000, John Wiley, New York
38.
De Leeuw ED: To mix or not to mix data collection modes in surveys. J Off Stat. 2005, 21 (2): 233-255.
39.
40.
Vujkovic M, Birnie E, Bonsel GJ: Maternal postnatal care utilisation in Rotterdam 2008–2009. The Rotterdam Public Health Authority Report (GGD Rotterdam Rijnmond) (in press). 2011.
41.
42.
Peterson WE, Charles C, DiCenso A, Sword W: The Newcastle satisfaction with nursing scales: a valid measure of maternal satisfaction with inpatient postpartum nursing care. J Adv Nurs. 2005, 52 (6): 672-681. 10.1111/j.1365-2648.2005.03634.x.CrossRefPubMed
43.
Truijens SE, Pommer AM, van Runnard Heimel PJ, Verhoeven CJ, Oei SG, Pop VJ: Development of the Pregnancy and Childbirth Questionnaire (PCQ): evaluating quality of care as perceived by women who recently gave birth. Eur J Obstet Gynecol Reprod Biol. 2014, 174: 35-40. 10.1016/j.ejogrb.2013.11.019.CrossRefPubMed
Metadata
Title
Validity of a questionnaire measuring the world health organization concept of health system responsiveness with respect to perinatal services in the dutch obstetric care system
Authors
Jacoba van der Kooy
Nicole B Valentine
Erwin Birnie
Marijana Vujkovic
Johanna P de Graaf
Semiha Denktaş
Eric AP Steegers
Gouke J Bonsel
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-014-0622-1

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue

Research article

Effect of health insurance type on health care utilization in patients with hypertension: a national health insurance database study in Korea

Research article

“Home is where the patient is”: a qualitative analysis of a patient-centred model of care for multi-drug resistant tuberculosis

Research article

A systematic review of barriers to and facilitators of the use of evidence by policymakers

Research article

The characteristics and relevant factors of Pap smear test use for women with intellectual disabilities in Taiwan

Research article

Clinical mentorship to improve pediatric quality of care at the health centers in rural Rwanda: a qualitative study of perceptions and acceptability of health care workers

Research article

A qualitative study of contextual factors’ impact on measures to reduce surgery cancellations