Skip to main content
Top
Published in: BMC Pediatrics 1/2010

Open Access 01-12-2010 | Research article

Development of paediatric quality of inpatient care indicators for low-income countries - A Delphi study

Authors: Stephen Ntoburi, Andrew Hutchings, Colin Sanderson, James Carpenter, Martin Weber, Mike English, the Paediatric Quality of Hospital Care Indicator Panel*

Published in: BMC Pediatrics | Issue 1/2010

Login to get access

Abstract

Background

Indicators of quality of care for children in hospitals in low-income countries have been proposed, but information on their perceived validity and acceptability is lacking.

Methods

Potential indicators representing structural and process aspects of care for six common conditions were selected from existing, largely qualitative WHO assessment tools and guidelines. We employed the Delphi technique, which combines expert opinion and existing scientific information, to assess their perceived validity and acceptability. Panels of experts, one representing an international panel and one a national (Kenyan) panel, were asked to rate the indicators over 3 rounds and 2 rounds respectively according to a variety of attributes.

Results

Based on a pre-specified consensus criteria most of the indicators presented to the experts were accepted: 112/137(82%) and 94/133(71%) for the international and local panels respectively. For the other indicators there was no consensus; none were rejected. Most indicators were rated highly on link to outcomes, reliability, relevance, actionability and priority but rated more poorly on feasibility of data collection under routine conditions. There was moderate to substantial agreement between the two panels of experts.

Conclusions

This Delphi study provided evidence for the perceived usefulness of most of a set of measures of quality of hospital care for children proposed for use in low-income countries. However, both international and local experts expressed concerns that data for many process-based indicators may not currently be available. The feasibility of widespread quality assessment and responsiveness of indicators to intervention should be examined as part of continued efforts to improve approaches to informative hospital quality assessment.
Appendix
Available only for authorised users
Literature
2.
go back to reference Duke T, Wandi F, Jonathan M, Matai S, Kaupa M, Saavu M, Subhi R, Peel D: Improved oxygen systems for childhood pneumonia: a multihospital effectiveness study in Papua New Guinea. Lancet. 2008, 372 (9646): 1328-1333. 10.1016/S0140-6736(08)61164-2.CrossRefPubMed Duke T, Wandi F, Jonathan M, Matai S, Kaupa M, Saavu M, Subhi R, Peel D: Improved oxygen systems for childhood pneumonia: a multihospital effectiveness study in Papua New Guinea. Lancet. 2008, 372 (9646): 1328-1333. 10.1016/S0140-6736(08)61164-2.CrossRefPubMed
3.
go back to reference Nolan TAP, Cunha AJ, Muhe L, Qazi S, Simoes EA, Tamburlini G, Weber M, Pierce NF: Quality of hospital care for seriously ill children in less-developed countries. The Lancet. 2000, 357: 106-110. 10.1016/S0140-6736(00)03542-X.CrossRef Nolan TAP, Cunha AJ, Muhe L, Qazi S, Simoes EA, Tamburlini G, Weber M, Pierce NF: Quality of hospital care for seriously ill children in less-developed countries. The Lancet. 2000, 357: 106-110. 10.1016/S0140-6736(00)03542-X.CrossRef
4.
go back to reference Zurovac D, Rowe AK: Quality of treatment for febrile illness among children at outpatient facilities in sub-Saharan Africa. Ann Trop Med Parasitol. 2006, 100 (4): 283-296. 10.1179/136485906X105633.CrossRefPubMed Zurovac D, Rowe AK: Quality of treatment for febrile illness among children at outpatient facilities in sub-Saharan Africa. Ann Trop Med Parasitol. 2006, 100 (4): 283-296. 10.1179/136485906X105633.CrossRefPubMed
5.
go back to reference English M, Esamai F, Wasunna A, Were F, Ogutu B, Wamae A, Snow RW, Peshu N: Delivery of paediatric care at the first-referral level in Kenya. Lancet. 2004, 364 (9445): 1622-1629. 10.1016/S0140-6736(04)17318-2.CrossRefPubMed English M, Esamai F, Wasunna A, Were F, Ogutu B, Wamae A, Snow RW, Peshu N: Delivery of paediatric care at the first-referral level in Kenya. Lancet. 2004, 364 (9445): 1622-1629. 10.1016/S0140-6736(04)17318-2.CrossRefPubMed
6.
go back to reference English M, Esamai F, Wasunna A, Were F, Ogutu B, Wamae A, Snow RW, Peshu N: Assessment of inpatient paediatric care in first referral level hospitals in 13 districts in Kenya. Lancet. 2004, 363 (9425): 1948-1953. 10.1016/S0140-6736(04)16408-8.CrossRefPubMed English M, Esamai F, Wasunna A, Were F, Ogutu B, Wamae A, Snow RW, Peshu N: Assessment of inpatient paediatric care in first referral level hospitals in 13 districts in Kenya. Lancet. 2004, 363 (9425): 1948-1953. 10.1016/S0140-6736(04)16408-8.CrossRefPubMed
7.
go back to reference English M, Ntoburi S, Wagai J, Mbindyo P, Opiyo N, Ayieko P, Opondo C, Migiro S, Wamae A, Irimu G: An intervention to improve paediatric and newborn care in Kenyan district hospitals: Understanding the context. Implement Sci. 2009, 4: 42-10.1186/1748-5908-4-42.CrossRefPubMedPubMedCentral English M, Ntoburi S, Wagai J, Mbindyo P, Opiyo N, Ayieko P, Opondo C, Migiro S, Wamae A, Irimu G: An intervention to improve paediatric and newborn care in Kenyan district hospitals: Understanding the context. Implement Sci. 2009, 4: 42-10.1186/1748-5908-4-42.CrossRefPubMedPubMedCentral
8.
go back to reference Reyburn H, Mwakasungula E, Chonya S, Mtei F, Bygbjerg I, Poulsen A, Olomi R: Clinical assessment and treatment in paediatric wards in the north-east of the United Republic of Tanzania. Bull World Health Organ. 2008, 86 (2): 132-139. 10.2471/BLT.07.041723.CrossRefPubMedPubMedCentral Reyburn H, Mwakasungula E, Chonya S, Mtei F, Bygbjerg I, Poulsen A, Olomi R: Clinical assessment and treatment in paediatric wards in the north-east of the United Republic of Tanzania. Bull World Health Organ. 2008, 86 (2): 132-139. 10.2471/BLT.07.041723.CrossRefPubMedPubMedCentral
9.
go back to reference Massoud R, Askov K, Reinke J, Franco L, Bornstein T, Knebel E, MacAulay C: A Modern Paradigm for Improving Healthcare Quality. 2001, Bethesda: Quality Assurance Project Massoud R, Askov K, Reinke J, Franco L, Bornstein T, Knebel E, MacAulay C: A Modern Paradigm for Improving Healthcare Quality. 2001, Bethesda: Quality Assurance Project
10.
go back to reference Mainz J: Quality indicators: essential for quality improvement. Int J Qual Health Care. 2004, 16 (suppl 1): i1-2. 10.1093/intqhc/mzh036.CrossRef Mainz J: Quality indicators: essential for quality improvement. Int J Qual Health Care. 2004, 16 (suppl 1): i1-2. 10.1093/intqhc/mzh036.CrossRef
11.
go back to reference Marshall M, Klazinga N, Leatherman S, Hardy C, Bergmann E, Pisco L, Mattke S, Mainz J: OECD Health Care Quality Indicator Project. The expert panel on primary care prevention and health promotion. Int J Qual Health Care. 2006, 18 (Suppl 1): 21-25. 10.1093/intqhc/mzl021.CrossRefPubMed Marshall M, Klazinga N, Leatherman S, Hardy C, Bergmann E, Pisco L, Mattke S, Mainz J: OECD Health Care Quality Indicator Project. The expert panel on primary care prevention and health promotion. Int J Qual Health Care. 2006, 18 (Suppl 1): 21-25. 10.1093/intqhc/mzl021.CrossRefPubMed
12.
go back to reference McGlynn EA, Asch SM: Developing a clinical performance measure. Am J Prev Med. 1998, 14 (3 Suppl): 14-21. 10.1016/S0749-3797(97)00032-9.CrossRefPubMed McGlynn EA, Asch SM: Developing a clinical performance measure. Am J Prev Med. 1998, 14 (3 Suppl): 14-21. 10.1016/S0749-3797(97)00032-9.CrossRefPubMed
13.
go back to reference Rowe A, de Savigny D, Lanata C, Victora C: How can we achieve and maintain high-quality performance of health workers in low-resource settings?. Lancet. 2005, 366: 1026-1035. 10.1016/S0140-6736(05)67028-6.CrossRefPubMed Rowe A, de Savigny D, Lanata C, Victora C: How can we achieve and maintain high-quality performance of health workers in low-resource settings?. Lancet. 2005, 366: 1026-1035. 10.1016/S0140-6736(05)67028-6.CrossRefPubMed
14.
go back to reference Campbell H, Duke T, Weber M, English M, Carai S, Tamburlini G: Global initiatives for improving hospital care for children: state of the art and future prospects. Pediatrics. 2008, 121 (4): e984-992. 10.1542/peds.2007-1395.CrossRefPubMedPubMedCentral Campbell H, Duke T, Weber M, English M, Carai S, Tamburlini G: Global initiatives for improving hospital care for children: state of the art and future prospects. Pediatrics. 2008, 121 (4): e984-992. 10.1542/peds.2007-1395.CrossRefPubMedPubMedCentral
15.
go back to reference Donabedian D: The quality care: How can it be assessed?. JAMA. 1988, 260 (12): 1743-1748. 10.1001/jama.260.12.1743.CrossRefPubMed Donabedian D: The quality care: How can it be assessed?. JAMA. 1988, 260 (12): 1743-1748. 10.1001/jama.260.12.1743.CrossRefPubMed
16.
go back to reference Mant J: Process versus outcome indicators in the assessment of quality of health care. International Journal for Quality in Health Care. 2001, 13: 475-480. 10.1093/intqhc/13.6.475.CrossRefPubMed Mant J: Process versus outcome indicators in the assessment of quality of health care. International Journal for Quality in Health Care. 2001, 13: 475-480. 10.1093/intqhc/13.6.475.CrossRefPubMed
17.
go back to reference Reerink IH, Sauerborn R: Quality of primary health care in developing countries: recent experiences and future directions. Int J Qual Health Care. 1996, 8 (2): 131-139. 10.1093/intqhc/8.2.131.CrossRefPubMed Reerink IH, Sauerborn R: Quality of primary health care in developing countries: recent experiences and future directions. Int J Qual Health Care. 1996, 8 (2): 131-139. 10.1093/intqhc/8.2.131.CrossRefPubMed
18.
go back to reference Gilson L, Magomi M, Mkangaa E: The structural quality of Tanzanian primary health facilities. Bull World Health Organ. 1995, 73 (1): 105-114.PubMedPubMedCentral Gilson L, Magomi M, Mkangaa E: The structural quality of Tanzanian primary health facilities. Bull World Health Organ. 1995, 73 (1): 105-114.PubMedPubMedCentral
19.
go back to reference Campbell SM, Braspenning J, Hutchinson A, Marshall M: Research methods used in developing and applying quality indicators in primary care. Qual Saf Health Care. 2002, 11 (4): 358-364. 10.1136/qhc.11.4.358.CrossRefPubMedPubMedCentral Campbell SM, Braspenning J, Hutchinson A, Marshall M: Research methods used in developing and applying quality indicators in primary care. Qual Saf Health Care. 2002, 11 (4): 358-364. 10.1136/qhc.11.4.358.CrossRefPubMedPubMedCentral
20.
go back to reference Hutchings A, Raine R: A systematic review of factors affecting the judgments produced by formal consensus development methods in health care. J Health Serv Res Policy. 2006, 11 (3): 172-179. 10.1258/135581906777641659.CrossRefPubMed Hutchings A, Raine R: A systematic review of factors affecting the judgments produced by formal consensus development methods in health care. J Health Serv Res Policy. 2006, 11 (3): 172-179. 10.1258/135581906777641659.CrossRefPubMed
21.
go back to reference Fretheim A, Schunemann HJ, Oxman AD: Improving the use of research evidence in guideline development: 3. Group composition and consultation process. Health Res Policy Syst. 2006, 4: 15-10.1186/1478-4505-4-15.CrossRefPubMedPubMedCentral Fretheim A, Schunemann HJ, Oxman AD: Improving the use of research evidence in guideline development: 3. Group composition and consultation process. Health Res Policy Syst. 2006, 4: 15-10.1186/1478-4505-4-15.CrossRefPubMedPubMedCentral
22.
go back to reference Black R, Morris S, Bryce J: Where and why are 10 million children dying every year?. The Lancet. 2003, 361: 2226-2234. 10.1016/S0140-6736(03)13779-8.CrossRef Black R, Morris S, Bryce J: Where and why are 10 million children dying every year?. The Lancet. 2003, 361: 2226-2234. 10.1016/S0140-6736(03)13779-8.CrossRef
23.
go back to reference Demographic and Health Survey - Preliminary Report. 2009, Nairobi: National Council for Population and Development, Central Bureau of Statistics & Ministry of Planning and National Development, Republic of Kenya Demographic and Health Survey - Preliminary Report. 2009, Nairobi: National Council for Population and Development, Central Bureau of Statistics & Ministry of Planning and National Development, Republic of Kenya
24.
go back to reference English M, Esamai F, Wasunna A, Were F, Ogutu B, Wamae A, Snow R, Peshu N: Delivery of paediatric care at the first-referral level in Kenya. The Lancet. 2004, 364: 1622-1629. 10.1016/S0140-6736(04)17318-2.CrossRef English M, Esamai F, Wasunna A, Were F, Ogutu B, Wamae A, Snow R, Peshu N: Delivery of paediatric care at the first-referral level in Kenya. The Lancet. 2004, 364: 1622-1629. 10.1016/S0140-6736(04)17318-2.CrossRef
25.
go back to reference Reyburn H, Mbatia R, Drakeley C, Carneiro I, Mwakasungula E, Mwerinde O, Saganda K, Shao J, Kitua A, Olomi R, et al: Overdiagnosis of malaria in patients with severe febrile illness in Tanzania: a prospective study. BMJ. 2004, 329 (7476): 1212.-10.1136/bmj.38251.658229.55.CrossRefPubMedPubMedCentral Reyburn H, Mbatia R, Drakeley C, Carneiro I, Mwakasungula E, Mwerinde O, Saganda K, Shao J, Kitua A, Olomi R, et al: Overdiagnosis of malaria in patients with severe febrile illness in Tanzania: a prospective study. BMJ. 2004, 329 (7476): 1212.-10.1136/bmj.38251.658229.55.CrossRefPubMedPubMedCentral
26.
go back to reference Chandler CI, Mwangi R, Mbakilwa H, Olomi R, Whitty CJ, Reyburn H: Malaria overdiagnosis: is patient pressure the problem?. Health Policy Plan. 2008, 23 (3): 170-178. 10.1093/heapol/czm046.CrossRefPubMed Chandler CI, Mwangi R, Mbakilwa H, Olomi R, Whitty CJ, Reyburn H: Malaria overdiagnosis: is patient pressure the problem?. Health Policy Plan. 2008, 23 (3): 170-178. 10.1093/heapol/czm046.CrossRefPubMed
27.
go back to reference Chandler CI, Nadjm B, Boniface G, Juma K, Reyburn H, Whitty CJ: Assessment of children for acute respiratory infections in hospital outpatients in Tanzania: what drives good practice?. Am J Trop Med Hyg. 2008, 79 (6): 925-932.PubMed Chandler CI, Nadjm B, Boniface G, Juma K, Reyburn H, Whitty CJ: Assessment of children for acute respiratory infections in hospital outpatients in Tanzania: what drives good practice?. Am J Trop Med Hyg. 2008, 79 (6): 925-932.PubMed
28.
go back to reference World Health Organization: Hospital care for children: Guidelines for the management of common illnesses with limited resources. 2006, Geneva: WHO World Health Organization: Hospital care for children: Guidelines for the management of common illnesses with limited resources. 2006, Geneva: WHO
29.
go back to reference Irimu G, Wamae A, Wasunna A, Were F, Ntoburi S, Opiyo N, Ayieko P, Peshu N, English M: Developing and introducing evidence based clinical practice guidelines for serious illness in Kenya. Arch Dis Child. 2008, 93 (9): 799-804. 10.1136/adc.2007.126508.CrossRefPubMedPubMedCentral Irimu G, Wamae A, Wasunna A, Were F, Ntoburi S, Opiyo N, Ayieko P, Peshu N, English M: Developing and introducing evidence based clinical practice guidelines for serious illness in Kenya. Arch Dis Child. 2008, 93 (9): 799-804. 10.1136/adc.2007.126508.CrossRefPubMedPubMedCentral
30.
go back to reference Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, Marteau T: Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998, 2 (3): i-iv. 1-88PubMed Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, Marteau T: Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998, 2 (3): i-iv. 1-88PubMed
31.
go back to reference Raine R, Sanderson C, Hutchings A, Carter S, Larkin K, Black N: An experimental study of determinants of group judgments in clinical guideline development. Lancet. 2004, 364 (9432): 429-437. 10.1016/S0140-6736(04)16766-4.CrossRefPubMed Raine R, Sanderson C, Hutchings A, Carter S, Larkin K, Black N: An experimental study of determinants of group judgments in clinical guideline development. Lancet. 2004, 364 (9432): 429-437. 10.1016/S0140-6736(04)16766-4.CrossRefPubMed
32.
go back to reference Brewster DR: Critical appraisal of the management of severe malnutrition: 1. Epidemiology and treatment guidelines. J Paediatr Child Health. 2006, 42 (10): 568-574. 10.1111/j.1440-1754.2006.00931.x.CrossRefPubMed Brewster DR: Critical appraisal of the management of severe malnutrition: 1. Epidemiology and treatment guidelines. J Paediatr Child Health. 2006, 42 (10): 568-574. 10.1111/j.1440-1754.2006.00931.x.CrossRefPubMed
33.
go back to reference Cantrill JA, Sibbald B, Buetow S: Indicators of the appropriateness of long-term prescribing in general practice in the United Kingdom: consensus development, face and content validity, feasibility, and reliability. Qual Health Care. 1998, 7 (3): 130-135. 10.1136/qshc.7.3.130.CrossRefPubMedPubMedCentral Cantrill JA, Sibbald B, Buetow S: Indicators of the appropriateness of long-term prescribing in general practice in the United Kingdom: consensus development, face and content validity, feasibility, and reliability. Qual Health Care. 1998, 7 (3): 130-135. 10.1136/qshc.7.3.130.CrossRefPubMedPubMedCentral
34.
go back to reference Reichenheim ME: Confidence intervals for the kappa statistic. Stata Journal. 2004, 4 (4): 421-428. Reichenheim ME: Confidence intervals for the kappa statistic. Stata Journal. 2004, 4 (4): 421-428.
35.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed
36.
go back to reference Keeney S, Hasson F, McKenna H: Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs. 2006, 53 (2): 205-212. 10.1111/j.1365-2648.2006.03716.x.CrossRefPubMed Keeney S, Hasson F, McKenna H: Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs. 2006, 53 (2): 205-212. 10.1111/j.1365-2648.2006.03716.x.CrossRefPubMed
37.
go back to reference AbouZahr C, Adjei S, Kanchanachitra C: From data to policy: good practices and cautionary tales. Lancet. 2007, 369 (9566): 1039-1046. 10.1016/S0140-6736(07)60463-2.CrossRefPubMed AbouZahr C, Adjei S, Kanchanachitra C: From data to policy: good practices and cautionary tales. Lancet. 2007, 369 (9566): 1039-1046. 10.1016/S0140-6736(07)60463-2.CrossRefPubMed
38.
go back to reference Okiro E, Hay S, Gikandi P, Sharif S, Noor A, Peshu N, Marsh K, Snow R: The decline in paediatric malaria admissions on the coast of Kenya. Malar J. 2007, 15 (6): 151-10.1186/1475-2875-6-151.CrossRef Okiro E, Hay S, Gikandi P, Sharif S, Noor A, Peshu N, Marsh K, Snow R: The decline in paediatric malaria admissions on the coast of Kenya. Malar J. 2007, 15 (6): 151-10.1186/1475-2875-6-151.CrossRef
39.
go back to reference Gething PW, Noor AM, Goodman CA, Gikandi PW, Hay SI, Sharif SK, Atkinson PM, Snow RW: Information for decision making from imperfect national data: tracking major changes in health care use in Kenya using geostatistics. BMC Med. 2007, 5: 37-10.1186/1741-7015-5-37.CrossRefPubMedPubMedCentral Gething PW, Noor AM, Goodman CA, Gikandi PW, Hay SI, Sharif SK, Atkinson PM, Snow RW: Information for decision making from imperfect national data: tracking major changes in health care use in Kenya using geostatistics. BMC Med. 2007, 5: 37-10.1186/1741-7015-5-37.CrossRefPubMedPubMedCentral
40.
go back to reference Schouten JA, Hulscher ME, Wollersheim H, Braspennning J, Kullberg BJ, van der Meer JW, Grol RP: Quality of antibiotic use for lower respiratory tract infections at hospitals: (how) can we measure it?. Clin Infect Dis. 2005, 41 (4): 450-460. 10.1086/431983.CrossRefPubMed Schouten JA, Hulscher ME, Wollersheim H, Braspennning J, Kullberg BJ, van der Meer JW, Grol RP: Quality of antibiotic use for lower respiratory tract infections at hospitals: (how) can we measure it?. Clin Infect Dis. 2005, 41 (4): 450-460. 10.1086/431983.CrossRefPubMed
41.
go back to reference Rowe AK, Lama M, Onikpo F, Deming MS: Health worker perceptions of how being observed influences their practices during consultations with ill children. Trop Doct. 2002, 32 (3): 166-167.PubMed Rowe AK, Lama M, Onikpo F, Deming MS: Health worker perceptions of how being observed influences their practices during consultations with ill children. Trop Doct. 2002, 32 (3): 166-167.PubMed
42.
go back to reference Solon O, Woo K, Quimbo SA, Shimkhada R, Florentino J, Peabody JW: A novel method for measuring health care system performance: experience from QIDS in the Philippines. Health Policy Plan. 2009, 24 (3): 167-174. 10.1093/heapol/czp003.CrossRefPubMedPubMedCentral Solon O, Woo K, Quimbo SA, Shimkhada R, Florentino J, Peabody JW: A novel method for measuring health care system performance: experience from QIDS in the Philippines. Health Policy Plan. 2009, 24 (3): 167-174. 10.1093/heapol/czp003.CrossRefPubMedPubMedCentral
43.
go back to reference Powell C: The Delphi technique: myths and realities. J Adv Nurs. 2003, 41 (4): 376-382. 10.1046/j.1365-2648.2003.02537.x.CrossRefPubMed Powell C: The Delphi technique: myths and realities. J Adv Nurs. 2003, 41 (4): 376-382. 10.1046/j.1365-2648.2003.02537.x.CrossRefPubMed
Metadata
Title
Development of paediatric quality of inpatient care indicators for low-income countries - A Delphi study
Authors
Stephen Ntoburi
Andrew Hutchings
Colin Sanderson
James Carpenter
Martin Weber
Mike English
the Paediatric Quality of Hospital Care Indicator Panel*
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Pediatrics / Issue 1/2010
Electronic ISSN: 1471-2431
DOI
https://doi.org/10.1186/1471-2431-10-90

Other articles of this Issue 1/2010

BMC Pediatrics 1/2010 Go to the issue