Skip to main content
Top
Published in: Intensive Care Medicine 8/2012

01-08-2012 | Pediatric Original

International comparison of the performance of the paediatric index of mortality (PIM) 2 score in two national data sets

Authors: Stéphane Leteurtre, Bruno Grandbastien, Francis Leclerc, Roger Parslow, Groupe Francophone de Réanimation et Urgences Pédiatriques, Paediatric Intensive Care Audit Network

Published in: Intensive Care Medicine | Issue 8/2012

Login to get access

Abstract

Objectives

To test the performance of PIM2 in French-speaking (FS) paediatric intensive care units (PICUs) and its relative performance when recalibrated using data from FS and Great Britain (GB) PICUs of different size.

Methods

Consecutive admissions to 15 FS (n = 5,602) and 31 GB PICUs (n = 20,693) from June 2006 to October 2007 were included. The recalibrated PIM2 were applied to PICUs of different size within the FS and GB PICUs and between the two groups. PICU size was defined using number of admissions/month. Discrimination and calibration were evaluated using the area under the ROC curve (AUC) and the goodness-of-fit test, respectively. Logistic regression, funnel plots and standardized W scores were performed in the two groups and between different PICU sizes.

Results

In FS PICUs, the original PIM2 had good discrimination (AUC = 0.85) and moderate calibration (p = 0.07). The recalibrated PIM2 scores had good calibration in FS (p = 0.33) and moderate calibration in GB (p = 0.06). Calibration was poor when the recalibrated FS PIM2 was applied to GB (p = 0.02) but good when the GB recalibration was applied to the FS (p = 0.36). Using the original PIM2 coefficients, calibration was poor in large units in both groups but improved following recalibration. There were no effects of PICU size on risk-adjusted mortality in GB and a significant effect in the FS PICUs with a minimum risk-adjusted mortality at about 35 admissions/month.

Conclusion

The PIM2 score was valid in the FS population. The recalibration based on GB data could be applied to FS PICUs. Such recalibration may facilitate comparisons between countries.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lacroix J, Cotting J (2005) Severity of illness and organ dysfunction scoring in children. Pediatr Crit Care Med 6:S126–S134PubMedCrossRef Lacroix J, Cotting J (2005) Severity of illness and organ dysfunction scoring in children. Pediatr Crit Care Med 6:S126–S134PubMedCrossRef
2.
go back to reference Martinot A, Leteurtre S, Grandbastien B, Duhamel A, Leclerc F (1997) Characteristics of patients and use of resource in French pediatric intensive care units. Arch Pediatr 4:730–736PubMedCrossRef Martinot A, Leteurtre S, Grandbastien B, Duhamel A, Leclerc F (1997) Characteristics of patients and use of resource in French pediatric intensive care units. Arch Pediatr 4:730–736PubMedCrossRef
3.
go back to reference Slater A, Shann F (2004) The suitability of the pediatric index of mortality (PIM), PIM2, the pediatric risk of mortality (PRISM), and PRISM III for monitoring the quality of pediatric intensive care in Australia and New Zealand. Pediatr Crit Care Med 5:447–454PubMedCrossRef Slater A, Shann F (2004) The suitability of the pediatric index of mortality (PIM), PIM2, the pediatric risk of mortality (PRISM), and PRISM III for monitoring the quality of pediatric intensive care in Australia and New Zealand. Pediatr Crit Care Med 5:447–454PubMedCrossRef
4.
go back to reference Wunsch H, Rowan KM, Angus DC (2007) International comparisons in critical care: a necessity and challenge. Curr Opin Crit Care 13:725–731PubMedCrossRef Wunsch H, Rowan KM, Angus DC (2007) International comparisons in critical care: a necessity and challenge. Curr Opin Crit Care 13:725–731PubMedCrossRef
5.
go back to reference LaRovere JM, Jeffries HE, Sachdeva RC, Rice TB, Wetzel RC, Cooper DS, Bird GL, Ghanayem NS, Checchia PA, Chang AC, Wessel DL (2008) Databases for assessing the outcomes of the treatment of patients with congenital and paediatric cardiac disease: the perspective of critical care. Cardiol Young 18(Suppl 2):130–136PubMedCrossRef LaRovere JM, Jeffries HE, Sachdeva RC, Rice TB, Wetzel RC, Cooper DS, Bird GL, Ghanayem NS, Checchia PA, Chang AC, Wessel DL (2008) Databases for assessing the outcomes of the treatment of patients with congenital and paediatric cardiac disease: the perspective of critical care. Cardiol Young 18(Suppl 2):130–136PubMedCrossRef
6.
go back to reference Parslow RC, Tasker RC, Draper ES, Parry GJ, Jones S, Chater T, Thiru K, McKinney PA (2009) Epidemiology of critically ill children in England and Wales: incidence, mortality, deprivation and ethnicity. Arch Dis Child 94:210–215PubMedCrossRef Parslow RC, Tasker RC, Draper ES, Parry GJ, Jones S, Chater T, Thiru K, McKinney PA (2009) Epidemiology of critically ill children in England and Wales: incidence, mortality, deprivation and ethnicity. Arch Dis Child 94:210–215PubMedCrossRef
7.
go back to reference Slater A, Shann F, McEniery J (2003) The ANZPIC registry diagnostic codes: a system for coding reasons for admitting children to intensive care. Intensive Care Med 29:271–277PubMed Slater A, Shann F, McEniery J (2003) The ANZPIC registry diagnostic codes: a system for coding reasons for admitting children to intensive care. Intensive Care Med 29:271–277PubMed
8.
go back to reference Pollack MM, Patel KM, Ruttimann UE (1996) PRISM III: an updated pediatric risk of mortality score. Crit Care Med 24:743–752PubMedCrossRef Pollack MM, Patel KM, Ruttimann UE (1996) PRISM III: an updated pediatric risk of mortality score. Crit Care Med 24:743–752PubMedCrossRef
9.
go back to reference Slater A, Shann F, Pearson G (2003) PIM2: a revised version of the paediatric index of mortality. Intensive Care Med 29:278–285PubMed Slater A, Shann F, Pearson G (2003) PIM2: a revised version of the paediatric index of mortality. Intensive Care Med 29:278–285PubMed
10.
go back to reference Brady AR, Harrison D, Black S, Jones S, Rowan K, Pearson G, Ratcliffe J, Parry GJ (2006) Assessment and optimization of mortality prediction tools for admissions to pediatric intensive care in the United Kingdom. Pediatrics 117:e733–e742PubMedCrossRef Brady AR, Harrison D, Black S, Jones S, Rowan K, Pearson G, Ratcliffe J, Parry GJ (2006) Assessment and optimization of mortality prediction tools for admissions to pediatric intensive care in the United Kingdom. Pediatrics 117:e733–e742PubMedCrossRef
11.
12.
go back to reference Minne L, Eslami S, de Keizer N, de Jonge E, de Rooij SE, Abu-Hanna A (2012) Effect of changes over time in the performance of a customized SAPS-II model on the quality of care assessment. Intensive Care Med 38:40–46PubMedCrossRef Minne L, Eslami S, de Keizer N, de Jonge E, de Rooij SE, Abu-Hanna A (2012) Effect of changes over time in the performance of a customized SAPS-II model on the quality of care assessment. Intensive Care Med 38:40–46PubMedCrossRef
13.
go back to reference Vincent JL, Moreno R (2010) Clinical review: scoring systems in the critically ill. Crit Care 14:207PubMedCrossRef Vincent JL, Moreno R (2010) Clinical review: scoring systems in the critically ill. Crit Care 14:207PubMedCrossRef
14.
go back to reference Wolfler A, Silvani P, Musicco M, Salvo I (2007) Pediatric index of mortality 2 score in Italy: a multicenter, prospective, observational study. Intensive Care Med 33:1407–1413PubMedCrossRef Wolfler A, Silvani P, Musicco M, Salvo I (2007) Pediatric index of mortality 2 score in Italy: a multicenter, prospective, observational study. Intensive Care Med 33:1407–1413PubMedCrossRef
15.
go back to reference Tilford JM, Simpson PM, Green JW, Lensing S, Fiser DH (2000) Volume-outcome relationships in pediatric intensive care units. Pediatrics 106:289–294PubMedCrossRef Tilford JM, Simpson PM, Green JW, Lensing S, Fiser DH (2000) Volume-outcome relationships in pediatric intensive care units. Pediatrics 106:289–294PubMedCrossRef
16.
go back to reference Cogo PE, Poole D, Codazzi D, Boniotti C, Capretta A, Langer M, Luciani D, Rossi C, Bertolini G (2010) Outcome of children admitted to adult intensive care units in Italy between 2003 and 2007. Intensive Care Med 36:1403–1409PubMedCrossRef Cogo PE, Poole D, Codazzi D, Boniotti C, Capretta A, Langer M, Luciani D, Rossi C, Bertolini G (2010) Outcome of children admitted to adult intensive care units in Italy between 2003 and 2007. Intensive Care Med 36:1403–1409PubMedCrossRef
18.
go back to reference Marcin JP, Song J, Leigh JP (2005) The impact of pediatric intensive care unit volume on mortality: a hierarchical instrumental variable analysis. Pediatr Crit Care Med 6:136–141PubMedCrossRef Marcin JP, Song J, Leigh JP (2005) The impact of pediatric intensive care unit volume on mortality: a hierarchical instrumental variable analysis. Pediatr Crit Care Med 6:136–141PubMedCrossRef
19.
go back to reference Pollack MM, Cuerdon TT, Patel KM, Ruttimann UE, Getson PR, Levetown M (1994) Impact of quality-of-care factors on pediatric intensive care unit mortality. JAMA 272:941–946PubMedCrossRef Pollack MM, Cuerdon TT, Patel KM, Ruttimann UE, Getson PR, Levetown M (1994) Impact of quality-of-care factors on pediatric intensive care unit mortality. JAMA 272:941–946PubMedCrossRef
20.
go back to reference Ruttimann UE, Patel KM, Pollack MM (2000) Relevance of diagnostic diversity and patient volumes for quality and length of stay in pediatric intensive care units. Pediatr Crit Care Med 1:133–139PubMedCrossRef Ruttimann UE, Patel KM, Pollack MM (2000) Relevance of diagnostic diversity and patient volumes for quality and length of stay in pediatric intensive care units. Pediatr Crit Care Med 1:133–139PubMedCrossRef
21.
go back to reference Shahian DM, Normand SL (2008) Comparison of “risk-adjusted” hospital outcomes. Circulation 117:1955–1963PubMedCrossRef Shahian DM, Normand SL (2008) Comparison of “risk-adjusted” hospital outcomes. Circulation 117:1955–1963PubMedCrossRef
22.
go back to reference Cevenini G, Barbini P (2010) A bootstrap approach for assessing the uncertainty of outcome probabilities when using a scoring system. BMC Med Inform Decis Mak 10:45PubMedCrossRef Cevenini G, Barbini P (2010) A bootstrap approach for assessing the uncertainty of outcome probabilities when using a scoring system. BMC Med Inform Decis Mak 10:45PubMedCrossRef
23.
go back to reference Lemeshow S, Hosmer DW Jr (1982) A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol 115:92–106PubMed Lemeshow S, Hosmer DW Jr (1982) A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol 115:92–106PubMed
24.
go back to reference Hollis S, Yates DW, Woodford M, Foster P (1995) Standardized comparison of performance indicators in trauma: a new approach to case-mix variation. J Trauma 38:763–766PubMedCrossRef Hollis S, Yates DW, Woodford M, Foster P (1995) Standardized comparison of performance indicators in trauma: a new approach to case-mix variation. J Trauma 38:763–766PubMedCrossRef
25.
go back to reference Glance LG, Osler T, Shinozaki T (2000) Effect of varying the case mix on the standardized mortality ratio and W statistic: a simulation study. Chest 117:1112–1117PubMedCrossRef Glance LG, Osler T, Shinozaki T (2000) Effect of varying the case mix on the standardized mortality ratio and W statistic: a simulation study. Chest 117:1112–1117PubMedCrossRef
27.
go back to reference Eulmesekian PG, Perez A, Minces PG, Ferrero H (2007) Validation of pediatric index of mortality 2 (PIM2) in a single pediatric intensive care unit of Argentina. Pediatr Crit Care Med 8:54–57PubMedCrossRef Eulmesekian PG, Perez A, Minces PG, Ferrero H (2007) Validation of pediatric index of mortality 2 (PIM2) in a single pediatric intensive care unit of Argentina. Pediatr Crit Care Med 8:54–57PubMedCrossRef
28.
go back to reference Imamura T, Nakagawa S, Goldman RD, Fujiwara T (2012) Validation of pediatric index of mortality 2 (PIM2) in a single pediatric intensive care unit in Japan. Intensive Care Med 38:649–654 Imamura T, Nakagawa S, Goldman RD, Fujiwara T (2012) Validation of pediatric index of mortality 2 (PIM2) in a single pediatric intensive care unit in Japan. Intensive Care Med 38:649–654
29.
go back to reference Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, Gottesman R, Joffe A, Pfenninger J, Hubert P, Lacroix J, Leclerc F (2003) Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet 362:192–197PubMedCrossRef Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, Gottesman R, Joffe A, Pfenninger J, Hubert P, Lacroix J, Leclerc F (2003) Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet 362:192–197PubMedCrossRef
30.
go back to reference Metnitz B, Schaden E, Moreno R, Le Gall JR, Bauer P, Metnitz PG (2009) Austrian validation and customization of the SAPS 3 admission score. Intensive Care Med 35:616–622PubMedCrossRef Metnitz B, Schaden E, Moreno R, Le Gall JR, Bauer P, Metnitz PG (2009) Austrian validation and customization of the SAPS 3 admission score. Intensive Care Med 35:616–622PubMedCrossRef
31.
go back to reference Bakhshi-Raiez F, Peek N, Bosman RJ, de Jonge E, de Keizer NF (2007) The impact of different prognostic models and their customization on institutional comparison of intensive care units. Crit Care Med 35:2553–2560PubMedCrossRef Bakhshi-Raiez F, Peek N, Bosman RJ, de Jonge E, de Keizer NF (2007) The impact of different prognostic models and their customization on institutional comparison of intensive care units. Crit Care Med 35:2553–2560PubMedCrossRef
32.
go back to reference Gregory CJ, Nasrollahzadeh F, Dharmar M, Parsapour K, Marcin JP (2008) Comparison of critically ill and injured children transferred from referring hospitals versus in-house admissions. Pediatrics 121:e906–e911PubMedCrossRef Gregory CJ, Nasrollahzadeh F, Dharmar M, Parsapour K, Marcin JP (2008) Comparison of critically ill and injured children transferred from referring hospitals versus in-house admissions. Pediatrics 121:e906–e911PubMedCrossRef
34.
go back to reference Straney LD, Clements A, Alexander J, Slater A (2010) Measuring efficiency in Australian and New Zealand paediatric intensive care units. Intensive Care Med 36:1410–1416PubMedCrossRef Straney LD, Clements A, Alexander J, Slater A (2010) Measuring efficiency in Australian and New Zealand paediatric intensive care units. Intensive Care Med 36:1410–1416PubMedCrossRef
36.
go back to reference Beyene J, Atenafu EG, Hamid JS, To T, Sung L (2009) Determining relative importance of variables in developing and validating predictive models. BMC Med Res Methodol 9:64PubMedCrossRef Beyene J, Atenafu EG, Hamid JS, To T, Sung L (2009) Determining relative importance of variables in developing and validating predictive models. BMC Med Res Methodol 9:64PubMedCrossRef
37.
go back to reference Murphy-Filkins R, Teres D, Lemeshow S, Hosmer DW (1996) Effect of changing patient mix on the performance of an intensive care unit severity-of-illness model: how to distinguish a general from a specialty intensive care unit. Crit Care Med 24:1968–1973PubMedCrossRef Murphy-Filkins R, Teres D, Lemeshow S, Hosmer DW (1996) Effect of changing patient mix on the performance of an intensive care unit severity-of-illness model: how to distinguish a general from a specialty intensive care unit. Crit Care Med 24:1968–1973PubMedCrossRef
38.
go back to reference Metnitz B, Metnitz PG, Bauer P, Valentin A (2009) Patient volume affects outcome in critically ill patients. Wien Klin Wochenschr 121:34–40PubMedCrossRef Metnitz B, Metnitz PG, Bauer P, Valentin A (2009) Patient volume affects outcome in critically ill patients. Wien Klin Wochenschr 121:34–40PubMedCrossRef
39.
41.
go back to reference Spiegelhalter D (2002) Funnel plots for institutional comparison. Qual Saf Health Care 11:390–391PubMedCrossRef Spiegelhalter D (2002) Funnel plots for institutional comparison. Qual Saf Health Care 11:390–391PubMedCrossRef
Metadata
Title
International comparison of the performance of the paediatric index of mortality (PIM) 2 score in two national data sets
Authors
Stéphane Leteurtre
Bruno Grandbastien
Francis Leclerc
Roger Parslow
Groupe Francophone de Réanimation et Urgences Pédiatriques
Paediatric Intensive Care Audit Network
Publication date
01-08-2012
Publisher
Springer-Verlag
Published in
Intensive Care Medicine / Issue 8/2012
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-012-2580-6

Other articles of this Issue 8/2012

Intensive Care Medicine 8/2012 Go to the issue