Skip to main content
Top
Published in: BMC Pediatrics 1/2020

Open Access 01-12-2020 | Care | Research article

First-step validation of a text message-based application for newborn clinical management among pediatricians

Authors: Santorino Data, Martin Mukama, Douglas McMillan, Nalini Singhal, Francis Bajunirwe

Published in: BMC Pediatrics | Issue 1/2020

Login to get access

Abstract

Background

Neonatal mortality is high in developing countries. Lack of adequate training and insufficient management skills for sick newborn care contribute to these deaths. We developed a phone application dubbed Protecting Infants Remotely by Short Message Service (PRISMS). The PRISMS application uses routine clinical assessments with algorithms to provide newborn clinical management suggestions. We measured the feasibility, acceptability and efficacy of PRISMS by comparing its clinical case management suggestions with those of experienced pediatricians as the gold standard.

Methods

Twelve different newborn case scenarios developed by pediatrics residents, based on real cases they had seen, were managed by pediatricians and PRISMS®. Each pediatrician was randomly assigned six of twelve cases. Pediatricians developed clinical case management plans for all assigned cases and then obtained PRISMS suggested clinical case managements. We calculated percent agreement and kappa (k) statistics to test the null hypothesis that pediatrician and PRISMS management plans were independent.

Results

We found high level of agreement between pediatricians and PRISMS for components of newborn care including: 10% dextrose (Agreement = 73.8%), normal saline (Agreement = 73.8%), anticonvulsants (Agreement = 100%), blood transfusion (Agreement =81%), phototherapy (Agreement = 90.5%), and supplemental oxygen (agreement = 69.1%). However, we found poor agreement with potential investigations such as complete blood count, blood culture and lumbar puncture. PRISMS had a user satisfaction score of 3.8 out of 5 (range 1 = strongly disagree, 5 = strongly agree) and an average PRISMS user experience score of 4.1 out of 5 (range 1 = very bad, 5 = very good).

Conclusion

Management plans for newborn care from PRISMS showed good agreement with management plans from experienced Pediatricians. We acknowledge that the level of agreement was low in some aspects of newborn care.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wall SN, Lee ACC, Carlo W, Goldenberg R, Niermeyer S, Darmstadt GL, et al. Reducing intrapartum-related neonatal deaths in low- and middle-income countries-what works? Semin Perinatol. 2010;34:395–407.CrossRef Wall SN, Lee ACC, Carlo W, Goldenberg R, Niermeyer S, Darmstadt GL, et al. Reducing intrapartum-related neonatal deaths in low- and middle-income countries-what works? Semin Perinatol. 2010;34:395–407.CrossRef
2.
go back to reference Afnan-Holmes H, Magoma M, John T, Levira F, Msemo G, Armstrong CE, et al. Tanzania’s countdown to 2015: an analysis of two decades of progress and gaps for reproductive, maternal, newborn, and child health, to inform priorities for post-2015. Lancet Glob Heal. 2015;3(7):e396–409.CrossRef Afnan-Holmes H, Magoma M, John T, Levira F, Msemo G, Armstrong CE, et al. Tanzania’s countdown to 2015: an analysis of two decades of progress and gaps for reproductive, maternal, newborn, and child health, to inform priorities for post-2015. Lancet Glob Heal. 2015;3(7):e396–409.CrossRef
6.
go back to reference Darmstadt GL, Ahmed ASMNU, Saha SK, Chowdhury MAKA, Alam MA, Khatun M, et al. Infection control practices reduce nosocomial infection and mortality in preterm infants in Bangladesh. J Perinatol. 2005;25(5):331–5.CrossRef Darmstadt GL, Ahmed ASMNU, Saha SK, Chowdhury MAKA, Alam MA, Khatun M, et al. Infection control practices reduce nosocomial infection and mortality in preterm infants in Bangladesh. J Perinatol. 2005;25(5):331–5.CrossRef
7.
go back to reference Cruz AT, Perry AM, Williams EA, Graf JM, Wuestner ER, Patel B. Implementation of goal-directed therapy for children with suspected sepsis in the emergency department. Pediatrics. 2011;127(3):e758–66. Cruz AT, Perry AM, Williams EA, Graf JM, Wuestner ER, Patel B. Implementation of goal-directed therapy for children with suspected sepsis in the emergency department. Pediatrics. 2011;127(3):e758–66.
8.
go back to reference Jimenez MM, Bui AL, Mantilla E, Miranda JJ. Human resources for health in Peru: recent trends (2007-2013) in the labour market for physicians, nurses and midwives. Hum Resour Health. 2017;15(1):69. Jimenez MM, Bui AL, Mantilla E, Miranda JJ. Human resources for health in Peru: recent trends (2007-2013) in the labour market for physicians, nurses and midwives. Hum Resour Health. 2017;15(1):69.
9.
go back to reference Arifeen SE, Bryce J, Gouws E, Baqui AH, Black RE, Hoque DME, et al. Quality of care for under-fives in first-level health facilities in one district of Bangladesh. Bull World Health Organ. 2005;83(4):260–7.PubMedPubMedCentral Arifeen SE, Bryce J, Gouws E, Baqui AH, Black RE, Hoque DME, et al. Quality of care for under-fives in first-level health facilities in one district of Bangladesh. Bull World Health Organ. 2005;83(4):260–7.PubMedPubMedCentral
10.
go back to reference Huynh M, Spasojevic J, Li W, Maduro G, Van Wye G, Waterman PD, et al. Spatial social polarization and birth outcomes: preterm birth and infant mortality – new York City, 2010–14. Scand J Public Health. 2018;46(1):157–66.CrossRef Huynh M, Spasojevic J, Li W, Maduro G, Van Wye G, Waterman PD, et al. Spatial social polarization and birth outcomes: preterm birth and infant mortality – new York City, 2010–14. Scand J Public Health. 2018;46(1):157–66.CrossRef
11.
go back to reference Assefa T, Haile Mariam D, Mekonnen W, Derbew M, Enbiale W. Physician distribution and attrition in the public health sector of Ethiopia. Risk Manag Healthc Policy. 2016;9:285–95.CrossRef Assefa T, Haile Mariam D, Mekonnen W, Derbew M, Enbiale W. Physician distribution and attrition in the public health sector of Ethiopia. Risk Manag Healthc Policy. 2016;9:285–95.CrossRef
12.
go back to reference Anyangwe SCE, Mtonga C. Inequities in the global health workforce: the greatest impediment to health in sub-Saharan Africa. Int J Environ Res Public Health. 2007;4:93–100.CrossRef Anyangwe SCE, Mtonga C. Inequities in the global health workforce: the greatest impediment to health in sub-Saharan Africa. Int J Environ Res Public Health. 2007;4:93–100.CrossRef
13.
go back to reference Khriesat W, Kassab M, Hamadneh S, Mohammad K, Hamadneh J, Khader YS. Infant resuscitation practices of midwives in a developing country. Adv Neonatal Care. 2017;17(5):400–6.CrossRef Khriesat W, Kassab M, Hamadneh S, Mohammad K, Hamadneh J, Khader YS. Infant resuscitation practices of midwives in a developing country. Adv Neonatal Care. 2017;17(5):400–6.CrossRef
14.
go back to reference De Graft-Johnson J, Vesel L, Rosen HE, Rawlins B, Abwao S, Mazia G, et al. Cross-sectional observational assessment of quality of newborn care immediately after birth in health facilities across six sub-Saharan African countries. BMJ Open. 2017;7(3):e014680. De Graft-Johnson J, Vesel L, Rosen HE, Rawlins B, Abwao S, Mazia G, et al. Cross-sectional observational assessment of quality of newborn care immediately after birth in health facilities across six sub-Saharan African countries. BMJ Open. 2017;7(3):e014680.
15.
go back to reference Donohue L, Hoffman K, Marcin J. Use of telemedicine to improve neonatal resuscitation. Children. 2019;6(4):50.CrossRef Donohue L, Hoffman K, Marcin J. Use of telemedicine to improve neonatal resuscitation. Children. 2019;6(4):50.CrossRef
16.
go back to reference Sable CA, Cummings SD, Pearson GD, Schratz LM, Cross RC, Quivers ES, et al. Impact of telemedicine on the practice of pediatric cardiology in community hospitals. Pediatrics. 2002;109(1):e3. Sable CA, Cummings SD, Pearson GD, Schratz LM, Cross RC, Quivers ES, et al. Impact of telemedicine on the practice of pediatric cardiology in community hospitals. Pediatrics. 2002;109(1):e3.
17.
go back to reference Jo Y, Labrique AB, Lefevre AE, Mehl G, Pfaff T, Walker N, et al. Using the lives saved tool (LiST) to model mHealth impact on neonatal survival in resource-limited settings. PLoS One. 2014;9(8):e106980. Jo Y, Labrique AB, Lefevre AE, Mehl G, Pfaff T, Walker N, et al. Using the lives saved tool (LiST) to model mHealth impact on neonatal survival in resource-limited settings. PLoS One. 2014;9(8):e106980.
18.
go back to reference Carmichael SL, Mehta K, Srikantiah S, Mahapatra T, Chaudhuri I, Balakrishnan R, et al. Use of mobile technology by frontline health workers to promote reproductive, maternal, newborn and child health and nutrition: a cluster randomized controlled trial in Bihar, India. J Glob Health. 2019;9(2):0204249. Carmichael SL, Mehta K, Srikantiah S, Mahapatra T, Chaudhuri I, Balakrishnan R, et al. Use of mobile technology by frontline health workers to promote reproductive, maternal, newborn and child health and nutrition: a cluster randomized controlled trial in Bihar, India. J Glob Health. 2019;9(2):0204249.
19.
go back to reference Modi D, Dholakia N, Gopalan R, Venkatraman S, Dave K, Shah S, et al. MHealth intervention “ImTeCHO” to improve delivery of maternal, neonatal, and child care services-a cluster-randomized trial in tribal areas of Gujarat, India. PLoS Med. 2019;16(10):e1002939. Modi D, Dholakia N, Gopalan R, Venkatraman S, Dave K, Shah S, et al. MHealth intervention “ImTeCHO” to improve delivery of maternal, neonatal, and child care services-a cluster-randomized trial in tribal areas of Gujarat, India. PLoS Med. 2019;16(10):e1002939.
20.
go back to reference Sondaal SFV, Browne JL, Amoakoh-Coleman M, Borgstein A, Miltenburg AS, Verwijs M, et al. Assessing the effect of mHealth interventions in improving maternal and neonatal Care in low- and Middle-Income Countries: a systematic review. PLoS One. 2016;11:e0154664.CrossRef Sondaal SFV, Browne JL, Amoakoh-Coleman M, Borgstein A, Miltenburg AS, Verwijs M, et al. Assessing the effect of mHealth interventions in improving maternal and neonatal Care in low- and Middle-Income Countries: a systematic review. PLoS One. 2016;11:e0154664.CrossRef
21.
go back to reference Merali HS, Chan NHM, Mistry N, Kealey R, Campbell D, Morris SK, et al. Designing and evaluating a novel mobile application for helping babies breathe skills retention in Uganda: comparative study protocol. BMJ Paediatr Open. 2019;3(1):1.CrossRef Merali HS, Chan NHM, Mistry N, Kealey R, Campbell D, Morris SK, et al. Designing and evaluating a novel mobile application for helping babies breathe skills retention in Uganda: comparative study protocol. BMJ Paediatr Open. 2019;3(1):1.CrossRef
22.
go back to reference Siedner MJ, Santorino D, Lankowski AJ, Kanyesigye M, Bwana MB, Haberer JE, et al. A combination SMS and transportation reimbursement intervention to improve HIV care following abnormal CD4 test results in rural Uganda: a prospective observational cohort study. BMC Med. 2015;13(1):160. Siedner MJ, Santorino D, Lankowski AJ, Kanyesigye M, Bwana MB, Haberer JE, et al. A combination SMS and transportation reimbursement intervention to improve HIV care following abnormal CD4 test results in rural Uganda: a prospective observational cohort study. BMC Med. 2015;13(1):160.
23.
go back to reference Siedner MJ, Santorino D, Haberer JE, Bangsberg DR. Know your audience: predictors of success for a patient-centered texting app to augment linkage to HIV care in rural Uganda. J Med Internet Res. 2015;17(3):e78. Siedner MJ, Santorino D, Haberer JE, Bangsberg DR. Know your audience: predictors of success for a patient-centered texting app to augment linkage to HIV care in rural Uganda. J Med Internet Res. 2015;17(3):e78.
24.
go back to reference Lund S, Rasch V, Hemed M, Boas IM, Said A, Said K, et al. Mobile phone intervention reduces perinatal mortality in zanzibar: secondary outcomes of a cluster randomized controlled trial. J Med Internet Res. 2014;2(1):e15. Lund S, Rasch V, Hemed M, Boas IM, Said A, Said K, et al. Mobile phone intervention reduces perinatal mortality in zanzibar: secondary outcomes of a cluster randomized controlled trial. J Med Internet Res. 2014;2(1):e15.
25.
go back to reference Lund S, Hemed M, Nielsen BB, Said A, Said K, Makungu MH, et al. Mobile phones as a health communication tool to improve skilled attendance at delivery in Zanzibar: a cluster-randomised controlled trial. BJOG An Int J Obstet Gynaecol. 2012;119(10):1256–64.CrossRef Lund S, Hemed M, Nielsen BB, Said A, Said K, Makungu MH, et al. Mobile phones as a health communication tool to improve skilled attendance at delivery in Zanzibar: a cluster-randomised controlled trial. BJOG An Int J Obstet Gynaecol. 2012;119(10):1256–64.CrossRef
26.
go back to reference Gräßer F, Beckert S, Küster D, Schmitt J, Abraham S, Malberg H, et al. Therapy decision support based on recommender system methods. J Healthc Eng. 2017;3:1–11. Gräßer F, Beckert S, Küster D, Schmitt J, Abraham S, Malberg H, et al. Therapy decision support based on recommender system methods. J Healthc Eng. 2017;3:1–11.
28.
go back to reference Zurovac D, Otieno G, Kigen S, Mbithi AM, Muturi A, Snow RW, et al. Ownership and use of mobile phones among health workers, caregivers of sick children and adult patients in Kenya: cross-sectional national survey. Glob Health. 2013;9:20.CrossRef Zurovac D, Otieno G, Kigen S, Mbithi AM, Muturi A, Snow RW, et al. Ownership and use of mobile phones among health workers, caregivers of sick children and adult patients in Kenya: cross-sectional national survey. Glob Health. 2013;9:20.CrossRef
29.
go back to reference Chang LW, Mwanika A, Kaye D, Muhwezi WW, Nabirye RC, Mbalinda S, et al. Information and communication technology and community-based health sciences training in Uganda: perceptions and experiences of educators and students. Informatics Heal Soc Care. 2012;37(1):1–11.CrossRef Chang LW, Mwanika A, Kaye D, Muhwezi WW, Nabirye RC, Mbalinda S, et al. Information and communication technology and community-based health sciences training in Uganda: perceptions and experiences of educators and students. Informatics Heal Soc Care. 2012;37(1):1–11.CrossRef
30.
go back to reference Singhal N, Lockyer J, Fidler H, Aziz K, McMillan D, Qiu X, et al. Acute Care of at-Risk Newborns (ACoRN): quantitative and qualitative educational evaluation of the program in a region of China. BMC Med Educ. 2012;12(1):44. Singhal N, Lockyer J, Fidler H, Aziz K, McMillan D, Qiu X, et al. Acute Care of at-Risk Newborns (ACoRN): quantitative and qualitative educational evaluation of the program in a region of China. BMC Med Educ. 2012;12(1):44.
31.
go back to reference WHO recommendations on newborn health: guidelines approved by the WHO Guidelines Review Committee. Geneva: World Health Organization; 2017 (WHO/MCA/17.07):3–18. WHO recommendations on newborn health: guidelines approved by the WHO Guidelines Review Committee. Geneva: World Health Organization; 2017 (WHO/MCA/17.07):3–18.
32.
go back to reference Landis JR, Koch GG. Landis amd Koch1977_agreement of categorical data. Biometrics. 1977;33(1):159–74.CrossRef Landis JR, Koch GG. Landis amd Koch1977_agreement of categorical data. Biometrics. 1977;33(1):159–74.CrossRef
33.
go back to reference Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed
34.
go back to reference McHugh ML. Interrater reliability: the kappa statistic. Biochem Medica. 2012;22(3):276–82.CrossRef McHugh ML. Interrater reliability: the kappa statistic. Biochem Medica. 2012;22(3):276–82.CrossRef
36.
go back to reference Zhao F, Squires N, Weakliam D, Van Lerberghe W, Soucat A, Toure K, et al. Investing in human resources for health: the need for a paradigm shift. Geneva: Vol. 91, bulletin of the World Health Organization; 2013. Zhao F, Squires N, Weakliam D, Van Lerberghe W, Soucat A, Toure K, et al. Investing in human resources for health: the need for a paradigm shift. Geneva: Vol. 91, bulletin of the World Health Organization; 2013.
37.
go back to reference Young Infants Clinical Signs Study Group. Clinical signs that predict severe illness in children under age 2 months: a multicentre study. Lancet. 2008;371(9607):135–42.CrossRef Young Infants Clinical Signs Study Group. Clinical signs that predict severe illness in children under age 2 months: a multicentre study. Lancet. 2008;371(9607):135–42.CrossRef
38.
go back to reference Hmone MP, Li M, Alam A, Dibley MJ. Mobile phone short messages to improve breastfeeding feeding practices: a study protocol for a randomized controlled trial in Yangon, Myanmar. JMIR Res Protoc. 2017;6(6):e126.CrossRef Hmone MP, Li M, Alam A, Dibley MJ. Mobile phone short messages to improve breastfeeding feeding practices: a study protocol for a randomized controlled trial in Yangon, Myanmar. JMIR Res Protoc. 2017;6(6):e126.CrossRef
39.
go back to reference Shao AF, Rambaud-Althaus C, Samaka J, Faustine AF, Perri-Moore S, Swai N, et al. New algorithm for managing childhood illness using mobile technology (ALMANACH): a controlled non-inferiority study on clinical outcome and antibiotic use in Tanzania. PLoS One. 2015;10(7):e0132316. Shao AF, Rambaud-Althaus C, Samaka J, Faustine AF, Perri-Moore S, Swai N, et al. New algorithm for managing childhood illness using mobile technology (ALMANACH): a controlled non-inferiority study on clinical outcome and antibiotic use in Tanzania. PLoS One. 2015;10(7):e0132316.
40.
go back to reference Mitchell M, Getchell M, Nkaka M, Msellemu D, Van Esch J, Hedt-Gauthier B. Perceived improvement in integrated management of childhood illness implementation through use of mobile technology: qualitative evidence from a pilot study in Tanzania. J Health Commun. 2012;17:118–27.CrossRef Mitchell M, Getchell M, Nkaka M, Msellemu D, Van Esch J, Hedt-Gauthier B. Perceived improvement in integrated management of childhood illness implementation through use of mobile technology: qualitative evidence from a pilot study in Tanzania. J Health Commun. 2012;17:118–27.CrossRef
41.
go back to reference Blanchet K, Lewis JJ, Pozo-Martin F, Satouro A, Somda S, Ilboudo P, et al. A mixed methods protocol to evaluate the effect and cost-effectiveness of an integrated electronic diagnosis approach (IeDA) for the management of childhood illnesses at primary health facilities in Burkina Faso. Implement Sci. 2016;11(1):111. Blanchet K, Lewis JJ, Pozo-Martin F, Satouro A, Somda S, Ilboudo P, et al. A mixed methods protocol to evaluate the effect and cost-effectiveness of an integrated electronic diagnosis approach (IeDA) for the management of childhood illnesses at primary health facilities in Burkina Faso. Implement Sci. 2016;11(1):111.
42.
go back to reference Kabakyenga J, Barigye C, Brenner J, Maling S, Buchner D, Nettle-Aquirre A, et al. A demonstration of mobile phone deployment to support the treatment of acutely ill children under five in Bushenyi district, Uganda. Afr Health Sci. 2016;16(1):89–96.CrossRef Kabakyenga J, Barigye C, Brenner J, Maling S, Buchner D, Nettle-Aquirre A, et al. A demonstration of mobile phone deployment to support the treatment of acutely ill children under five in Bushenyi district, Uganda. Afr Health Sci. 2016;16(1):89–96.CrossRef
Metadata
Title
First-step validation of a text message-based application for newborn clinical management among pediatricians
Authors
Santorino Data
Martin Mukama
Douglas McMillan
Nalini Singhal
Francis Bajunirwe
Publication date
01-12-2020
Publisher
BioMed Central
Keyword
Care
Published in
BMC Pediatrics / Issue 1/2020
Electronic ISSN: 1471-2431
DOI
https://doi.org/10.1186/s12887-020-02307-2

Other articles of this Issue 1/2020

BMC Pediatrics 1/2020 Go to the issue