Skip to main content
Top
Published in: BMC Pediatrics 2/2023

Open Access 01-11-2023 | Research

Avoid equipment graveyards: rigorous process to improve identification and procurement of effective, affordable, and usable newborn devices in low-resource hospital settings

Authors: Elizabeth Asma, Megan Heenan, George Banda, Rebecca P. Kirby, Lucky Mangwiro, Claudia Ziegler Acemyan, Kara M. Palamountain, Philip Kortum, Kondwani Kawaza, Z. Maria Oden, Rebecca Richards-Kortum, Technical Collaborative Authorship Group

Published in: BMC Pediatrics | Special Issue 2/2023

Login to get access

Abstract

Background

Millions of newborns die annually from preventable causes, with the highest rates occurring in Africa. Reducing neonatal mortality requires investment to scale hospital care, which includes providing hospitals with appropriate technology to care for small and sick newborns. Expensive medical devices designed for high-resource settings often fail to withstand conditions in low-resource hospitals, including humidity, dust, frequent user turnover, complex maintenance, lack of stable power, or difficulty sourcing expensive consumables. Rigorous evaluation protocols are needed to identify effective, affordable, rugged, and easy-to-use medical devices appropriate for quality hospital-based newborn care in low-resource hospitals.

Methods

We developed an evidence-based technology review process to identify medical devices suitable for small and sick newborn care in low-resource hospitals. The eight-step process consists of: identifying devices needed for effective newborn care; defining Target Product Profiles (TPPs); identifying commercially-available products that may meet TPPs; conducting desk research to evaluate technologies against TPPs; performing technical performance verification testing under laboratory conditions; verifying technical performance after exposure to heat, humidity, dust, and power loss; performing usability evaluations with nurses, and qualifying devices that pass all steps. Devices were purchased, installed, and monitored in newborn wards across Kenya, Malawi, Nigeria, and Tanzania.

Results

Of 271 devices considered, only 45 (16.6%) met corresponding TPPs based on desk research. Thirty-nine were purchased and evaluated in the laboratory; five (12.8%) failed to meet TPPs. Thirty-four products passing laboratory evaluation underwent short-term environmental testing; only one (2.9%) device failed. Thirty-seven products underwent usability testing with 127 clinicians; surprisingly, 14 (37.8%) failed to meet TPPs. Twenty-three products passed all evaluations, and 2457 devices were installed across 65 newborn wards in Kenya, Malawi, Nigeria, and Tanzania. Continuous device monitoring reported minimal device failures, with failed devices typically returned to service within two days, resulting in an average uptime (service days divided by days installed) of 99%.

Conclusion

An evidence-based device selection process can improve procurement of effective, affordable, rugged, usable newborn care devices for low-resource hospitals, and feedback to manufacturers can improve device quality. Similar processes could be adapted beyond newborn care to identify medical devices suitable for implementation in any low-resource setting.
Appendix
Available only for authorised users
Literature
1.
go back to reference UN Interagency Group for Child Mortality Estimation (UN IGME). Levels and trends in child mortality: Report 2022. New York: 2023. UN Interagency Group for Child Mortality Estimation (UN IGME). Levels and trends in child mortality: Report 2022. New York: 2023.
3.
go back to reference United Nations. Transforming Our World: The 2030 agenda for sustainable development. New York: United Nations; 2015. United Nations. Transforming Our World: The 2030 agenda for sustainable development. New York: United Nations; 2015.
4.
go back to reference Lawn JE, World Health Organization (WHO). Survive and thrive: transforming care for every small and sick newborn. Chapter 2. Geneva: WHO; 2018. Lawn JE, World Health Organization (WHO). Survive and thrive: transforming care for every small and sick newborn. Chapter 2. Geneva: WHO; 2018.
5.
go back to reference Kinney MV, Cocoman O, Dickson KE, et al. Implementation of the every newborn action plan: progress and lessons learned. Semin Perinatol. 2015;39(5):326–37.CrossRefPubMed Kinney MV, Cocoman O, Dickson KE, et al. Implementation of the every newborn action plan: progress and lessons learned. Semin Perinatol. 2015;39(5):326–37.CrossRefPubMed
7.
go back to reference Bhutta ZA, Das JK, Bahl R, et al. Can available interventions end preventable deaths in mothers, newborn babies, and stillbirths, and at what cost? Lancet. 2014;384(9940):347–70.CrossRefPubMed Bhutta ZA, Das JK, Bahl R, et al. Can available interventions end preventable deaths in mothers, newborn babies, and stillbirths, and at what cost? Lancet. 2014;384(9940):347–70.CrossRefPubMed
10.
go back to reference World Health Organization (WHO). Standards for improving quality of maternal and newborn care in health facilities. Geneva: WHO; 2016. World Health Organization (WHO). Standards for improving quality of maternal and newborn care in health facilities. Geneva: WHO; 2016.
11.
go back to reference March of Dimes, PMNHC, Save the children, WHO. Born Too Soon: the Global action report on preterm birth. Eds CP Howson, MV Kinney, JE Lawn. Geneva: World Health Organization; 2012. March of Dimes, PMNHC, Save the children, WHO. Born Too Soon: the Global action report on preterm birth. Eds CP Howson, MV Kinney, JE Lawn. Geneva: World Health Organization; 2012.
12.
go back to reference UNICEF, World Health Organization (WHO). Ending preventable newborn deaths and stillbirths by 2030. Geneva: World Health Organization; 2020. UNICEF, World Health Organization (WHO). Ending preventable newborn deaths and stillbirths by 2030. Geneva: World Health Organization; 2020.
13.
go back to reference World Health Organization (WHO). Every newborn: an action plan to end preventable deaths. Geneva: WHO; 2014. World Health Organization (WHO). Every newborn: an action plan to end preventable deaths. Geneva: WHO; 2014.
14.
go back to reference Di Pietro L, Piaggio D, Oronti I, et al. A framework for assessing healthcare facilities in low-resource settings: field studies in Benin and Uganda. J Med Biol Eng. 2020;40:526–34.CrossRef Di Pietro L, Piaggio D, Oronti I, et al. A framework for assessing healthcare facilities in low-resource settings: field studies in Benin and Uganda. J Med Biol Eng. 2020;40:526–34.CrossRef
15.
go back to reference Piaggio D, Medenou D, Houessouvo RC, Pecchia L. Donation of medical devices in low-income countries: preliminary results from field studies. In: CMBEBIH 2019: Proceedings of the International Conference on Medical and Biological Engineering, 16 -- 18 May 2019. Banja Luka: Springer International Publishing; 2020. p. 423–7.CrossRef Piaggio D, Medenou D, Houessouvo RC, Pecchia L. Donation of medical devices in low-income countries: preliminary results from field studies. In: CMBEBIH 2019: Proceedings of the International Conference on Medical and Biological Engineering, 16 -- 18 May 2019. Banja Luka: Springer International Publishing; 2020. p. 423–7.CrossRef
16.
go back to reference Perry L, Malkin R. Effectiveness of medical equipment donations to improve health systems: how much medical equipment is broken in the developing world? Med Biol Eng Comput. 2011;49(7):719–22.CrossRefPubMed Perry L, Malkin R. Effectiveness of medical equipment donations to improve health systems: how much medical equipment is broken in the developing world? Med Biol Eng Comput. 2011;49(7):719–22.CrossRefPubMed
17.
go back to reference Velazquez-Berumen A, Manimaran M. Driving innovation in low resource settings. World Hosp Health Serv. 2016;52(3):7–11. Velazquez-Berumen A, Manimaran M. Driving innovation in low resource settings. World Hosp Health Serv. 2016;52(3):7–11.
18.
go back to reference Howitt P, Darzi A, Yang GZ, et al. Technologies for global health. Lancet. 2012;380(9840):507–35.CrossRefPubMed Howitt P, Darzi A, Yang GZ, et al. Technologies for global health. Lancet. 2012;380(9840):507–35.CrossRefPubMed
19.
go back to reference Kirby R, Molyneux E, Dube Q, McWhorter C, Bradley B, Gartley M, et al. BMC Paediatrics. Target product profiles for neonatal care devices: systematic development and results with NEST360 and UNICEF. BMC Pediatr. 2023. Kirby R, Molyneux E, Dube Q, McWhorter C, Bradley B, Gartley M, et al. BMC Paediatrics. Target product profiles for neonatal care devices: systematic development and results with NEST360 and UNICEF. BMC Pediatr. 2023.
20.
go back to reference Niemeier D, Gombachika H, Richards-Kortum R. How to transform the practice of engineering to meet global health needs. Science. 2014;345(6202):1287–90.CrossRefPubMed Niemeier D, Gombachika H, Richards-Kortum R. How to transform the practice of engineering to meet global health needs. Science. 2014;345(6202):1287–90.CrossRefPubMed
21.
go back to reference Ayah R, Ong’ech J, Mbugua EM, Kosgei RC, Waller K, Gathara D. Responding to maternal, neonatal and child health equipment needs in Kenya: a model for an innovation ecosystem leveraging on collaborations and partnerships. BMJ Innov. 2020;6(3):85–91.CrossRefPubMedPubMedCentral Ayah R, Ong’ech J, Mbugua EM, Kosgei RC, Waller K, Gathara D. Responding to maternal, neonatal and child health equipment needs in Kenya: a model for an innovation ecosystem leveraging on collaborations and partnerships. BMJ Innov. 2020;6(3):85–91.CrossRefPubMedPubMedCentral
22.
go back to reference Sinha SR, Barry M. Health technologies and innovation in the global health arena. N Engl J Med. 2011;365(9):779–82.CrossRefPubMed Sinha SR, Barry M. Health technologies and innovation in the global health arena. N Engl J Med. 2011;365(9):779–82.CrossRefPubMed
23.
go back to reference Ploss B, Douglas TS, Glucksberg M, et al. Part II: U.S.-Sub-Saharan Africa educational partnerships for medical device design. Ann Biomed Eng. 2017;45(11):2489–93.CrossRefPubMed Ploss B, Douglas TS, Glucksberg M, et al. Part II: U.S.-Sub-Saharan Africa educational partnerships for medical device design. Ann Biomed Eng. 2017;45(11):2489–93.CrossRefPubMed
24.
go back to reference Malkin R, von Oldenburg BK. Diffusion of novel healthcare technologies to resource poor settings. Ann Biomed Eng. 2013;41(9):1841–50.CrossRefPubMed Malkin R, von Oldenburg BK. Diffusion of novel healthcare technologies to resource poor settings. Ann Biomed Eng. 2013;41(9):1841–50.CrossRefPubMed
25.
go back to reference World Health Organization (WHO). Human resource strategies to improve newborn care in health facilities in low-and middle-income Countries. Geneva: WHO; 2020. World Health Organization (WHO). Human resource strategies to improve newborn care in health facilities in low-and middle-income Countries. Geneva: WHO; 2020.
26.
go back to reference World Health Organization (WHO). Standards for improving the quality of care for small and sick newborns in health facilities. Geneva: WHO; 2020. World Health Organization (WHO). Standards for improving the quality of care for small and sick newborns in health facilities. Geneva: WHO; 2020.
28.
go back to reference Kirby R, Palamountain K. Target product profiles for newborn care in low-resource settings (v1.2). Copenhagen; UNICEF; 2020. Kirby R, Palamountain K. Target product profiles for newborn care in low-resource settings (v1.2). Copenhagen; UNICEF; 2020.
29.
go back to reference Kirby R, Molyneux E, Langton J, Werdenberg J, Palamountain K. Newborn technology landscape: technologies for newborn care in low-resource settings: 7th Edition technical report. NEST360. 2022. Kirby R, Molyneux E, Langton J, Werdenberg J, Palamountain K. Newborn technology landscape: technologies for newborn care in low-resource settings: 7th Edition technical report. NEST360. 2022.
30.
go back to reference World Health Organization (WHO). WHO compendium of innovative health technologies for low-resource settings 2022. Geneva: WHO; 2022. World Health Organization (WHO). WHO compendium of innovative health technologies for low-resource settings 2022. Geneva: WHO; 2022.
31.
go back to reference Shanklin R, Kortum P, Acemyan CZ. Adaptation of heuristic evaluations for the physical environment. Proc Hum Factors Ergon Soc Annu Meet. 2020;64(1):1135–9.CrossRef Shanklin R, Kortum P, Acemyan CZ. Adaptation of heuristic evaluations for the physical environment. Proc Hum Factors Ergon Soc Annu Meet. 2020;64(1):1135–9.CrossRef
32.
go back to reference Johnston J, Asma E, Ziegler Acemyan C, Oden M, Richards-Kortum R, Kortum P. Development and use of heuristics to evaluate neonatal medical devices for use in low-resource settings. J User Exp. 2021;17(1):12–20. Johnston J, Asma E, Ziegler Acemyan C, Oden M, Richards-Kortum R, Kortum P. Development and use of heuristics to evaluate neonatal medical devices for use in low-resource settings. J User Exp. 2021;17(1):12–20.
33.
go back to reference Nielsen J. Usability inspection methods. Conference companion on Human factors in computing systems. 1994. p. 413–4.CrossRef Nielsen J. Usability inspection methods. Conference companion on Human factors in computing systems. 1994. p. 413–4.CrossRef
34.
go back to reference Zhang J, Johnson TR, Patel VL, Paige DL, Kubose T. Using usability heuristics to evaluate patient safety of medical devices. J Biomed Inform. 2003;36(1–2):23–30.CrossRefPubMed Zhang J, Johnson TR, Patel VL, Paige DL, Kubose T. Using usability heuristics to evaluate patient safety of medical devices. J Biomed Inform. 2003;36(1–2):23–30.CrossRefPubMed
35.
go back to reference Spencer R. The streamlined cognitive walkthrough method, working around social constraints encountered in a software development company. Proceedings of the SIGCHI on Human Factors in Computing Systems. 2000. p. 353–359. Spencer R. The streamlined cognitive walkthrough method, working around social constraints encountered in a software development company. Proceedings of the SIGCHI on Human Factors in Computing Systems. 2000. p. 353–359.
37.
go back to reference Kortum P. Usability assessment: how to measure the usability of products, services, and systems. Santa Monica: The Human Factors And Ergonomics Society; 2016. Kortum P. Usability assessment: how to measure the usability of products, services, and systems. Santa Monica: The Human Factors And Ergonomics Society; 2016.
38.
go back to reference International Organization for Standardization. ISO 9241–11:2018. Ergonomics of human-system interaction - Part 11: Usability: Definitions and concepts. Geneva: ISO; 2018. International Organization for Standardization. ISO 9241–11:2018. Ergonomics of human-system interaction - Part 11: Usability: Definitions and concepts. Geneva: ISO; 2018.
39.
go back to reference Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum Comput Interact. 2008;24(6):574–94.CrossRef Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum Comput Interact. 2008;24(6):574–94.CrossRef
40.
go back to reference Brooke J. SUS: a quick and dirty usability scale. Usability Evaluation in Industry. 1996. Brooke J. SUS: a quick and dirty usability scale. Usability Evaluation in Industry. 1996.
41.
go back to reference Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J User Exp. 2009;4(1):114–23. Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J User Exp. 2009;4(1):114–23.
42.
go back to reference Coulentianos MJ, Rodriguez-Calero I, Daly SR, Sienko KH. Global health front-end medical device design: the use of prototypes to engage stakeholders. Dev Eng. 2020;5:100055.CrossRef Coulentianos MJ, Rodriguez-Calero I, Daly SR, Sienko KH. Global health front-end medical device design: the use of prototypes to engage stakeholders. Dev Eng. 2020;5:100055.CrossRef
43.
go back to reference Bitkina OVI, Kim HK, Park J. Usability and user experience of medical devices: An overview of the current state, analysis methodologies, and future challenges. Int J Indfy Ergon. 2020;76:102932.CrossRef Bitkina OVI, Kim HK, Park J. Usability and user experience of medical devices: An overview of the current state, analysis methodologies, and future challenges. Int J Indfy Ergon. 2020;76:102932.CrossRef
46.
go back to reference Smith A. Issues in adapting usability testing for global usability. In: Global usability. London: Springer London; 2011. p. 23–38.CrossRef Smith A. Issues in adapting usability testing for global usability. In: Global usability. London: Springer London; 2011. p. 23–38.CrossRef
47.
go back to reference Matin S, Asma E, Mjumira R, Valle M, Acemyan C, Oden M, Kawaza K, Kortum P, Richards-Kortum R. Proxy Users for Usability Testing of Medical Devices for Use in Sub-Saharan Africa. In: Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care, 12(1). Sage CA: Los Angeles, CA: SAGE Publications; 2023. p. 208–12. Matin S, Asma E, Mjumira R, Valle M, Acemyan C, Oden M, Kawaza K, Kortum P, Richards-Kortum R. Proxy Users for Usability Testing of Medical Devices for Use in Sub-Saharan Africa. In: Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care, 12(1). Sage CA: Los Angeles, CA: SAGE Publications; 2023. p. 208–12.
48.
go back to reference Winschiers-Theophilus H. The art of cross-cultural design for usability. In Universal Access in Human-Computer Interaction. Addressing Diversity: 5th International Conference, UAHCI 2009, Held as Part of HCI International 2009. San Diego, CA, USA, July 19-24, 2009. Proceedings, Part I 5. Springer Berlin Heidelberg. 2009. pp. 665–71. Winschiers-Theophilus H. The art of cross-cultural design for usability. In Universal Access in Human-Computer Interaction. Addressing Diversity: 5th International Conference, UAHCI 2009, Held as Part of HCI International 2009. San Diego, CA, USA, July 19-24, 2009. Proceedings, Part I 5. Springer Berlin Heidelberg. 2009. pp. 665–71. 
49.
go back to reference Mohedas I, Sabet Sarvestani A, Daly SR, Sienko KH. Applying design ethnography to product evaluation: A case example of a medical device in a low-resource setting. In Proceedings of the 20th International Conference on Engineering Design ICED15; 2015. Mohedas I, Sabet Sarvestani A, Daly SR, Sienko KH. Applying design ethnography to product evaluation: A case example of a medical device in a low-resource setting. In Proceedings of the 20th International Conference on Engineering Design ICED15; 2015.
50.
go back to reference Coulentianos MJ, Rodriguez-Calero I, Daly SR, Burridge J, Sienko KH. Medical device design practitioner strategies for prototype-centered front-end design stakeholder engagements in low-resource settings. In: Proceedings of the Design Society: International Conference on Engineering Design (1)1. Cambridge University Press. 2019. pp. 957–964. Coulentianos MJ, Rodriguez-Calero I, Daly SR, Burridge J, Sienko KH. Medical device design practitioner strategies for prototype-centered front-end design stakeholder engagements in low-resource settings. In: Proceedings of the Design Society: International Conference on Engineering Design (1)1. Cambridge University Press. 2019. pp. 957–964.
51.
go back to reference Bekele R, Groher I, Sametinger J, Biru T, Floyd C, Pomberger G, Oppelt P. User-centered design in developing countries: a case study of a sustainable intercultural healthcare platform in Ethiopia. In 2019 IEEE/ACM symposium on software engineering in Africa (SEiA). IEEE; 2019. pp. 11–15. Bekele R, Groher I, Sametinger J, Biru T, Floyd C, Pomberger G, Oppelt P. User-centered design in developing countries: a case study of a sustainable intercultural healthcare platform in Ethiopia. In 2019 IEEE/ACM symposium on software engineering in Africa (SEiA). IEEE; 2019. pp. 11–15.
52.
go back to reference Searle E. What is the best possible design for all my users?: A single question to guide user-centered design in low-resource environments. In: Proceedings of the 7th International ISCRAM Conference; 2010. Searle E. What is the best possible design for all my users?: A single question to guide user-centered design in low-resource environments. In: Proceedings of the 7th International ISCRAM Conference; 2010.
53.
go back to reference Aranda-Jan CB, Jagtap S, Moultrie J. Towards a framework for holistic contextual design for low-resource settings. Int J Des. 2016;10(3):43–63. Aranda-Jan CB, Jagtap S, Moultrie J. Towards a framework for holistic contextual design for low-resource settings. Int J Des. 2016;10(3):43–63.
Metadata
Title
Avoid equipment graveyards: rigorous process to improve identification and procurement of effective, affordable, and usable newborn devices in low-resource hospital settings
Authors
Elizabeth Asma
Megan Heenan
George Banda
Rebecca P. Kirby
Lucky Mangwiro
Claudia Ziegler Acemyan
Kara M. Palamountain
Philip Kortum
Kondwani Kawaza
Z. Maria Oden
Rebecca Richards-Kortum
Technical Collaborative Authorship Group
Publication date
01-11-2023
Publisher
BioMed Central
Published in
BMC Pediatrics / Issue Special Issue 2/2023
Electronic ISSN: 1471-2431
DOI
https://doi.org/10.1186/s12887-023-04362-x

Other articles of this Special Issue 2/2023

BMC Pediatrics 2/2023 Go to the issue