Skip to main content
Top
Published in: World Journal of Surgery 8/2021

01-08-2021 | Care | Surgery in Low and Middle Income Countries

Evaluating a Novel Prehospital Emergency Trauma Care Assessment Tool (PETCAT) for Low- and Middle-Income Countries in Sierra Leone

Authors: Peter G. Delaney, Zachary J. Eisner, Alfred H. Thullah, Benjamin D. Muller, Kpawuru Sandy, Philip S. Boonstra, John W. Scott, Krishnan Raghavendran

Published in: World Journal of Surgery | Issue 8/2021

Login to get access

Abstract

Background

WHO recommends training lay first responders (LFRs) as the first step toward formal emergency medical services development, yet no tool exists to evaluate LFR programs.

Methods

We developed Prehospital Emergency Trauma Care Assessment Tool (PETCAT), a seven-question survey administered to first-line hospital-based healthcare providers, to independently assess LFR prehospital intervention frequency and quality. PETCAT surveys were administered one month pre-LFR program launch (June 2019) in Makeni, Sierra Leone and again 14 months post-launch (August 2020). Using a difference-in-differences approach, PETCAT was also administered in a control city (Kenema) with no LFR training intervention during the study period at the same intervals to control for secular trends. PETCAT measured change in both the experimental and control locations. Cronbach’s alpha, point bi-serial correlation, and inter-rater reliability using Cohen's Kappa assessed PETCAT reliability.

Results

PETCAT administration to 90 first-line, hospital-based healthcare providers found baseline prehospital intervention were rare in Makeni and Kenema prior to LFR program launch (1.2/10 vs. 1.8/10). Fourteen months post-LFR program implementation, PETCAT demonstrated prehospital interventions increased in Makeni with LFRs (5.2/10, p < 0.0001) and not in Kenema (1.2/10) by an adjusted difference of + 4.6 points/10 (p < 0.0001) (“never/rarely” to “half the time”), indicating negligible change due to secular trends. PETCAT demonstrated high reliability (Cronbach’s α = 0.93, Cohen's K = 0.62).

Conclusions

PETCAT measures changes in rates of prehospital care delivery by LFRs in a resource-limited African setting and may serve as a robust tool for independent EMS quality assessment.
Literature
1.
go back to reference Injuries and Violence: The Facts. World Health Organization (2010) Injuries and Violence: The Facts. World Health Organization (2010)
2.
go back to reference Mathers CD, Loncar D (2006) Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med 3(11):e442CrossRef Mathers CD, Loncar D (2006) Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med 3(11):e442CrossRef
3.
go back to reference Hsia RY, Thind A, Zakariah A et al (2015) Prehospital and emergency care: updates from the disease control priorities, Version 3. World J Surg 39(9):2161–2167CrossRef Hsia RY, Thind A, Zakariah A et al (2015) Prehospital and emergency care: updates from the disease control priorities, Version 3. World J Surg 39(9):2161–2167CrossRef
4.
go back to reference Mould-Millman N-K, Dixon JM, Sefa N et al (2017) The state of emergency medical services (EMS) systems in Africa. Prehosp Disaster Med 32(3):273–283CrossRef Mould-Millman N-K, Dixon JM, Sefa N et al (2017) The state of emergency medical services (EMS) systems in Africa. Prehosp Disaster Med 32(3):273–283CrossRef
5.
go back to reference Higgins A, Morriss WW, Gelb AW et al (2020) 72nd World Health Assembly. Anesthesia and Analgesia. 130(3):e92-4CrossRef Higgins A, Morriss WW, Gelb AW et al (2020) 72nd World Health Assembly. Anesthesia and Analgesia. 130(3):e92-4CrossRef
6.
go back to reference Nathens AB, Brunet FP, Maier RV (2004) Development of trauma systems and effect on outcomes after injury. Lancet 363(9423):1794–1801CrossRef Nathens AB, Brunet FP, Maier RV (2004) Development of trauma systems and effect on outcomes after injury. Lancet 363(9423):1794–1801CrossRef
7.
go back to reference Osterwalder JJ (2004) Insufficient quality of research on prehospital medical emergency care–where are the major problems and solutions? Swiss Med Wkly 134(27–28):389–394PubMed Osterwalder JJ (2004) Insufficient quality of research on prehospital medical emergency care–where are the major problems and solutions? Swiss Med Wkly 134(27–28):389–394PubMed
8.
go back to reference Mehmood A, Rowther AA, Kobusingye O et al (2018) Assessment of pre-hospital emergency medical services in low-income settings using a health systems approach. Int J Emerg Med 11(1):53CrossRef Mehmood A, Rowther AA, Kobusingye O et al (2018) Assessment of pre-hospital emergency medical services in low-income settings using a health systems approach. Int J Emerg Med 11(1):53CrossRef
9.
go back to reference Howard I, Cameron P, Wallis L et al (2018) Quality indicators for evaluating prehospital emergency care: a scoping review. Prehosp Disaster Med 33(1):43–52CrossRef Howard I, Cameron P, Wallis L et al (2018) Quality indicators for evaluating prehospital emergency care: a scoping review. Prehosp Disaster Med 33(1):43–52CrossRef
10.
go back to reference Harmsen AMK, Giannakopoulos GF, Moerbeek PR et al (2015) The influence of prehospital time on trauma patients outcome: a systematic review. Injury 46(4):602–609CrossRef Harmsen AMK, Giannakopoulos GF, Moerbeek PR et al (2015) The influence of prehospital time on trauma patients outcome: a systematic review. Injury 46(4):602–609CrossRef
11.
go back to reference Pap R, Lockwood C, Stephenson M et al (2018) Indicators to measure prehospital care quality: a scoping review. JBI Database Syst Rev Implement Rep 16(11):2192–2223CrossRef Pap R, Lockwood C, Stephenson M et al (2018) Indicators to measure prehospital care quality: a scoping review. JBI Database Syst Rev Implement Rep 16(11):2192–2223CrossRef
12.
go back to reference Gale J, Coburn A, Pearson K et al (2017) Developing program performance measures for rural emergency medical services. Prehosp Emerg Care 21(2):157–165CrossRef Gale J, Coburn A, Pearson K et al (2017) Developing program performance measures for rural emergency medical services. Prehosp Emerg Care 21(2):157–165CrossRef
13.
go back to reference Blair KJ, Paladino L, Shaw PL et al (2017) Surgical and trauma care in low- and middle-income countries: a review of capacity assessments. J Surg Res 210:139–151CrossRef Blair KJ, Paladino L, Shaw PL et al (2017) Surgical and trauma care in low- and middle-income countries: a review of capacity assessments. J Surg Res 210:139–151CrossRef
14.
go back to reference Mock C, Essential Trauma Care Project (World Health Organization), World Health Organization, International Society of Surgery (2004) Guidelines for essential trauma care. World Health Organization, Geneva, p 93 Mock C, Essential Trauma Care Project (World Health Organization), World Health Organization, International Society of Surgery (2004) Guidelines for essential trauma care. World Health Organization, Geneva, p 93
15.
go back to reference Mock C, Joshipura M, Goosen J et al (2006) Overview of the essential trauma care project. World J Surg 30(6):919–929CrossRef Mock C, Joshipura M, Goosen J et al (2006) Overview of the essential trauma care project. World J Surg 30(6):919–929CrossRef
16.
go back to reference Eisner ZJ, Delaney PG, Harun A et al (2020) Evaluation of a lay first responder program in Sierra Leone as a scalable model for prehospital trauma care. Injury 51(11):2565–2573CrossRef Eisner ZJ, Delaney PG, Harun A et al (2020) Evaluation of a lay first responder program in Sierra Leone as a scalable model for prehospital trauma care. Injury 51(11):2565–2573CrossRef
17.
go back to reference Mainz J (2003) Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care 15(6):523–530CrossRef Mainz J (2003) Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care 15(6):523–530CrossRef
18.
go back to reference Jones P, Shepherd M, Wells S et al (2014) What makes a good healthcare quality indicator? A systematic review and validation study. Emerg Med Australas 26(2):113–124CrossRef Jones P, Shepherd M, Wells S et al (2014) What makes a good healthcare quality indicator? A systematic review and validation study. Emerg Med Australas 26(2):113–124CrossRef
19.
go back to reference Howard I, Cameron P, Wallis L et al (2019) Identifying quality indicators for prehospital emergency care services in the low to middle income setting: the South African perspective. Afr J Emerg Med 9(4):185–192CrossRef Howard I, Cameron P, Wallis L et al (2019) Identifying quality indicators for prehospital emergency care services in the low to middle income setting: the South African perspective. Afr J Emerg Med 9(4):185–192CrossRef
20.
go back to reference Spaite DW, Maio R, Garrison HG et al (2001) Emergency medical services outcomes project (EMSOP) II: developing the foundation and conceptual models for out-of-hospital outcomes research. Ann Emerg Med 37(6):657–663CrossRef Spaite DW, Maio R, Garrison HG et al (2001) Emergency medical services outcomes project (EMSOP) II: developing the foundation and conceptual models for out-of-hospital outcomes research. Ann Emerg Med 37(6):657–663CrossRef
21.
go back to reference GBD 2016 Healthcare Access and Quality Collaborators (2018) Measuring performance on the healthcare access and quality Index for 195 countries and territories and selected subnational locations: a systematic analysis from the global burden of disease study 2016. Lancet 391(10136):2236–2271CrossRef GBD 2016 Healthcare Access and Quality Collaborators (2018) Measuring performance on the healthcare access and quality Index for 195 countries and territories and selected subnational locations: a systematic analysis from the global burden of disease study 2016. Lancet 391(10136):2236–2271CrossRef
22.
go back to reference Kruk ME, Gage AD, Arsenault C et al (2018) High-quality health systems in the sustainable development goals era: time for a revolution. Lancet Glob Health 6(11):e1196–e1252CrossRef Kruk ME, Gage AD, Arsenault C et al (2018) High-quality health systems in the sustainable development goals era: time for a revolution. Lancet Glob Health 6(11):e1196–e1252CrossRef
23.
go back to reference Delaney PG, Bamuleke R, Lee YJ (2018) Lay first responder training in eastern Uganda: leveraging transportation infrastructure to build an effective prehospital emergency care training program. World J Surg 42(8):2293–2302CrossRef Delaney PG, Bamuleke R, Lee YJ (2018) Lay first responder training in eastern Uganda: leveraging transportation infrastructure to build an effective prehospital emergency care training program. World J Surg 42(8):2293–2302CrossRef
24.
go back to reference Delaney PG, Figueroa JA, Eisner ZJ et al (2020) Designing and implementing a practical prehospital emergency trauma care curriculum for lay first responders in Guatemala. Trauma Surg Acute Care Open 5(1):e000409CrossRef Delaney PG, Figueroa JA, Eisner ZJ et al (2020) Designing and implementing a practical prehospital emergency trauma care curriculum for lay first responders in Guatemala. Trauma Surg Acute Care Open 5(1):e000409CrossRef
25.
go back to reference Hancock CJ, Delaney PG, Eisner ZJ et al (2020) Developing a lay first responder program in Chad: a 12-month follow-up evaluation of a rural prehospital emergency care program. Prehosp Disaster Med 35(5):546–553CrossRef Hancock CJ, Delaney PG, Eisner ZJ et al (2020) Developing a lay first responder program in Chad: a 12-month follow-up evaluation of a rural prehospital emergency care program. Prehosp Disaster Med 35(5):546–553CrossRef
26.
go back to reference Bakalos G, Mamali M, Komninos C, Koukou E et al (2011) Advanced life support versus basic life support in the pre-hospital setting: a meta-analysis. Resuscitation 82(9):1130–1137CrossRef Bakalos G, Mamali M, Komninos C, Koukou E et al (2011) Advanced life support versus basic life support in the pre-hospital setting: a meta-analysis. Resuscitation 82(9):1130–1137CrossRef
27.
go back to reference Dimick JB, Ryan AM (2014) Methods for evaluating changes in health care policy: the difference-in-differences approach. JAMA 312(22):2401–2402CrossRef Dimick JB, Ryan AM (2014) Methods for evaluating changes in health care policy: the difference-in-differences approach. JAMA 312(22):2401–2402CrossRef
28.
go back to reference Sierra Leone population structure and population distribution. :54. Sierra Leone population structure and population distribution. :54.
29.
go back to reference Sierra Leone Briefing note for countries on the 2019 Human Development Report. :10. Sierra Leone Briefing note for countries on the 2019 Human Development Report. :10.
32.
go back to reference Boeck MA, Callese TE, Nelson SK et al (2018) The development and implementation of a layperson trauma first responder course in La Paz, Bolivia: a pilot study. Injury 49(5):885–896CrossRef Boeck MA, Callese TE, Nelson SK et al (2018) The development and implementation of a layperson trauma first responder course in La Paz, Bolivia: a pilot study. Injury 49(5):885–896CrossRef
33.
go back to reference Greenland S (2016) Statistical tests, p values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol 31(4):337–350CrossRef Greenland S (2016) Statistical tests, p values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol 31(4):337–350CrossRef
34.
go back to reference Ursachi G, Horodnic IA, Zait A (2015) How reliable are measurement scales? External factors with indirect influence on reliability estimators. Procedia Econ Financ 20:679–686CrossRef Ursachi G, Horodnic IA, Zait A (2015) How reliable are measurement scales? External factors with indirect influence on reliability estimators. Procedia Econ Financ 20:679–686CrossRef
35.
go back to reference McHugh ML (2012) Interrater reliability: the kappa statistic. Biochem Med (Zagreb) 22(3):276–282CrossRef McHugh ML (2012) Interrater reliability: the kappa statistic. Biochem Med (Zagreb) 22(3):276–282CrossRef
36.
go back to reference Ebel RL (1967) The relation of item discrimination to test Reliability. J Educ Meas 4(3):125–128CrossRef Ebel RL (1967) The relation of item discrimination to test Reliability. J Educ Meas 4(3):125–128CrossRef
37.
go back to reference Harvill LM (1991) An NCME instructional module on. Standard error of measurement. Educ Meas Issues Pract 10(2):33–41CrossRef Harvill LM (1991) An NCME instructional module on. Standard error of measurement. Educ Meas Issues Pract 10(2):33–41CrossRef
38.
go back to reference Jayaraman S, Mabweijano JR, Lipnick MS et al (2009) First things first: effectiveness and scalability of a basic prehospital trauma care program for lay first-responders in Kampala. Uganda. PLoS ONE. 4(9):e6955CrossRef Jayaraman S, Mabweijano JR, Lipnick MS et al (2009) First things first: effectiveness and scalability of a basic prehospital trauma care program for lay first-responders in Kampala. Uganda. PLoS ONE. 4(9):e6955CrossRef
39.
go back to reference Spiegel DA, Gosselin RA, Coughlin RR et al (2008) The burden of musculoskeletal injury in low and middle-income countries: challenges and opportunities. J Bone Joint Surg Am 90(4):915–923CrossRef Spiegel DA, Gosselin RA, Coughlin RR et al (2008) The burden of musculoskeletal injury in low and middle-income countries: challenges and opportunities. J Bone Joint Surg Am 90(4):915–923CrossRef
40.
go back to reference Mock CN, nii-Amon-Kotei D, Maier RV (1997) Low utilization of formal medical services by injured persons in a developing nation: health service data underestimate the importance of trauma. J Trauma 42(3):504–11CrossRef Mock CN, nii-Amon-Kotei D, Maier RV (1997) Low utilization of formal medical services by injured persons in a developing nation: health service data underestimate the importance of trauma. J Trauma 42(3):504–11CrossRef
Metadata
Title
Evaluating a Novel Prehospital Emergency Trauma Care Assessment Tool (PETCAT) for Low- and Middle-Income Countries in Sierra Leone
Authors
Peter G. Delaney
Zachary J. Eisner
Alfred H. Thullah
Benjamin D. Muller
Kpawuru Sandy
Philip S. Boonstra
John W. Scott
Krishnan Raghavendran
Publication date
01-08-2021
Publisher
Springer International Publishing
Keyword
Care
Published in
World Journal of Surgery / Issue 8/2021
Print ISSN: 0364-2313
Electronic ISSN: 1432-2323
DOI
https://doi.org/10.1007/s00268-021-06140-1

Other articles of this Issue 8/2021

World Journal of Surgery 8/2021 Go to the issue