Skip to main content
Top
Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2020

Open Access 01-12-2020 | Original research

Developing a tool for measuring the disaster resilience of healthcare rescuers: a modified Delphi study

Authors: Xiaorong MAO, Alice Yuen LOKE, Xiuying HU

Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine | Issue 1/2020

Login to get access

Abstract

Background

Disaster resilience is an essential personal characteristics of health rescue workers to respond to disasters in an effective manner, and maintain a state of adaptation after deployment. It is essential for disaster managers to recruit, assess, and prepare healthcare rescuers with this characteristic. A specific tool for measuring the disaster resilience of healthcare rescuers has yet to be devised.

Objective

The purpose of this study was to establish the content validity of a tool for measuring the disaster resilience of disaster rescue workers.

Methods

A modified Delphi approach was employed. Experts in disaster work and research were invited to rate the domains and items of a prototype tool for measuring disaster resilience in healthcare rescue workers. The panel of experts rated the relevance of the items using a 4-point Likert scale. The median and interquartile range, as well as the level of agreement, were calculated for each item using the Kendall coefficient W, to assess the consensus of the experts. The content validity index (CVI) was calculated to assess the content validity of this tool.

Results

A total of 22 and 21 experts were involved in the first and second rounds of this modified Delphi study (response rate of 91.7 and 95.5%), respectively. After two rounds of expert query, an eight-domain and 27-item disaster resilience measuring tool was established. The median range of all of the included items was 3.50 to 4.00 and the interquartile range was 0.00 to 1.00, and all items achieved ≥85% agreement. The Kendall coordination coefficient W was 0.21 and 0.33 in the first and second rounds, respectively, with P < 0.01. The I-CVI ranged from 0.85 to 1.0, while the S-CVI/UA and S-CVI /Ave were 0.69 and 0.97, respectively.

Conclusion

Consensus was reached on a disaster resilience measuring tool covering 27 items. The content validity of this tool for measuring the disaster resilience of healthcare rescuers was excellent. This tool is validated and ready to be tested in a pilot study to assess its psychometric properties.
Literature
1.
go back to reference Bonanno GA, Diminich ED. Annual research review: positive adjustment to adversity–trajectories of minimal–impact resilience and emergent resilience. J Child Psychol Psychiatry. 2013;54(4):378–401.PubMedCrossRef Bonanno GA, Diminich ED. Annual research review: positive adjustment to adversity–trajectories of minimal–impact resilience and emergent resilience. J Child Psychol Psychiatry. 2013;54(4):378–401.PubMedCrossRef
2.
go back to reference Jackson J, Vandall-Walker V, Vanderspank-Wright B, Wishart P, Moore SL. Burnout and resilience in critical care nurses: a grounded theory of managing exposure. Intensive Crit Care Nurs. 2018;48:28–35.PubMedCrossRef Jackson J, Vandall-Walker V, Vanderspank-Wright B, Wishart P, Moore SL. Burnout and resilience in critical care nurses: a grounded theory of managing exposure. Intensive Crit Care Nurs. 2018;48:28–35.PubMedCrossRef
3.
go back to reference Moon Y, Shin SY. Moderating effects of resilience on the relationship between emotional labor and burnout in care work ers. J Gerontol Nurs. 2018;44(10):30–9.PubMedCrossRef Moon Y, Shin SY. Moderating effects of resilience on the relationship between emotional labor and burnout in care work ers. J Gerontol Nurs. 2018;44(10):30–9.PubMedCrossRef
4.
go back to reference Kašpárková L, Vaculík M, Procházka J, Schaufeli WB. Why resilient workers perform better: the roles of job satisfaction and work engagement. J Work Behav Health. 2018;33(1):43–62.CrossRef Kašpárková L, Vaculík M, Procházka J, Schaufeli WB. Why resilient workers perform better: the roles of job satisfaction and work engagement. J Work Behav Health. 2018;33(1):43–62.CrossRef
5.
go back to reference Mao XR, Fung OWM, Hu XY, Loke AY. Psychological impacts of disaster on rescue workers: a review of the literature. Int J Disaster Risk Reduction. 2018;27:602–17.CrossRef Mao XR, Fung OWM, Hu XY, Loke AY. Psychological impacts of disaster on rescue workers: a review of the literature. Int J Disaster Risk Reduction. 2018;27:602–17.CrossRef
6.
go back to reference McCain RS, McKinley N, Dempster M, Campbell WJ, Kirk SJ. A study of the relationship between resilience, burnout and coping strategies in doctors. Postgrad Med J. 2018;94(1107):43–7.CrossRef McCain RS, McKinley N, Dempster M, Campbell WJ, Kirk SJ. A study of the relationship between resilience, burnout and coping strategies in doctors. Postgrad Med J. 2018;94(1107):43–7.CrossRef
8.
go back to reference Kang P, Lv Y, Hao L, Tang B, Liu Z, Liu X, et al. Psychological consequences and quality of life among medical rescuers who responded to the 2010 Yushu earthquake: a neglected problem. Psychiatry Res. 2015;230(2):517–23.PubMedCrossRef Kang P, Lv Y, Hao L, Tang B, Liu Z, Liu X, et al. Psychological consequences and quality of life among medical rescuers who responded to the 2010 Yushu earthquake: a neglected problem. Psychiatry Res. 2015;230(2):517–23.PubMedCrossRef
9.
go back to reference Zhen Y. Huang Z-q, Jin J, Deng X-y, Zhang L-p, Wang J-g. posttraumatic stress disorder of red cross nurses in the aftermath of the 2008 Wenchuan China earthquake. Arch Psychiatr Nurs. 2012;26(1):63–70.PubMedCrossRef Zhen Y. Huang Z-q, Jin J, Deng X-y, Zhang L-p, Wang J-g. posttraumatic stress disorder of red cross nurses in the aftermath of the 2008 Wenchuan China earthquake. Arch Psychiatr Nurs. 2012;26(1):63–70.PubMedCrossRef
10.
go back to reference Connor KM, Davidson JR. Development of a new resilience scale: the Connor-Davidson resilience scale (CD-RISC). Depress Anxiety. 2003;18(2):76–82.PubMedCrossRef Connor KM, Davidson JR. Development of a new resilience scale: the Connor-Davidson resilience scale (CD-RISC). Depress Anxiety. 2003;18(2):76–82.PubMedCrossRef
11.
go back to reference Southwick SM, Charney DS. The Science of Resilience: Implications for the Prevention and Treatment of Depression. Science (New York, NY). 2012;338(6103):79–82.CrossRef Southwick SM, Charney DS. The Science of Resilience: Implications for the Prevention and Treatment of Depression. Science (New York, NY). 2012;338(6103):79–82.CrossRef
12.
go back to reference Shepherd D, McBride D, Lovelock K. First responder well-being following the 2011 Canterbury earthquake. Disaster Prev Manag. 2017;26(3):286–97.CrossRef Shepherd D, McBride D, Lovelock K. First responder well-being following the 2011 Canterbury earthquake. Disaster Prev Manag. 2017;26(3):286–97.CrossRef
13.
go back to reference McCanlies EC, Mnatsakanova A, Andrew ME, Burchfiel CM, Violanti JM. Positive psychological factors are associated with lower PTSD symptoms among police officers: post hurricane Katrina. Stress Health. 2014;30(5):405–15.PubMedPubMedCentralCrossRef McCanlies EC, Mnatsakanova A, Andrew ME, Burchfiel CM, Violanti JM. Positive psychological factors are associated with lower PTSD symptoms among police officers: post hurricane Katrina. Stress Health. 2014;30(5):405–15.PubMedPubMedCentralCrossRef
14.
go back to reference Chang K, Taormina RJ. Reduced secondary trauma among Chinese earthquake rescuers: a test of correlates and life indicators. J Loss Trauma. 2011;16(6):542–62.CrossRef Chang K, Taormina RJ. Reduced secondary trauma among Chinese earthquake rescuers: a test of correlates and life indicators. J Loss Trauma. 2011;16(6):542–62.CrossRef
15.
go back to reference Windle G. What is resilience? A review and concept analysis. Rev Clin Gerontol. 2011;21(02):152–69.CrossRef Windle G. What is resilience? A review and concept analysis. Rev Clin Gerontol. 2011;21(02):152–69.CrossRef
16.
go back to reference Mao X, Loke AY, Fung OWM, Hu X. What it takes to be resilient: the views of disaster healthcare rescuers. Int J Disaster Risk Reduction. 2019;36:1–8.CrossRef Mao X, Loke AY, Fung OWM, Hu X. What it takes to be resilient: the views of disaster healthcare rescuers. Int J Disaster Risk Reduction. 2019;36:1–8.CrossRef
17.
go back to reference Hsu C-C, Sandford BA. Delphi technique. In: Encyclopedia of research design; 2010. p. 344–7. Hsu C-C, Sandford BA. Delphi technique. In: Encyclopedia of research design; 2010. p. 344–7.
19.
go back to reference Keeney S, McKenna H, Hasson F. The Delphi technique in nursing and health research. Wiley; 2011. Keeney S, McKenna H, Hasson F. The Delphi technique in nursing and health research. Wiley; 2011.
20.
go back to reference Custer RL, Scarcella JA, Stewart BRJJov, education t. The Modified Delphi Technique--A Rotational Modification 1999;15(2):50–58. Custer RL, Scarcella JA, Stewart BRJJov, education t. The Modified Delphi Technique--A Rotational Modification 1999;15(2):50–58.
21.
go back to reference Schmidt RCJdS. Managing Delphi surveys using nonparametric statistical techniques. 1997;28(3):763–774. Schmidt RCJdS. Managing Delphi surveys using nonparametric statistical techniques. 1997;28(3):763–774.
22.
go back to reference Keeney S, Hasson F, McKenna H. Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs. 2006;53(2):205–12.PubMedCrossRef Keeney S, Hasson F, McKenna H. Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs. 2006;53(2):205–12.PubMedCrossRef
23.
go back to reference Williams KE, Sansoni J, Morris D, Thompson C. A Delphi study to develop indicators of cancer patient experience for quality improvement. Support Care Cancer. 2018;26(1):129–38.PubMedCrossRef Williams KE, Sansoni J, Morris D, Thompson C. A Delphi study to develop indicators of cancer patient experience for quality improvement. Support Care Cancer. 2018;26(1):129–38.PubMedCrossRef
24.
go back to reference Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15.PubMed Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15.PubMed
25.
go back to reference Biondo PD, Nekolaichuk CL, Stiles C, Fainsinger R, Hagen NAJScic. Applying the Delphi process to palliative care tool development: lessons learned 2008;16(8):935–942. Biondo PD, Nekolaichuk CL, Stiles C, Fainsinger R, Hagen NAJScic. Applying the Delphi process to palliative care tool development: lessons learned 2008;16(8):935–942.
26.
go back to reference Skulmoski GJ, Hartman FT, Krahn J. The Delphi method for graduate research. J Inf Technol Educ Res. 2007;6:1–21. Skulmoski GJ, Hartman FT, Krahn J. The Delphi method for graduate research. J Inf Technol Educ Res. 2007;6:1–21.
27.
go back to reference Huang HC, Lin WC, Lin JDJJocn. Development of a fall-risk checklist using the Delphi technique 2008;17(17):2275–2283. Huang HC, Lin WC, Lin JDJJocn. Development of a fall-risk checklist using the Delphi technique 2008;17(17):2275–2283.
28.
go back to reference Evans CJP. The use of consensus methods and expert panels in pharmacoeconomic studies. 1997;12(2):121–129. Evans CJP. The use of consensus methods and expert panels in pharmacoeconomic studies. 1997;12(2):121–129.
29.
go back to reference Keeney S, Hasson F, McKenna HP. A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud. 2001;38(2):195–200.PubMedCrossRef Keeney S, Hasson F, McKenna HP. A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud. 2001;38(2):195–200.PubMedCrossRef
30.
go back to reference Moreno-Casbas T, Martín-Arribas C, Orts-Cortés I, Comet-Cortés P. Identification of priorities for nursing research in Spain: a Delphi study. J Adv Nurs. 2001;35(6):857–63.PubMedCrossRef Moreno-Casbas T, Martín-Arribas C, Orts-Cortés I, Comet-Cortés P. Identification of priorities for nursing research in Spain: a Delphi study. J Adv Nurs. 2001;35(6):857–63.PubMedCrossRef
31.
go back to reference Klimenko E, Julliard K. Communication between CAM and mainstream medicine: Delphi panel perspectives. Complement Ther Clin Pract. 2007;13(1):46–52.PubMedCrossRef Klimenko E, Julliard K. Communication between CAM and mainstream medicine: Delphi panel perspectives. Complement Ther Clin Pract. 2007;13(1):46–52.PubMedCrossRef
32.
go back to reference Jairath N, Weinstein J. The Delphi methodology (Part one): A useful administrative approach. 1994;7(3):29–42. Jairath N, Weinstein J. The Delphi methodology (Part one): A useful administrative approach. 1994;7(3):29–42.
33.
go back to reference MRJNr L. Determination and quantification of content validity; 1986. MRJNr L. Determination and quantification of content validity; 1986.
34.
go back to reference LLJAnr D. Instrument review: Getting the most from a panel of experts. 1992;5(4):194–7. LLJAnr D. Instrument review: Getting the most from a panel of experts. 1992;5(4):194–7.
35.
go back to reference NLJJoNE MC. A test of Cohen's developmental model for professional socialization with baccalaureate nursing students. 1985;24(5):180–6. NLJJoNE MC. A test of Cohen's developmental model for professional socialization with baccalaureate nursing students. 1985;24(5):180–6.
36.
go back to reference Heiko A. Consensus measurement in Delphi studies: review and implications for future quality assurance. Technol Forecast Soc Chang. 2012;79(8):1525–36.CrossRef Heiko A. Consensus measurement in Delphi studies: review and implications for future quality assurance. Technol Forecast Soc Chang. 2012;79(8):1525–36.CrossRef
37.
go back to reference Alshehri SA, Rezgui Y, Li H. Delphi-based consensus study into a framework of community resilience to disaster. Nat Hazards. 2015;75(3):2221–45.CrossRef Alshehri SA, Rezgui Y, Li H. Delphi-based consensus study into a framework of community resilience to disaster. Nat Hazards. 2015;75(3):2221–45.CrossRef
38.
go back to reference Joling KJ, Windle G, Dröes R-M, Huisman M, Hertogh CMM, Woods RT. What are the essential features of resilience for informal caregivers of people living with dementia? A Delphi consensus examination. Aging Ment Health. 2017;21(5):509–17.PubMedCrossRef Joling KJ, Windle G, Dröes R-M, Huisman M, Hertogh CMM, Woods RT. What are the essential features of resilience for informal caregivers of people living with dementia? A Delphi consensus examination. Aging Ment Health. 2017;21(5):509–17.PubMedCrossRef
39.
go back to reference Thompson SR, Dobbins S. The applicability of resilience training to the mitigation of trauma-related mental illness in military personnel. J Am Psychiatr Nurses Assoc. 2018;24(1):23–34.PubMedCrossRef Thompson SR, Dobbins S. The applicability of resilience training to the mitigation of trauma-related mental illness in military personnel. J Am Psychiatr Nurses Assoc. 2018;24(1):23–34.PubMedCrossRef
40.
go back to reference Zhong S, Clark M, Hou XY, Zang YL, FitzGerald G. Development of key indicators of hospital resilience: a modified Delphi study. J Health Serv Res Policy. 2015;20(2):74–82.PubMedCrossRef Zhong S, Clark M, Hou XY, Zang YL, FitzGerald G. Development of key indicators of hospital resilience: a modified Delphi study. J Health Serv Res Policy. 2015;20(2):74–82.PubMedCrossRef
41.
go back to reference Hampshaw S, Cooke J, Mott L. What is a research derived actionable tool, and what factors should be considered in their development? A Delphi study. BMC Health Serv Res. 2018;18. Hampshaw S, Cooke J, Mott L. What is a research derived actionable tool, and what factors should be considered in their development? A Delphi study. BMC Health Serv Res. 2018;18.
42.
go back to reference Lis R, Sakata V, Lien O. How to choose? Using the Delphi method to develop consensus triggers and indicators for disaster response. Disaster Med Public Health Prep. 2017;11(4):467–72.PubMedCrossRef Lis R, Sakata V, Lien O. How to choose? Using the Delphi method to develop consensus triggers and indicators for disaster response. Disaster Med Public Health Prep. 2017;11(4):467–72.PubMedCrossRef
43.
go back to reference Veziari Y, Kumar S, Leach M. The development of a survey instrument to measure the barriers to the conduct and application of research in complementary and alternative medicine: a Delphi study. BMC Complement Altern Med. 2018;18. Veziari Y, Kumar S, Leach M. The development of a survey instrument to measure the barriers to the conduct and application of research in complementary and alternative medicine: a Delphi study. BMC Complement Altern Med. 2018;18.
44.
go back to reference MJHta M. Consensus development methods, and their use in clinical guideline development. 1998;2(3):1–88. MJHta M. Consensus development methods, and their use in clinical guideline development. 1998;2(3):1–88.
45.
go back to reference Raskin MSJJoSWE. The Delphi study in field instruction revisited: Expert consensus on issues and research priorities. 1994;30(1):75–89. Raskin MSJJoSWE. The Delphi study in field instruction revisited: Expert consensus on issues and research priorities. 1994;30(1):75–89.
46.
go back to reference Rayens MK, Hahn EJJP, politics,, practice n. Building consensus using the policy Delphi method 2000;1(4):308–315. Rayens MK, Hahn EJJP, politics,, practice n. Building consensus using the policy Delphi method 2000;1(4):308–315.
47.
go back to reference Chen L, Huang LH, Xing MY, Feng ZX, Shao LW, Zhang MY, et al. Using the Delphi method to develop nursing-sensitive quality indicators for the NICU. J Clin Nurs. 2017;26(3–4):502–13.PubMedCrossRef Chen L, Huang LH, Xing MY, Feng ZX, Shao LW, Zhang MY, et al. Using the Delphi method to develop nursing-sensitive quality indicators for the NICU. J Clin Nurs. 2017;26(3–4):502–13.PubMedCrossRef
48.
go back to reference Polit DF, Beck CT, Owen SVJRin, health. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations 2007;30(4):459–467. Polit DF, Beck CT, Owen SVJRin, health. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations 2007;30(4):459–467.
49.
go back to reference Tidball KG, Krasny ME. From risk to resilience: What role for community greening and civic ecology in cities? 2007. p. 149–64. Tidball KG, Krasny ME. From risk to resilience: What role for community greening and civic ecology in cities? 2007. p. 149–64.
50.
go back to reference Eubank BH, Mohtadi NG, Lafave MR, Wiley JP, Bois AJ, Boorman RS, et al. Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology. BMC Med Res Methodol. 2016;16(1):56.PubMedPubMedCentralCrossRef Eubank BH, Mohtadi NG, Lafave MR, Wiley JP, Bois AJ, Boorman RS, et al. Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology. BMC Med Res Methodol. 2016;16(1):56.PubMedPubMedCentralCrossRef
51.
go back to reference Okoli C, Pawlowski SD. The Delphi method as a research tool: an example, design considerations and applications. Inf Manag. 2004;42(1):15–29.CrossRef Okoli C, Pawlowski SD. The Delphi method as a research tool: an example, design considerations and applications. Inf Manag. 2004;42(1):15–29.CrossRef
52.
go back to reference Shaw KL, Brook L, Cuddeford L, Fitzmaurice N, Thomas C, Thompson A, et al. Prognostic indicators for children and young people at the end of life: a Delphi study. Palliat Med. 2014;28(6):501–12.PubMedCrossRef Shaw KL, Brook L, Cuddeford L, Fitzmaurice N, Thomas C, Thompson A, et al. Prognostic indicators for children and young people at the end of life: a Delphi study. Palliat Med. 2014;28(6):501–12.PubMedCrossRef
53.
go back to reference Keeney S. The Delphi technique in nursing and health research. Hasson F, McKenna HP, editors. Chichester: Wiley-Blackwell; 2011.CrossRef Keeney S. The Delphi technique in nursing and health research. Hasson F, McKenna HP, editors. Chichester: Wiley-Blackwell; 2011.CrossRef
54.
go back to reference Bantel K. Comprehensiveness of strategic planning: the importance of heterogeneity of a top team. Psychol Rep. 1993;73:35.CrossRef Bantel K. Comprehensiveness of strategic planning: the importance of heterogeneity of a top team. Psychol Rep. 1993;73:35.CrossRef
55.
go back to reference Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review. PLoS One. 2011;6(6).PubMedPubMedCentralCrossRef Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review. PLoS One. 2011;6(6).PubMedPubMedCentralCrossRef
56.
go back to reference Gearhart A, Booth DT, Sedivec K, Schauer C. Use of Kendall's coefficient of concordance to assess agreement among observers of very high resolution imagery. Geocarto Int. 2013;28(6):517–26.CrossRef Gearhart A, Booth DT, Sedivec K, Schauer C. Use of Kendall's coefficient of concordance to assess agreement among observers of very high resolution imagery. Geocarto Int. 2013;28(6):517–26.CrossRef
57.
go back to reference Petrosyan Y, Barnsley JM, Kuluski K, Liu B, Wodchis WP. Quality indicators for ambulatory care for older adults with diabetes and comorbid conditions: A Delphi study. PLoS One. 2018;13(12).PubMedPubMedCentralCrossRef Petrosyan Y, Barnsley JM, Kuluski K, Liu B, Wodchis WP. Quality indicators for ambulatory care for older adults with diabetes and comorbid conditions: A Delphi study. PLoS One. 2018;13(12).PubMedPubMedCentralCrossRef
Metadata
Title
Developing a tool for measuring the disaster resilience of healthcare rescuers: a modified Delphi study
Authors
Xiaorong MAO
Alice Yuen LOKE
Xiuying HU
Publication date
01-12-2020
Publisher
BioMed Central
DOI
https://doi.org/10.1186/s13049-020-0700-9

Other articles of this Issue 1/2020

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2020 Go to the issue