Skip to main content
Top
Published in: Conflict and Health 1/2018

Open Access 01-12-2018 | Research

Adaptation and testing of an assessment for mental health and alcohol use problems among conflict-affected adults in Ukraine

Authors: Benjamin Doty, Emily E. Haroz, Namrita S. Singh, Sergiy Bogdanov, Judith K. Bass, Laura K. Murray, Karis L. Callaway, Paul A. Bolton

Published in: Conflict and Health | Issue 1/2018

Login to get access

Abstract

Background

In Ukraine, a large number of internally displaced persons (IDPs) and veterans experience social and psychological problems as a result of the ongoing conflict between Ukraine and Russia. Our purpose was to develop reliable and valid instruments to screen for common mental health and alcohol use problems in these populations.

Methods

We used a three-step process of instrument adaptation and testing. The instrument—the Mental Health Assessment Inventory (MHAI)—combines adapted standard screeners with items derived locally in Ukraine. A validity study was conducted using a sample of 153 adults (54% male) ages 18 years and older. All participants in the sample were IDPs or veterans living in or near the major urban areas of Kyiv and Zaporizhia. Reliability testing (internal consistency, test-retest) and validity testing (construct, criterion) of the MHAI were conducted using classical test theory. After initial testing, we used Item Response Theory (IRT) to shorten and further refine the instrument.

Results

The MHAI showed good internal consistency and test-retest reliability for the main outcomes: depression (α = 0.94; r = .84), post-traumatic stress (PTS; α = 0.97; r = 0.87), anxiety (α = 0.90; r = 0.80), and alcohol use (α = 0.86; r = 0.91). There was good evidence of convergent construct validity among the scales for depression, PTS, and anxiety, but not for alcohol use. Item Response Theory (IRT) analysis supported use of shortened versions of the scales for depression, PTS, and anxiety, as they retained comparable psychometric properties to the full scales of the MHAI.

Conclusion

The findings support the reliability and validity of the assessment—the MHAI—for screening of common mental health problems among Ukrainian IDPs and veterans. Use of IRT shortened the instrument to improve practicality and potential sustainability.
Appendix
Available only for authorised users
Literature
1.
go back to reference Marples DR. Introduction. In: Marples DR, Mills FV, editors. Ukraines Euromaidan: analyses of a civil revolution. Stuttgart, Germany; 2015. p. 9–26. Marples DR. Introduction. In: Marples DR, Mills FV, editors. Ukraines Euromaidan: analyses of a civil revolution. Stuttgart, Germany; 2015. p. 9–26.
2.
go back to reference Reid A. Borderland: a journey through the history of Ukraine. New York: Basic Books; 2015. Reid A. Borderland: a journey through the history of Ukraine. New York: Basic Books; 2015.
3.
go back to reference Wood EA, Pomeranz WE, Merry EW, Trudolyubov M. Roots of Russia's war in Ukraine. Washington, DC: Woodrow Wilson Center Press; 2016. Wood EA, Pomeranz WE, Merry EW, Trudolyubov M. Roots of Russia's war in Ukraine. Washington, DC: Woodrow Wilson Center Press; 2016.
6.
go back to reference Murthy RS, Lakshminarayana R. Mental health consequences of war: a brief review of research findings. World Psychiatry. 2006;5:25–30.PubMedPubMedCentral Murthy RS, Lakshminarayana R. Mental health consequences of war: a brief review of research findings. World Psychiatry. 2006;5:25–30.PubMedPubMedCentral
7.
go back to reference de Jong JT, Komproe IH, van Ommeren M. Common mental disorders in postconflict settings. Lancet. 2003;361:2128–30.CrossRef de Jong JT, Komproe IH, van Ommeren M. Common mental disorders in postconflict settings. Lancet. 2003;361:2128–30.CrossRef
8.
go back to reference World Health Organization. World Health Organisation Composite International Diagnostic Interview (CIDI). Geneva 1990. World Health Organization. World Health Organisation Composite International Diagnostic Interview (CIDI). Geneva 1990.
9.
go back to reference Bromet EJ, Gluzman SF, Paniotto VI, Webb CPM, Tintle NL, Zakhozha V, et al. Epidemiology of psychiatric and alcohol disorders in Ukraine: findings from the Ukraine world mental health survey. Soc Psychiatry Psychiatr Epidemiol. 2005;40:681–90.CrossRef Bromet EJ, Gluzman SF, Paniotto VI, Webb CPM, Tintle NL, Zakhozha V, et al. Epidemiology of psychiatric and alcohol disorders in Ukraine: findings from the Ukraine world mental health survey. Soc Psychiatry Psychiatr Epidemiol. 2005;40:681–90.CrossRef
11.
go back to reference DeVellis RF. Scale development: Theory and applications. Thousand Oaks: SAGE Publications; 2017. DeVellis RF. Scale development: Theory and applications. Thousand Oaks: SAGE Publications; 2017.
12.
go back to reference Webb CPM, Bromet EJ, Gluzman S, Tintle NL, Schwartz JE, Kostyuchenko S, et al. Epidemiology of heavy alcohol use in Ukraine: findings from the World Mental Health Survey. Alcohol Alcohol. 2005;40:327–35. Webb CPM, Bromet EJ, Gluzman S, Tintle NL, Schwartz JE, Kostyuchenko S, et al. Epidemiology of heavy alcohol use in Ukraine: findings from the World Mental Health Survey. Alcohol Alcohol. 2005;40:327–35.
13.
go back to reference Haroz EE, Bass J, Lee C, Oo SS, Lin K, Kohrt B, et al. Development and cross-cultural testing of the international depression symptom scale (IDSS): a measurement instrument designed to represent global presentations of depression. Glob Mental Health. 2017;4:e17.CrossRef Haroz EE, Bass J, Lee C, Oo SS, Lin K, Kohrt B, et al. Development and cross-cultural testing of the international depression symptom scale (IDSS): a measurement instrument designed to represent global presentations of depression. Glob Mental Health. 2017;4:e17.CrossRef
14.
go back to reference Haroz EE, Michalopolous L, Bolton PA, Bass JK. Development of new global instruments for assessing depression and posttraumatic stress related to torture and trauma. Washington, DC: A report to the United States Agency for International Development; 2015. p. 1–96. Haroz EE, Michalopolous L, Bolton PA, Bass JK. Development of new global instruments for assessing depression and posttraumatic stress related to torture and trauma. Washington, DC: A report to the United States Agency for International Development; 2015. p. 1–96.
15.
go back to reference Parloff MB, Kelman HC, Frank JD. Comfort, effectiveness, and self-awareness as criteria of improvement in psychotherapy. Am J Psychiatry. 1954;111:343–52.CrossRef Parloff MB, Kelman HC, Frank JD. Comfort, effectiveness, and self-awareness as criteria of improvement in psychotherapy. Am J Psychiatry. 1954;111:343–52.CrossRef
16.
go back to reference Derogatis LR, Lipman RS, Rickels K, Uhlenhuth EH, Covi L. The Hopkins symptom checklist (HSCL): a self-report symptom inventory. Syst Res. 1974;19:1–15.CrossRef Derogatis LR, Lipman RS, Rickels K, Uhlenhuth EH, Covi L. The Hopkins symptom checklist (HSCL): a self-report symptom inventory. Syst Res. 1974;19:1–15.CrossRef
17.
go back to reference Cardozo BL. Mental health, social functioning, and attitudes of Kosovar Albanians following the war in Kosovo. JAMA. 2000;284:569.CrossRef Cardozo BL. Mental health, social functioning, and attitudes of Kosovar Albanians following the war in Kosovo. JAMA. 2000;284:569.CrossRef
18.
go back to reference Kleijn WC, Hovens JE, Rodenburg JJ. Posttraumatic stress symptoms in refugees: assessments with the Harvard Trauma Questionnaire and the Hopkins Symptom Checklist-25 in different languages. Psychol Rep. 2001;88:527–32. Kleijn WC, Hovens JE, Rodenburg JJ. Posttraumatic stress symptoms in refugees: assessments with the Harvard Trauma Questionnaire and the Hopkins Symptom Checklist-25 in different languages. Psychol Rep. 2001;88:527–32.
19.
go back to reference Lhewa D, Banu S, Rosenfeld B, Keller A. Validation of a Tibetan translation of the Hopkins Symptom Checklist 25 and the Harvard Trauma Questionnaire. Assessment. 2007;14:223–30. Lhewa D, Banu S, Rosenfeld B, Keller A. Validation of a Tibetan translation of the Hopkins Symptom Checklist 25 and the Harvard Trauma Questionnaire. Assessment. 2007;14:223–30.
20.
go back to reference Thapa SB, Hauff E. Psychological distress among displaced persons during an armed conflict in Nepal. Soc Psychiatry Psychiatr Epidemiol. 2005;40:672–9.CrossRef Thapa SB, Hauff E. Psychological distress among displaced persons during an armed conflict in Nepal. Soc Psychiatry Psychiatr Epidemiol. 2005;40:672–9.CrossRef
23.
go back to reference Bolton P, Tang AM. An alternative approach to cross-cultural function assessment. Soc Psychiatry Psychiatr Epidemiol. 2002;37:537–43.CrossRef Bolton P, Tang AM. An alternative approach to cross-cultural function assessment. Soc Psychiatry Psychiatr Epidemiol. 2002;37:537–43.CrossRef
24.
go back to reference Bass JK, Ryder RW, Lammers M-C, Mukaba TN, Bolton PA. Post-partum depression in Kinshasa, Democratic Republic of Congo: validation of a concept using a mixed-methods cross-cultural approach. Tropical Med Int Health. 2008;13:1534–42.CrossRef Bass JK, Ryder RW, Lammers M-C, Mukaba TN, Bolton PA. Post-partum depression in Kinshasa, Democratic Republic of Congo: validation of a concept using a mixed-methods cross-cultural approach. Tropical Med Int Health. 2008;13:1534–42.CrossRef
25.
go back to reference Gray MJ, Litz BT, Hsu JL, Lombardo TW. Psychometric properties of the life events checklist. Assessment. 2004;11:330–41.CrossRef Gray MJ, Litz BT, Hsu JL, Lombardo TW. Psychometric properties of the life events checklist. Assessment. 2004;11:330–41.CrossRef
26.
go back to reference First MB, Spitzer RL, Gibbon M, JBW W. Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition. Revision: January 2010. In: Biometrics Research. New York: New York State Psychiatric Institute; 2002. Available from: http://www.scid4.org/info/refscid.html. First MB, Spitzer RL, Gibbon M, JBW W. Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition. Revision: January 2010. In: Biometrics Research. New York: New York State Psychiatric Institute; 2002. Available from: http://​www.​scid4.​org/​info/​refscid.​html.
27.
go back to reference Rapaport MH, Judd LL. Minor depressive disorder and subsyndromal depressive symptoms: functional impairment and response to treatment. J Affect Disord. 1998;48:227–32.CrossRef Rapaport MH, Judd LL. Minor depressive disorder and subsyndromal depressive symptoms: functional impairment and response to treatment. J Affect Disord. 1998;48:227–32.CrossRef
28.
go back to reference Fann JR, Bombardier CH, Dikmen S, Esselman P, Warms CA, Pelzer E, et al. Validity of the Patient Health Questionnaire-9 in assessing depression following traumatic brain injury. J Head Trauma Rehabil. 2005;20:501–11. Fann JR, Bombardier CH, Dikmen S, Esselman P, Warms CA, Pelzer E, et al. Validity of the Patient Health Questionnaire-9 in assessing depression following traumatic brain injury. J Head Trauma Rehabil. 2005;20:501–11.
29.
go back to reference Phillips MR, Zhang J, Shi Q, Song Z, Ding Z, Pang S, et al. Prevalence, treatment, and associated disability of mental disorders in four provinces in China during 2001–05: an epidemiological survey. Lancet. 2009;373:2041–53.CrossRef Phillips MR, Zhang J, Shi Q, Song Z, Ding Z, Pang S, et al. Prevalence, treatment, and associated disability of mental disorders in four provinces in China during 2001–05: an epidemiological survey. Lancet. 2009;373:2041–53.CrossRef
30.
go back to reference Elhai JD, Franklin CL, Gray MJ. The SCID PTSD module's trauma screen: validity with two samples in detecting trauma history. Depress Anxiety. 2008;25:737–41.CrossRef Elhai JD, Franklin CL, Gray MJ. The SCID PTSD module's trauma screen: validity with two samples in detecting trauma history. Depress Anxiety. 2008;25:737–41.CrossRef
31.
go back to reference Zimmerman M, McGlinchey JB, Young D, Chelminski I. Diagnosing major depressive disorder I: a psychometric evaluation of the DSM-IV symptom criteria. J Nerv Ment Dis. 2006;194:158–63.CrossRef Zimmerman M, McGlinchey JB, Young D, Chelminski I. Diagnosing major depressive disorder I: a psychometric evaluation of the DSM-IV symptom criteria. J Nerv Ment Dis. 2006;194:158–63.CrossRef
32.
go back to reference Erdman HP, Klein MH, Greist JH, Bass SM, Bires JK. Machtinger PE. A comparison of the diagnostic interview schedule and clinical diagnosis. Am J Psychiatry. 1987;144:1477–80.CrossRef Erdman HP, Klein MH, Greist JH, Bass SM, Bires JK. Machtinger PE. A comparison of the diagnostic interview schedule and clinical diagnosis. Am J Psychiatry. 1987;144:1477–80.CrossRef
33.
go back to reference Nordgaard J, Revsbech R, Sæbye D, Parnas J. Assessing the diagnostic validity of a structured psychiatric interview in a first-admission hospital sample. World Psychiatry World Psychiatr Assoc. 2012;11:181–5.CrossRef Nordgaard J, Revsbech R, Sæbye D, Parnas J. Assessing the diagnostic validity of a structured psychiatric interview in a first-admission hospital sample. World Psychiatry World Psychiatr Assoc. 2012;11:181–5.CrossRef
34.
go back to reference Marsh L, McDonald WM, Cummings J, Ravina B, NINDS/NIMH Work roup on depression and Parkinson’s disease. Provisional diagnostic criteria for depression in Parkinson’s disease: report of an NINDS/NIMH work group. Mov Disord. 2006;21:148–58.CrossRef Marsh L, McDonald WM, Cummings J, Ravina B, NINDS/NIMH Work roup on depression and Parkinson’s disease. Provisional diagnostic criteria for depression in Parkinson’s disease: report of an NINDS/NIMH work group. Mov Disord. 2006;21:148–58.CrossRef
36.
go back to reference Betancourt T, Scorza P, Meyers-Ohki S, Mushashi C, Kayiteshonga Y, Binagwaho A, Stulac S, Beardslee WR. Validating the Center for Epidemiological Studies Depression Scale for children in Rwanda. J Am Acad Child Adolesc Psychiatry. 2012;51:1284–92. Betancourt T, Scorza P, Meyers-Ohki S, Mushashi C, Kayiteshonga Y, Binagwaho A, Stulac S, Beardslee WR. Validating the Center for Epidemiological Studies Depression Scale for children in Rwanda. J Am Acad Child Adolesc Psychiatry. 2012;51:1284–92.
37.
go back to reference Silove D, Manicavasagar V, Mollica R, Thai M, Khiek D, Lavelle J, et al. Screening for depression and PTSD in a Cambodian population unaffected by war: comparing the Hopkins Symptom Checklist and Harvard Trauma Questionnaire with the structured clinical interview. J Nerv Ment Dis. 2007;195:152–7. Silove D, Manicavasagar V, Mollica R, Thai M, Khiek D, Lavelle J, et al. Screening for depression and PTSD in a Cambodian population unaffected by war: comparing the Hopkins Symptom Checklist and Harvard Trauma Questionnaire with the structured clinical interview. J Nerv Ment Dis. 2007;195:152–7.
38.
go back to reference Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRef Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRef
39.
go back to reference Liu X. Classification accuracy and cut point selection. Stat Med. 2012;31:2676–86.CrossRef Liu X. Classification accuracy and cut point selection. Stat Med. 2012;31:2676–86.CrossRef
40.
go back to reference Edelen MO, Reeve BB. Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Qual Life Res. 2007;16(Suppl 1):5–18.CrossRef Edelen MO, Reeve BB. Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Qual Life Res. 2007;16(Suppl 1):5–18.CrossRef
41.
go back to reference Samejima F. Graded response model. In: Van der Linden WJ, Hambleton RK, editors. Handbook of modern item response theory. New York: Springer; 1997. p. 85–100.CrossRef Samejima F. Graded response model. In: Van der Linden WJ, Hambleton RK, editors. Handbook of modern item response theory. New York: Springer; 1997. p. 85–100.CrossRef
43.
go back to reference StataCorp. Stata Statistical Software: Release 14. 14. College Station: Stata Corp. StataCorp. Stata Statistical Software: Release 14. 14. College Station: Stata Corp.
44.
go back to reference Ventevogel P, De Vries G, Scholte WF, Shinwari NR, Faiz H, Nassery R, et al. Properties of the Hopkins Symptom Checklist-25 (HSCL-25) and the self-reporting questionnaire (SRQ-20) as screening instruments used in primary care in Afghanistan. Soc Psychiatry Psychiatr Epidemiol. 2007;42:328–35. Ventevogel P, De Vries G, Scholte WF, Shinwari NR, Faiz H, Nassery R, et al. Properties of the Hopkins Symptom Checklist-25 (HSCL-25) and the self-reporting questionnaire (SRQ-20) as screening instruments used in primary care in Afghanistan. Soc Psychiatry Psychiatr Epidemiol. 2007;42:328–35.
46.
go back to reference Betancourt TS, Yang F, Bolton P, Normand S-L. Developing an African youth psychosocial assessment: an application of item response theory. Int J Methods Psychiatr Res. 2014;23:142–60.CrossRef Betancourt TS, Yang F, Bolton P, Normand S-L. Developing an African youth psychosocial assessment: an application of item response theory. Int J Methods Psychiatr Res. 2014;23:142–60.CrossRef
47.
go back to reference Haroz EE, Bolton P, Gross A, Chan KS, Michalopoulos L, Bass J. Depression symptoms across cultures: an IRT analysis of standard depression symptoms using data from eight countries. Soc Psychiatry Psychiatr Epidemiol. 2016;51:981–91.CrossRef Haroz EE, Bolton P, Gross A, Chan KS, Michalopoulos L, Bass J. Depression symptoms across cultures: an IRT analysis of standard depression symptoms using data from eight countries. Soc Psychiatry Psychiatr Epidemiol. 2016;51:981–91.CrossRef
48.
go back to reference Jacobson IG. Alcohol use and alcoholrelated problems before and after military combat deployment. JAMA. 2008;300:663–75.CrossRef Jacobson IG. Alcohol use and alcohol­related problems before and after military combat deployment. JAMA. 2008;300:663–75.CrossRef
49.
go back to reference Roberts B, Murphy A, Chikovani I, Makhashvili N, Patel V, McKee M. Individual and community level riskfactors for alcohol use disorder among conflictaffected persons in Georgia. PLoS One. 2014;9:e98299.CrossRef Roberts B, Murphy A, Chikovani I, Makhashvili N, Patel V, McKee M. Individual and community level risk­factors for alcohol use disorder among conflict­affected persons in Georgia. PLoS One. 2014;9:e98299.CrossRef
50.
go back to reference Kozarić-Kovacić D, Ljubin T, Grappe M. Comorbidity of posttraumatic stress disorder and alcohol dependence in displaced persons. Croat Med J. 2000;41:173–8.PubMed Kozarić-Kovacić D, Ljubin T, Grappe M. Comorbidity of posttraumatic stress disorder and alcohol dependence in displaced persons. Croat Med J. 2000;41:173–8.PubMed
51.
go back to reference Haroz EE, Bass JK, Lee C, Murray LK, Robinson C, Bolton P. Adaptation and testing of psychosocial assessment instruments for cross-cultural use: an example from the Thailand Burma border. BMC Psychol. 2014;2:31.CrossRef Haroz EE, Bass JK, Lee C, Murray LK, Robinson C, Bolton P. Adaptation and testing of psychosocial assessment instruments for cross-cultural use: an example from the Thailand Burma border. BMC Psychol. 2014;2:31.CrossRef
52.
go back to reference Betancourt TS, Bass J, Borisova I, Neugebauer R, Speelman L, Onyango G, et al. Assessing local instrument reliability and validity: a field-based example from northern Uganda. Soc Psychiatry Psychiatr Epidemiol. 2009;44:685–92.CrossRef Betancourt TS, Bass J, Borisova I, Neugebauer R, Speelman L, Onyango G, et al. Assessing local instrument reliability and validity: a field-based example from northern Uganda. Soc Psychiatry Psychiatr Epidemiol. 2009;44:685–92.CrossRef
53.
go back to reference Porter M, Haslam N. Predisplacement and postdisplacement factors associated with mental health of refugees and internally displaced persons: a meta-analysis. JAMA. 2005;294:602–12.CrossRef Porter M, Haslam N. Predisplacement and postdisplacement factors associated with mental health of refugees and internally displaced persons: a meta-analysis. JAMA. 2005;294:602–12.CrossRef
54.
go back to reference Miller KE, Rasmussen A. War exposure, daily stressors, and mental health in conflict and post-conflict settings: bridging the divide between trauma-focused and psychosocial frameworks. Soc Sci Med. 2010;70:7–16.CrossRef Miller KE, Rasmussen A. War exposure, daily stressors, and mental health in conflict and post-conflict settings: bridging the divide between trauma-focused and psychosocial frameworks. Soc Sci Med. 2010;70:7–16.CrossRef
Metadata
Title
Adaptation and testing of an assessment for mental health and alcohol use problems among conflict-affected adults in Ukraine
Authors
Benjamin Doty
Emily E. Haroz
Namrita S. Singh
Sergiy Bogdanov
Judith K. Bass
Laura K. Murray
Karis L. Callaway
Paul A. Bolton
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Conflict and Health / Issue 1/2018
Electronic ISSN: 1752-1505
DOI
https://doi.org/10.1186/s13031-018-0169-6

Other articles of this Issue 1/2018

Conflict and Health 1/2018 Go to the issue