Skip to main content
Top
Published in: BMC Psychiatry 1/2015

Open Access 01-12-2015 | Research article

Bridging a translational gap: using machine learning to improve the prediction of PTSD

Authors: Karen-Inge Karstoft, Isaac R Galatzer-Levy, Alexander Statnikov, Zhiguo Li, Arieh Y Shalev, For members of the Jerusalem Trauma Outreach and Prevention Study (J-TOPS) group

Published in: BMC Psychiatry | Issue 1/2015

Login to get access

Abstract

Background

Predicting Posttraumatic Stress Disorder (PTSD) is a pre-requisite for targeted prevention. Current research has identified group-level risk-indicators, many of which (e.g., head trauma, receiving opiates) concern but a subset of survivors. Identifying interchangeable sets of risk indicators may increase the efficiency of early risk assessment. The study goal is to use supervised machine learning (ML) to uncover interchangeable, maximally predictive combinations of early risk indicators.

Methods

Data variables (features) reflecting event characteristics, emergency department (ED) records and early symptoms were collected in 957 trauma survivors within ten days of ED admission, and used to predict PTSD symptom trajectories during the following fifteen months. A Target Information Equivalence Algorithm (TIE*) identified all minimal sets of features (Markov Boundaries; MBs) that maximized the prediction of a non-remitting PTSD symptom trajectory when integrated in a support vector machine (SVM). The predictive accuracy of each set of predictors was evaluated in a repeated 10-fold cross-validation and expressed as average area under the Receiver Operating Characteristics curve (AUC) for all validation trials.

Results

The average number of MBs per cross validation was 800. MBs’ mean AUC was 0.75 (95% range: 0.67-0.80). The average number of features per MB was 18 (range: 12–32) with 13 features present in over 75% of the sets.

Conclusions

Our findings support the hypothesized existence of multiple and interchangeable sets of risk indicators that equally and exhaustively predict non-remitting PTSD. ML’s ability to increase prediction versatility is a promising step towards developing algorithmic, knowledge-based, personalized prediction of post-traumatic psychopathology.
Appendix
Available only for authorised users
Literature
1.
go back to reference Brewin CR, Andrews B, Valentine JD. Meta-analysis of risk factors for posttraumatic stress disorder in trauma-exposed adults. J Consult Clin Psychol. 2000;68(5):748–66.CrossRefPubMed Brewin CR, Andrews B, Valentine JD. Meta-analysis of risk factors for posttraumatic stress disorder in trauma-exposed adults. J Consult Clin Psychol. 2000;68(5):748–66.CrossRefPubMed
2.
go back to reference Ozer EJ, Best SR, Lipsey TL, Weiss DS. Predictors of posttraumatic stress disorder and symptoms in adults: A meta-analysis. Psychol Bull. 2003;129(1):52–73.CrossRefPubMed Ozer EJ, Best SR, Lipsey TL, Weiss DS. Predictors of posttraumatic stress disorder and symptoms in adults: A meta-analysis. Psychol Bull. 2003;129(1):52–73.CrossRefPubMed
3.
go back to reference Kessler RC, Sonnega A, Bromet E, Hughes M, Nelson C. Post-traumatic stress disorder in the National Comorbidity Survey. Arch Gen Psychiatry. 1995;52:1048–60.CrossRefPubMed Kessler RC, Sonnega A, Bromet E, Hughes M, Nelson C. Post-traumatic stress disorder in the National Comorbidity Survey. Arch Gen Psychiatry. 1995;52:1048–60.CrossRefPubMed
4.
go back to reference Marmar CR, Weiss DS, Schlenger WE, et al. Peritraumatic dissociation and posttraumatic stress in male Vietnam theater veterans. Am J Psychiatry. 1994;151(6):902–7.CrossRefPubMed Marmar CR, Weiss DS, Schlenger WE, et al. Peritraumatic dissociation and posttraumatic stress in male Vietnam theater veterans. Am J Psychiatry. 1994;151(6):902–7.CrossRefPubMed
5.
go back to reference Shalev AY, Peri T, Canetti L, Schreiber S. Predictors of PTSD in injured trauma survivors: a prospective study. Am J Psychiatry. 1996;153(2):219–25.CrossRefPubMed Shalev AY, Peri T, Canetti L, Schreiber S. Predictors of PTSD in injured trauma survivors: a prospective study. Am J Psychiatry. 1996;153(2):219–25.CrossRefPubMed
6.
go back to reference Forbes D, Creamer M, Biddle D. The validity of the PTSD checklist as a measure of symptomatic change in combat-related PTSD. Behav Res Ther. 2001;39(8):977–86.CrossRefPubMed Forbes D, Creamer M, Biddle D. The validity of the PTSD checklist as a measure of symptomatic change in combat-related PTSD. Behav Res Ther. 2001;39(8):977–86.CrossRefPubMed
7.
go back to reference Bryant RA, Harvey AG, Guthrie RM, Moulds ML. A prospective study of psychophysiological arousal, acute stress disorder, and posttraumatic stress disorder. J Abnorm Psychol. 2000;109(2):341–4.CrossRefPubMed Bryant RA, Harvey AG, Guthrie RM, Moulds ML. A prospective study of psychophysiological arousal, acute stress disorder, and posttraumatic stress disorder. J Abnorm Psychol. 2000;109(2):341–4.CrossRefPubMed
8.
go back to reference Difede J, Barocas D. Acute intrusive and avoidant PTSD symptoms as predictors of chronic PTSD following burn injury. J Trauma Stress. 1999;12(2):363–9.CrossRefPubMed Difede J, Barocas D. Acute intrusive and avoidant PTSD symptoms as predictors of chronic PTSD following burn injury. J Trauma Stress. 1999;12(2):363–9.CrossRefPubMed
9.
10.
go back to reference Mellman TA, David D, Bustamante V, Fins AI, Esposito K. Predictors of post-traumatic stress disorder following severe injury. Depress Anxiety. 2001;14(4):226–31.CrossRefPubMed Mellman TA, David D, Bustamante V, Fins AI, Esposito K. Predictors of post-traumatic stress disorder following severe injury. Depress Anxiety. 2001;14(4):226–31.CrossRefPubMed
11.
go back to reference Shalev AY, Peri T, Brandes D, Freedman S, Orr SP, Pitman RK. Auditory startle response in trauma survivors with posttraumatic stress disorder: a prospective study. Am J Psychiatry. 2000;157(2):255–61.CrossRefPubMed Shalev AY, Peri T, Brandes D, Freedman S, Orr SP, Pitman RK. Auditory startle response in trauma survivors with posttraumatic stress disorder: a prospective study. Am J Psychiatry. 2000;157(2):255–61.CrossRefPubMed
12.
go back to reference Segman RH, Shefi N, Goltser-Dubner T, Friedman N, Kaminski N, Shalev AY. Peripheral blood mononuclear cell gene expression profiles identify emergent post-traumatic stress disorder among trauma survivors. Mol Psychiatry. 2005;10(5):500. –513, 425.CrossRefPubMed Segman RH, Shefi N, Goltser-Dubner T, Friedman N, Kaminski N, Shalev AY. Peripheral blood mononuclear cell gene expression profiles identify emergent post-traumatic stress disorder among trauma survivors. Mol Psychiatry. 2005;10(5):500. –513, 425.CrossRefPubMed
13.
go back to reference Koenen KC, Stellman JM, Stellman SD, Sommer Jr JF. Risk factors for course of posttraumatic stress disorder among Vietnam veterans: a 14-year follow-up of American Legionnaires. J Consult Clin Psych. 2003;71(6):980–6.CrossRef Koenen KC, Stellman JM, Stellman SD, Sommer Jr JF. Risk factors for course of posttraumatic stress disorder among Vietnam veterans: a 14-year follow-up of American Legionnaires. J Consult Clin Psych. 2003;71(6):980–6.CrossRef
14.
go back to reference Shalev AY, Segman RH. Commentary: biological findings in PTSD – too much or too little? Prog Brain Res. 2008;167:187–99.CrossRefPubMed Shalev AY, Segman RH. Commentary: biological findings in PTSD – too much or too little? Prog Brain Res. 2008;167:187–99.CrossRefPubMed
15.
go back to reference Orrù G, Pettersson-Yeo W, Marquand AF, Sartori G, Mechelli A. Using support vector machine to identify imaging biomarkers of neurological and psychiatric disease: a critical review. Neurosci Biobehav Rev. 2012;36(4):1140–52.CrossRefPubMed Orrù G, Pettersson-Yeo W, Marquand AF, Sartori G, Mechelli A. Using support vector machine to identify imaging biomarkers of neurological and psychiatric disease: a critical review. Neurosci Biobehav Rev. 2012;36(4):1140–52.CrossRefPubMed
16.
go back to reference Norman SB, Stein MB, Dimsdale JE, Hoyt DB. Pain in the aftermath of trauma is a risk factor for post-traumatic stress disorder. Psychol Med. 2008;38(4):533–42.CrossRefPubMed Norman SB, Stein MB, Dimsdale JE, Hoyt DB. Pain in the aftermath of trauma is a risk factor for post-traumatic stress disorder. Psychol Med. 2008;38(4):533–42.CrossRefPubMed
17.
go back to reference Bryan CJ, Clemans TA. Repetitive traumatic brain injury, psychological symptoms, and suicide risk in a clinical sample of deployed military personnel. JAMA Psychiatry (Chicago, Ill). 2013;70(7):686–91.CrossRef Bryan CJ, Clemans TA. Repetitive traumatic brain injury, psychological symptoms, and suicide risk in a clinical sample of deployed military personnel. JAMA Psychiatry (Chicago, Ill). 2013;70(7):686–91.CrossRef
18.
go back to reference Haagsma JA, Ringburg AN, van Lieshout EM, van Beeck EF, Patka P, Schipper IB. Prevalence rate, predictors and long-term course of probable posttraumatic stress disorder after major trauma: a prospective cohort study. BMC Psychiatry. 2012;12:236.CrossRefPubMedPubMedCentral Haagsma JA, Ringburg AN, van Lieshout EM, van Beeck EF, Patka P, Schipper IB. Prevalence rate, predictors and long-term course of probable posttraumatic stress disorder after major trauma: a prospective cohort study. BMC Psychiatry. 2012;12:236.CrossRefPubMedPubMedCentral
19.
go back to reference Bienvenu OJ, Gellar J, Althouse BM, Colantuoni E, Sricharoenchai T, Mendez-Tellez PA, et al. Post-traumatic stress disorder symptoms after acute lung injury: a 2-year prospective longitudinal study. Psychol Med. 2013;43(12):2657–71.CrossRefPubMed Bienvenu OJ, Gellar J, Althouse BM, Colantuoni E, Sricharoenchai T, Mendez-Tellez PA, et al. Post-traumatic stress disorder symptoms after acute lung injury: a 2-year prospective longitudinal study. Psychol Med. 2013;43(12):2657–71.CrossRefPubMed
20.
go back to reference Statnikov A, Lytkin NI, Lemeire J, Aliferis CF. Algorithms for Discovery of Multiple Markov Boundaries. J Mach Learn Res. 2013;14:499–566.PubMedPubMedCentral Statnikov A, Lytkin NI, Lemeire J, Aliferis CF. Algorithms for Discovery of Multiple Markov Boundaries. J Mach Learn Res. 2013;14:499–566.PubMedPubMedCentral
21.
go back to reference Breiman L. Statistical modeling: the two cultures. Stat Sci. 2001;16(3):199–215.CrossRef Breiman L. Statistical modeling: the two cultures. Stat Sci. 2001;16(3):199–215.CrossRef
23.
go back to reference Galatzer-Levy IR, Karstoft KI, Statnikov A, Shalev AY. Quantitative forecasting of PTSD from early trauma responses: a Machine Learning application. J Psychiatr Res. 2014;59:68–76.CrossRefPubMedPubMedCentral Galatzer-Levy IR, Karstoft KI, Statnikov A, Shalev AY. Quantitative forecasting of PTSD from early trauma responses: a Machine Learning application. J Psychiatr Res. 2014;59:68–76.CrossRefPubMedPubMedCentral
24.
go back to reference Boser BE, Guyon IM, Vapnik VN. A training algorithm for optimal margin classifiers. In: Proceedings of the fifth annual workshop on Computational learning theory (COLT '92). New York, NY, USA: ACM; 1992. 144-152. doi:10.1145/130385.130401. Boser BE, Guyon IM, Vapnik VN. A training algorithm for optimal margin classifiers. In: Proceedings of the fifth annual workshop on Computational learning theory (COLT '92). New York, NY, USA: ACM; 1992. 144-152. doi:10.1145/130385.130401.
25.
go back to reference Galatzer-Levy IR, Ankri Y, Freedman S, Israeli-Shalev Y, Roitman P, Gilad M, et al. Early PTSD Symptom Trajectories: Persistence, Recovery, and Response to Treatment: Results from the Jerusalem Trauma Outreach and Prevention Study (J-TOPS). PLoS One. 2013;8(8):e70084. Galatzer-Levy IR, Ankri Y, Freedman S, Israeli-Shalev Y, Roitman P, Gilad M, et al. Early PTSD Symptom Trajectories: Persistence, Recovery, and Response to Treatment: Results from the Jerusalem Trauma Outreach and Prevention Study (J-TOPS). PLoS One. 2013;8(8):e70084.
26.
go back to reference Shalev AY, Ankri Y, Israeli-Shalev Y, Peleg T, Adessky R, Freedman S. Prevention of posttraumatic stress disorder by early treatment: results from the Jerusalem Trauma Outreach And Prevention study. Arch Gen Psychiatry. 2012;69(2):166–76.CrossRefPubMed Shalev AY, Ankri Y, Israeli-Shalev Y, Peleg T, Adessky R, Freedman S. Prevention of posttraumatic stress disorder by early treatment: results from the Jerusalem Trauma Outreach And Prevention study. Arch Gen Psychiatry. 2012;69(2):166–76.CrossRefPubMed
27.
go back to reference Shalev AY, Ankri YL, Peleg T, Israeli-Shalev Y, Freedman S. Barriers to receiving early care for PTSD: results from the Jerusalem trauma outreach and prevention study. Psychiatr Serv. 2011;62(7):765–73.CrossRefPubMed Shalev AY, Ankri YL, Peleg T, Israeli-Shalev Y, Freedman S. Barriers to receiving early care for PTSD: results from the Jerusalem trauma outreach and prevention study. Psychiatr Serv. 2011;62(7):765–73.CrossRefPubMed
28.
go back to reference Foa EB, Tolin DF. Comparison of the PTSD Symptom Scale-Interview Version and the Clinician-Administered PTSD scale. J Trauma Stress. 2000;13(2):181–91.CrossRefPubMed Foa EB, Tolin DF. Comparison of the PTSD Symptom Scale-Interview Version and the Clinician-Administered PTSD scale. J Trauma Stress. 2000;13(2):181–91.CrossRefPubMed
29.
go back to reference Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32(6):959–76.CrossRefPubMed Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32(6):959–76.CrossRefPubMed
30.
go back to reference Bryant RA, Moulds ML, Guthrie RM. Acute Stress Disorder Scale: a self-report measure of acute stress disorder. Psychol Assess. 2000;12(1):61–8.CrossRefPubMed Bryant RA, Moulds ML, Guthrie RM. Acute Stress Disorder Scale: a self-report measure of acute stress disorder. Psychol Assess. 2000;12(1):61–8.CrossRefPubMed
31.
go back to reference Guy W. Clinical global impression scale. The ECDEU Assessment Manual for Psychopharmacology-Revised Volume DHEW Publ No ADM 76. 1976;338:218–22. Guy W. Clinical global impression scale. The ECDEU Assessment Manual for Psychopharmacology-Revised Volume DHEW Publ No ADM 76. 1976;338:218–22.
32.
go back to reference Foa EB, Ehlers A, Clark DM, Tolin DF, Orsillo SM. The Posttraumatic Cognitions Inventory (PTCI): Development and validation. Psychol Assess. 1999;11(3):303–14.CrossRef Foa EB, Ehlers A, Clark DM, Tolin DF, Orsillo SM. The Posttraumatic Cognitions Inventory (PTCI): Development and validation. Psychol Assess. 1999;11(3):303–14.CrossRef
33.
go back to reference Lazarus RS, Folkman S. Stress, Appraisal, and Coping. New York: Springer; 1984. Lazarus RS, Folkman S. Stress, Appraisal, and Coping. New York: Springer; 1984.
34.
go back to reference Bryant RA, O'Donnell ML, Creamer M, McFarlane AC, Silove D: A Multisite Analysis of the Fluctuating Course of Posttraumatic Stress Disorder. JAMA psychiatry (Chicago, Ill.). Jun 19 2013:1–8 Bryant RA, O'Donnell ML, Creamer M, McFarlane AC, Silove D: A Multisite Analysis of the Fluctuating Course of Posttraumatic Stress Disorder. JAMA psychiatry (Chicago, Ill.). Jun 19 2013:1–8
35.
go back to reference Statnikov A, Tsamardinos I, Brown LE, Aliferis CF. Causal Explorer: A Matlab Library of Algorithms for Causal Discovery and Variable Selection for Classification. In: Guyon IM, Aliferis CF, Cooper GF, editors. Challenges in Machine Learning Volume 2: Causation and Prediction Challenge. Bookline, Massachusetts: Microtome Publishing; 2010. p. 267–78. Statnikov A, Tsamardinos I, Brown LE, Aliferis CF. Causal Explorer: A Matlab Library of Algorithms for Causal Discovery and Variable Selection for Classification. In: Guyon IM, Aliferis CF, Cooper GF, editors. Challenges in Machine Learning Volume 2: Causation and Prediction Challenge. Bookline, Massachusetts: Microtome Publishing; 2010. p. 267–78.
36.
go back to reference Chang C-C, Lin C-J, LIBSVM. A library for support vector machines. ACM Trans Intell Syst Technol. 2011;2(3):1–27.CrossRef Chang C-C, Lin C-J, LIBSVM. A library for support vector machines. ACM Trans Intell Syst Technol. 2011;2(3):1–27.CrossRef
37.
go back to reference Bradley AP. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recogn. 1997;30(7):15.CrossRef Bradley AP. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recogn. 1997;30(7):15.CrossRef
38.
go back to reference Shalev AY, Freedman S. PTSD following terrorist attacks: a prospective evaluation. Am J Psychiatry. 2005;162(6):1188–91.CrossRefPubMed Shalev AY, Freedman S. PTSD following terrorist attacks: a prospective evaluation. Am J Psychiatry. 2005;162(6):1188–91.CrossRefPubMed
39.
go back to reference Freedman SA, Brandes D, Peri T, Shalev A. Predictors of chronic post-traumatic stress disorder. A prospective study. Br J Psychiatry. 1999;174:353–9.CrossRefPubMed Freedman SA, Brandes D, Peri T, Shalev A. Predictors of chronic post-traumatic stress disorder. A prospective study. Br J Psychiatry. 1999;174:353–9.CrossRefPubMed
40.
go back to reference Breslau N, Chilcoat HD, Kessler RC, Davis GC. Previous exposure to trauma and PTSD effects of subsequent trauma: results from the Detroit Area Survey of Trauma. Am J Psychiatry. 1999;156(6):902–7.CrossRefPubMed Breslau N, Chilcoat HD, Kessler RC, Davis GC. Previous exposure to trauma and PTSD effects of subsequent trauma: results from the Detroit Area Survey of Trauma. Am J Psychiatry. 1999;156(6):902–7.CrossRefPubMed
41.
go back to reference Koenen KC, Harley R, Lyons MJ, Wolfe J, Simpson JC, Goldberg J, et al. A twin registry study of familial and individual risk factors for trauma exposure and posttraumatic stress disorder. J Nerv Ment Dis. 2002;190(4):209–18.CrossRefPubMed Koenen KC, Harley R, Lyons MJ, Wolfe J, Simpson JC, Goldberg J, et al. A twin registry study of familial and individual risk factors for trauma exposure and posttraumatic stress disorder. J Nerv Ment Dis. 2002;190(4):209–18.CrossRefPubMed
42.
go back to reference Shalev AY, Videlock EJ, Peleg T, Segman R, Pitman RK, Yehuda R. Stress hormones and post-traumatic stress disorder in civilian trauma victims: a longitudinal study. Part I: HPA axis responses. Int J Neuropsychopharmacol. 2008;11(03):365–72.CrossRefPubMed Shalev AY, Videlock EJ, Peleg T, Segman R, Pitman RK, Yehuda R. Stress hormones and post-traumatic stress disorder in civilian trauma victims: a longitudinal study. Part I: HPA axis responses. Int J Neuropsychopharmacol. 2008;11(03):365–72.CrossRefPubMed
43.
go back to reference Binder EB, Bradley RG, Liu W, Epstein MP, Deveau TC, Mercer KB, et al. Association of fkbp5 polymorphisms and childhood abuse with risk of posttraumatic stress disorder symptoms in adults. JAMA. 2008;299(11):1291–305.CrossRefPubMedPubMedCentral Binder EB, Bradley RG, Liu W, Epstein MP, Deveau TC, Mercer KB, et al. Association of fkbp5 polymorphisms and childhood abuse with risk of posttraumatic stress disorder symptoms in adults. JAMA. 2008;299(11):1291–305.CrossRefPubMedPubMedCentral
44.
go back to reference Boscarino JA, Erlich PM, Hoffman SN, Zhang X. Higher FKBP5, COMT, CHRNA5, and CRHR1 allele burdens are associated with PTSD and interact with trauma exposure: implications for neuropsychiatric research and treatment. Neuropsychiatr Dis Treat. 2012;8:131–9.CrossRefPubMedPubMedCentral Boscarino JA, Erlich PM, Hoffman SN, Zhang X. Higher FKBP5, COMT, CHRNA5, and CRHR1 allele burdens are associated with PTSD and interact with trauma exposure: implications for neuropsychiatric research and treatment. Neuropsychiatr Dis Treat. 2012;8:131–9.CrossRefPubMedPubMedCentral
45.
go back to reference Visweswaran S, Angus DC, Hsieh M, Weissfeld L, Yealy D, Cooper GF. Learning patient-specific predictive models from clinical data. J Biomed Inform. 2010;43(5):669–85.CrossRefPubMedPubMedCentral Visweswaran S, Angus DC, Hsieh M, Weissfeld L, Yealy D, Cooper GF. Learning patient-specific predictive models from clinical data. J Biomed Inform. 2010;43(5):669–85.CrossRefPubMedPubMedCentral
Metadata
Title
Bridging a translational gap: using machine learning to improve the prediction of PTSD
Authors
Karen-Inge Karstoft
Isaac R Galatzer-Levy
Alexander Statnikov
Zhiguo Li
Arieh Y Shalev
For members of the Jerusalem Trauma Outreach and Prevention Study (J-TOPS) group
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2015
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-015-0399-8

Other articles of this Issue 1/2015

BMC Psychiatry 1/2015 Go to the issue