Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

Changes in affect after completing a mailed survey about trauma: two pre- and post-test studies in former disability applicants for posttraumatic stress disorder

Authors: Maureen Murdoch, Shannon Marie Kehle-Forbes, Melissa Ruth Partin

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

One potential concern with using mailed surveys containing trauma-related content is the possibility of re-traumatizing survivors without a trained mental health professional present. Prior research provides insufficient guidance regarding the prevalence and magnitude of this risk because the psychological harms of trauma-related surveys have typically been estimated using single post-test observations. Post-test observations cannot quantify magnitude of change in participants’ emotional states and may over or under estimate associations between participants’ characteristics (risk factors) and post-survey upset.

Methods

We conducted two pre- and post-test studies in samples of former applicants for posttraumatic stress disorder disability benefits: 191 males who served during Gulf War I plus 639 male and 921 female Veterans who served sometime between 1955 and 1998. We used two 9-point items from the Self-Assessment Manikins to measure participants’ valence (sadness/happiness) and arousal (tenseness/calmness) before and after they completed mailed surveys asking about trauma-related symptoms or experiences. We examined the following potential predictors for post-survey sadness and tenseness: screening positive for posttraumatic stress disorder, having a serious mental illness, and history of military sexual assault or combat.

Results

After the survey, across the groups, 29.3–41.8% were sadder, 45.3–52.2% had no change in valence, and 12.9–22.5% were happier; 31.7–40.2% were tenser, 40.6–48.2% had no change in arousal, and 17.3–24.0% were calmer. The mean increase in sadness or tenseness post-survey was less than one point in all groups (SD’s < 1.7). Cohen’s d ranged from 0.07 to 0.30. Most hypothesized predictors were associated with greater baseline sadness or tenseness, but not necessarily with larger post-survey changes. Women with a history of military sexual assault had the largest net post-survey changes in sadness (mean = 0.7, SD = 1.4) and tenseness (mean = 0.6, SD = 1.6).

Conclusion

While a substantial minority of Veterans reported more sadness or tenseness post-survey, the net change in affect was small. Most hypothesized risk factors were actually associated with higher baseline sadness or tenseness scores. When receiving unsolicited, trauma-related surveys by mail, separate protections for Veterans with the risk factors studied here do not seem necessary.
Appendix
Available only for authorised users
Literature
1.
go back to reference Moum T. Mode of administration and interviewer effects in self-reported symptoms of anxiety and depression. Soc Indic Res. 1998;45(1–3):279–318.CrossRef Moum T. Mode of administration and interviewer effects in self-reported symptoms of anxiety and depression. Soc Indic Res. 1998;45(1–3):279–318.CrossRef
2.
go back to reference Richman WL, Kiesler S, Weisband S, Drasgow F. A meta-analytic study of social desirability distortion in computer-administered questionnaires, traditional questionnaires, and interviews. J Appl Psychol. 1999;84(5):754–75.CrossRef Richman WL, Kiesler S, Weisband S, Drasgow F. A meta-analytic study of social desirability distortion in computer-administered questionnaires, traditional questionnaires, and interviews. J Appl Psychol. 1999;84(5):754–75.CrossRef
3.
go back to reference Rogers SM, Miller HG, Turner CF. Effects of interview mode on bias in survey measurements of drug use: do respondent characteristics make a difference? Subst Use Misuse. 1998;33(10):2179–200.CrossRefPubMed Rogers SM, Miller HG, Turner CF. Effects of interview mode on bias in survey measurements of drug use: do respondent characteristics make a difference? Subst Use Misuse. 1998;33(10):2179–200.CrossRefPubMed
4.
go back to reference Beebe T, Harrison P, Park E, McRae JJ, Evans J. The effects of data collection mode and disclosure on adolescent reporting of health behavior. Soc Sci Computer Rev. 2006;24(4):476–88.CrossRef Beebe T, Harrison P, Park E, McRae JJ, Evans J. The effects of data collection mode and disclosure on adolescent reporting of health behavior. Soc Sci Computer Rev. 2006;24(4):476–88.CrossRef
7.
go back to reference Halek K, Murdoch M, Fortier L. Spontaneous reports of emotional upset and health care utilization among veterans with posttraumatic stress disorder (PTSD) after receiving a potentially upsetting survey. Am J Orthopsychiatry. 2005;75(1):142–51.CrossRefPubMed Halek K, Murdoch M, Fortier L. Spontaneous reports of emotional upset and health care utilization among veterans with posttraumatic stress disorder (PTSD) after receiving a potentially upsetting survey. Am J Orthopsychiatry. 2005;75(1):142–51.CrossRefPubMed
8.
go back to reference Newman E, Willard T, Sinclair R, Kaloupek D. Empirically supported ethical research practice: the costs and benefits of research from the participants’ view. Account Res. 2001;8:309–29.CrossRefPubMed Newman E, Willard T, Sinclair R, Kaloupek D. Empirically supported ethical research practice: the costs and benefits of research from the participants’ view. Account Res. 2001;8:309–29.CrossRefPubMed
9.
go back to reference Jorm A, Kelly C, Morgan A. Participant distress in psychiatric research: a systematic review. Psychol Med. 2007;37:917–26.CrossRefPubMed Jorm A, Kelly C, Morgan A. Participant distress in psychiatric research: a systematic review. Psychol Med. 2007;37:917–26.CrossRefPubMed
10.
go back to reference Jaffe A, DiLillo D, Hoffman L, Haikalis M, Dykstra R. Does it hurt to ask? A meta-analysis of participant reactions to trauma research. Clin Psychol Rev. 2015;40:40–56.CrossRefPubMed Jaffe A, DiLillo D, Hoffman L, Haikalis M, Dykstra R. Does it hurt to ask? A meta-analysis of participant reactions to trauma research. Clin Psychol Rev. 2015;40:40–56.CrossRefPubMed
11.
go back to reference Newman E, Wlaker E, Gefland A. Assessing the ethical costs and benefits of trauma-focused research. Gen Hosp Psychiatry. 1999;21(3):187–96.CrossRefPubMed Newman E, Wlaker E, Gefland A. Assessing the ethical costs and benefits of trauma-focused research. Gen Hosp Psychiatry. 1999;21(3):187–96.CrossRefPubMed
12.
go back to reference Sandberg A, Murdoch M, Polusny M, Grill J. Reactions to a survey among those who were and were not sexually assaulted while serving in the military. Psychol Rep. 2012;110(2):461–8.CrossRefPubMed Sandberg A, Murdoch M, Polusny M, Grill J. Reactions to a survey among those who were and were not sexually assaulted while serving in the military. Psychol Rep. 2012;110(2):461–8.CrossRefPubMed
13.
go back to reference Walker EA, Newman E, Koss M, Bernstein D. Does the study of victimization revictimize the victims? Gen Hosp Psychiatry. 1997;19(6):403–10.CrossRefPubMed Walker EA, Newman E, Koss M, Bernstein D. Does the study of victimization revictimize the victims? Gen Hosp Psychiatry. 1997;19(6):403–10.CrossRefPubMed
14.
go back to reference Murdoch M, Hodges J, Cowper D, Fortier L, Van Ryn M. Racial disparities in VA service connection for posttraumatic stress disorder disability. Med Care. 2003;41(4):536–49.PubMed Murdoch M, Hodges J, Cowper D, Fortier L, Van Ryn M. Racial disparities in VA service connection for posttraumatic stress disorder disability. Med Care. 2003;41(4):536–49.PubMed
15.
go back to reference Murdoch M, Hodges J, Hunt C, Cowper D, Kressin N, O’Brien N. Gender differences in service connection for PTSD. Med Care. 2003;41(8):950–61.CrossRefPubMed Murdoch M, Hodges J, Hunt C, Cowper D, Kressin N, O’Brien N. Gender differences in service connection for PTSD. Med Care. 2003;41(8):950–61.CrossRefPubMed
16.
go back to reference Murdoch M, Hodges J, Cowper D, Sayer N. Regional variation and other correlates of Department of Veterans Affairs (VA) disability awards for posttraumatic stress disorder. Med Care. 2005;43(2):112–21.CrossRefPubMed Murdoch M, Hodges J, Cowper D, Sayer N. Regional variation and other correlates of Department of Veterans Affairs (VA) disability awards for posttraumatic stress disorder. Med Care. 2005;43(2):112–21.CrossRefPubMed
17.
go back to reference Murdoch M, Sayer N, Spoont M, Rosenheck R, Noorbaloochi S, Griffin J, Arbisi P, Hagel E. Long-term outcomes of disability benefits in US Veterans with posttraumatic stress disorder. Arch Gen Psychiatry. 2011;68(10):1072–80.CrossRefPubMed Murdoch M, Sayer N, Spoont M, Rosenheck R, Noorbaloochi S, Griffin J, Arbisi P, Hagel E. Long-term outcomes of disability benefits in US Veterans with posttraumatic stress disorder. Arch Gen Psychiatry. 2011;68(10):1072–80.CrossRefPubMed
18.
go back to reference Murdoch M, Spoont M, Kehle-Forbes S, Harwood E, Sayer N, Clothier B, Bangerter A. Persistent serious mental illness among former applicants for VA PTSD disability benefits and long-term outcomes: symptoms, functioning, and employment. J Trauma Stress. 2017;30(1):36–44.CrossRefPubMed Murdoch M, Spoont M, Kehle-Forbes S, Harwood E, Sayer N, Clothier B, Bangerter A. Persistent serious mental illness among former applicants for VA PTSD disability benefits and long-term outcomes: symptoms, functioning, and employment. J Trauma Stress. 2017;30(1):36–44.CrossRefPubMed
19.
go back to reference Murdoch M, Simon A, Polusny M, Bangerter A, Grill J, Noorbaloochi S, Partin M. Randomized controlled trial using pre-merged questionnaires showed that different tracking/privacy conditions and incentives yielded distinctive subpopulations of respondents. BMC Med Res Methodol. 2014;14:90.CrossRefPubMedPubMedCentral Murdoch M, Simon A, Polusny M, Bangerter A, Grill J, Noorbaloochi S, Partin M. Randomized controlled trial using pre-merged questionnaires showed that different tracking/privacy conditions and incentives yielded distinctive subpopulations of respondents. BMC Med Res Methodol. 2014;14:90.CrossRefPubMedPubMedCentral
20.
go back to reference Posner J, Russell J, Peterson B. The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev Psychopathol. 2005;17(3):715–34.CrossRefPubMedPubMedCentral Posner J, Russell J, Peterson B. The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev Psychopathol. 2005;17(3):715–34.CrossRefPubMedPubMedCentral
21.
go back to reference Bradley M, Lang P. Measuring emotion: the Self-Assessment Manikin and the semantic differential. J Behav Ther & Exp Psychiat. 1994;25(1):49–59.CrossRef Bradley M, Lang P. Measuring emotion: the Self-Assessment Manikin and the semantic differential. J Behav Ther & Exp Psychiat. 1994;25(1):49–59.CrossRef
22.
go back to reference Hammarberg M. Penn Inventory for Posttraumatic Stress Disorder: psychometric properties. Psychol Assess. 1992;4(1):67–76.CrossRef Hammarberg M. Penn Inventory for Posttraumatic Stress Disorder: psychometric properties. Psychol Assess. 1992;4(1):67–76.CrossRef
23.
go back to reference Janes G, Goldberg J, Eisen S, True W. Reliability and validity of a Combat Exposure Index for Vietnam veterans. J Clin Psychol. 1991;47:80–6.CrossRefPubMed Janes G, Goldberg J, Eisen S, True W. Reliability and validity of a Combat Exposure Index for Vietnam veterans. J Clin Psychol. 1991;47:80–6.CrossRefPubMed
24.
go back to reference Murdoch M, McGovern P. Development and validation of the Sexual Harassment Inventory. Violence Vict. 1998;13(3):203–16.PubMed Murdoch M, McGovern P. Development and validation of the Sexual Harassment Inventory. Violence Vict. 1998;13(3):203–16.PubMed
25.
go back to reference Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Lawrence Erlbaum Assoc.: Hillsdale; 1988. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Lawrence Erlbaum Assoc.: Hillsdale; 1988.
26.
go back to reference Morris J, Boone M. The effects of music on emotional response, brand attitude, and purchase intent in an emotional advertising condition. Adv Consum Res. 1998;25:518–26. Morris J, Boone M. The effects of music on emotional response, brand attitude, and purchase intent in an emotional advertising condition. Adv Consum Res. 1998;25:518–26.
27.
go back to reference Ekkekakis P, Hall E, VanLanduyt L, Petruzzello S. Walking in (affective) circles: can short walks enhance affect? J Behav Med. 2000;23(3):245–75.CrossRefPubMed Ekkekakis P, Hall E, VanLanduyt L, Petruzzello S. Walking in (affective) circles: can short walks enhance affect? J Behav Med. 2000;23(3):245–75.CrossRefPubMed
28.
go back to reference Ferrier-Auerbach A, Erbes C, Polusny M. Does trauma survey research cause more distress than other types of survey research? J Trauma Stress. 2009;22(4):320–3.CrossRefPubMed Ferrier-Auerbach A, Erbes C, Polusny M. Does trauma survey research cause more distress than other types of survey research? J Trauma Stress. 2009;22(4):320–3.CrossRefPubMed
29.
go back to reference Savell J, Kinder B, Young M. Effects of administering sexually explicit questionnaires on anger, anxiety, and depression in sexually abused and nonabused females: implications for risk assessment. J Sex Marital Therap. 2006;32:161–72.CrossRef Savell J, Kinder B, Young M. Effects of administering sexually explicit questionnaires on anger, anxiety, and depression in sexually abused and nonabused females: implications for risk assessment. J Sex Marital Therap. 2006;32:161–72.CrossRef
30.
go back to reference Rojas A, Kinder B. Effects of completing sexual questionnaires in males and females with histories of childhood sexual abuse: implications for institutional review boards. J Sex Marital Therap. 2007;33:193–201.CrossRef Rojas A, Kinder B. Effects of completing sexual questionnaires in males and females with histories of childhood sexual abuse: implications for institutional review boards. J Sex Marital Therap. 2007;33:193–201.CrossRef
31.
go back to reference Knowles E, Coker M, Scott R, Cook D, Neville J. Measurement-induced improvement in anxiety: mean shifts with repeated assessment. J Pers Soc Psychol. 1996;71(2):352–63.CrossRefPubMed Knowles E, Coker M, Scott R, Cook D, Neville J. Measurement-induced improvement in anxiety: mean shifts with repeated assessment. J Pers Soc Psychol. 1996;71(2):352–63.CrossRefPubMed
32.
go back to reference Labott S, Johnson T, Fendrich M, Feeny N. Emotional risks to respondents in survey research: some empirical evidence. J Empir Res Hum Res Ethics. 2013;8(4):53–66.CrossRefPubMedPubMedCentral Labott S, Johnson T, Fendrich M, Feeny N. Emotional risks to respondents in survey research: some empirical evidence. J Empir Res Hum Res Ethics. 2013;8(4):53–66.CrossRefPubMedPubMedCentral
33.
go back to reference Desmet P, Overbeeke C, Tax S. Designing products with added emotional value: develoment and application of an approach for research through design. The Design Journal. 2001;4(1):32–47.CrossRef Desmet P, Overbeeke C, Tax S. Designing products with added emotional value: develoment and application of an approach for research through design. The Design Journal. 2001;4(1):32–47.CrossRef
34.
go back to reference Isomursu M, Tahiti M, Vainamo S, Kuuttii K. Experimental evaluation of five methods for collecting emotions in field settings with mobile applications. Int J Human Computer Studies. 2007;65:404–18.CrossRef Isomursu M, Tahiti M, Vainamo S, Kuuttii K. Experimental evaluation of five methods for collecting emotions in field settings with mobile applications. Int J Human Computer Studies. 2007;65:404–18.CrossRef
35.
go back to reference Hogarth R, Portell M, Cuxart A, Kolev G. Emotion and reason in everyday risk perception. J Behav Decision Making. 2011;24:202–22.CrossRef Hogarth R, Portell M, Cuxart A, Kolev G. Emotion and reason in everyday risk perception. J Behav Decision Making. 2011;24:202–22.CrossRef
Metadata
Title
Changes in affect after completing a mailed survey about trauma: two pre- and post-test studies in former disability applicants for posttraumatic stress disorder
Authors
Maureen Murdoch
Shannon Marie Kehle-Forbes
Melissa Ruth Partin
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0357-x

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue