Neuropsychological characteristics of Gulf War illness: A meta-analysis

Patricia A. Janulewicz; Maxine H. Krengel; Alexis Maule; Roberta F. White; Joanna Cirillo; Emily Sisson; Timothy Heeren; Kimberly Sullivan

doi:10.1371/journal.pone.0177121

Abstract

Objective

Gulf War illness (GWI) is a disorder related to military service in the 1991 GW. Prominent symptoms include fatigue, pain and cognitive problems. These symptoms were reported by GW Veterans (GWV) immediately after the war and were eventually incorporated into case definitions of GWI. Neuropsychological function in GW veterans has been studied both among deployed GWV and in GWV diagnosed with GWI. Results have been inconsistent between and across GW populations. The purpose of the present investigation was to better characterize neuropsychological function in this veteran population.

Methods

Meta-analysis techniques were applied to published studies on neuropsychological performance in GWV to identify domains of dysfunction in deployed vs. non-deployed GW-era veterans and symptomatic vs. non-symptomatic GWVs.

Results

Significantly decreased performance was found in three functional domains: attention and executive function, visuospatial skills and learning/memory.

Conclusions

These findings document the cognitive decrements associated with GW service, validate current GWI case definitions using cognitive criteria, and identify test measures for use in GWI research assessing GWI treatment trial efficacy.

Citation: Janulewicz PA, Krengel MH, Maule A, White RF, Cirillo J, Sisson E, et al. (2017) Neuropsychological characteristics of Gulf War illness: A meta-analysis. PLoS ONE 12(5): e0177121. https://doi.org/10.1371/journal.pone.0177121

Editor: Linda Chao, University of California, San Francisco, UNITED STATES

Received: November 15, 2016; Accepted: April 21, 2017; Published: May 17, 2017

Copyright: © 2017 Janulewicz et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All data used in this meta-analysis have been published.

Funding: This work was supported by the Congressionally Directed Medical Research Program (Award number: W81XWH-13-2-0072; http://cdmrp.army.mil/).

Competing interests: The authors have declared that no competing interests exist.

Introduction

A subset of veterans of the 1991 Gulf War (GW) developed a chronic health disorder, now generally referred to as Gulf War Illness (GWI)[1], but sometimes also referred to by the name of one of the case definitions of the disorder, chronic multi-symptom illness (CMI). GWI afflicts 25–32% of the 697,000 veterans who deployed to the GW theater[2, 3]. It is associated with several concomitant symptoms, including fatigue, joint pain, sleep disturbance, gastrointestinal problems, headaches, skin rashes and cognitive complaints[1, 2]. Substantial evidence has accumulated over the past two decades demonstrating a link between deployment to the Persian Gulf region during Operation Desert Shield/ Desert Storm and developing GWI[4], as well as links between specific chemical exposures in the GW and risk of becoming ill (White et al., 2016, RAC 2014). Furthermore, longitudinal studies on this veteran population conclude that most GW veterans (GWV) with GWI have not improved since returning from deployment and may be getting worse over time[3]. Cognitive problems constitute one of the most prevalent symptoms reported by GWV[5, 6]. A recent publication showed that in GWV who met criteria for GWI, nearly all reported at least one mood-cognition symptom[5]. In addition, a study examining a large population-based cohort of 1,200 GWV (with and without GWI) concluded that at least half reported cognitive symptoms[6]. These symptoms, plus substantial neuropsychological, neuroimaging and neurophysiological research, suggest that central nervous system (CNS) dysfunction is a prominent feature of GWV with health complaints and in GWV who meet case criteria for GWI[3, 7, 8]. However, there has been controversy in the field whether these self-reported cognitive symptoms relate to decrements on objective cognitive tests measures, particularly with respect to memory complaints[9–11]

The two most widely accepted case definitions of GWI are chronic multi-symptom illness[12] (CMI), developed by the Centers for Disease Control and Prevention (CDC), and the Kansas GWI definition[7, 13]. Both were recently recommended by the National Academy of Sciences Institute of Medicine (IOM), which concluded that CMI is appropriate for clinical diagnosis while the Kansas definition is more rigorous and especially appropriate for research. Both case definitions include mood/cognition/neurological symptom report as a key criterion[13]. The CDC case definition requires self-report of one or more symptoms that last for at least six months in two of three categories: fatigue, musculoskeletal pain, and mood/cognition[12]. The Kansas definition requires moderate levels of self-reported symptoms in at least three out of six symptom categories: fatigue/sleep, pain, neurological/cognitive/mood, respiratory, gastrointestinal and skin[7]. These case definitions rely on self-reports of cognitive dysfunction.

Another approach to investigating cognitive dysfunction in GWV has been to evaluate domain-specific neuropsychological function in subgroups of GWV. However, findings across the neuropsychological studies on this population are inconsistent. This is due, in large part, to the variability in study designs. A major difference among the studies has involved the type of subpopulations used as the ill GWV group and controls (Table 1). Early on, researchers did not have a case definition for GWI, so comparisons were made between “symptomatic” and “non-symptomatic” deployed GWVs (defined in various ways)[14–18] or between deployed GWV (some of whom were ill and some of whom were not) and non-deployed era veterans[3, 18–22]. In other studies, GWV test performance was compared to normative populations[23–25]. A few studies examined neuropsychological performance among GWVs with specific chemical exposures in theater to those without such exposures[22, 26, 27]. In addition, some of the populations studied were quite small, leading to insufficient power to detect subtle differences in test performance[15, 17]. Finally, different investigators explored different domains of neuropsychological function or assessed the same domain with differing test instruments.

Download:

Table 1. Summary of 14 studies included in the meta-analysis.

https://doi.org/10.1371/journal.pone.0177121.t001

Findings from several studies showed reduced performance in GWV populations. Axelrod and colleagues[23] examined neuropsychological performance in 44 GWVs and compared their results to normative data, reporting significant reductions in GWV performance on two motor tasks and a measure of executive function. Goldstein and colleagues[24] examined 21 GWV and compared their neuropsychological performance to 38 nonveteran demographically matched controls. An impairment index combining results from 14 tests including a continuous performance test showed a significant difference with GWV performing worse than controls. Hom and colleagues[14] conducted a battery of neuropsychological tests with 24 symptomatic GWV and 20 healthy GWV. Significantly reduced performance in the symptomatic GWVs was found on a combined Impairment Index and several subtest scores from the Verbal, Performance and Full-Scale WAIS-R IQ. Lange and colleagues examined 48 symptomatic GWV compared to 39 healthy GWV on neuropsychological performance. Significant differences in the motor, attention and executive function domains were seen, with symptomatic veterans performing worse than the healthy veterans. Toomey and colleagues[20] assessed 1061 deployed and 1128 non-deployed GWV, with an extensive neuropsychological test battery. Statistically significant differences were seen on tests of attention, executive functioning and learning and memory including individual tests differences on Trail making Test (TMT), the Continuous Performance Test (CPT) and California Verbal Learning Test (CVLT) with deployed veterans performing worse than non-deployed veterans, although only TMT part B remain statistically significant following corrections for multiple comparisons.

Some studies found no statistically significant reductions in performance of GWV. Forty-nine Army Reserve Military Police GWVs were examined with a battery of neuropsychological tests by Sillanpaa and colleagues[25], who tried to predict neuropsychological performance on the battery using a combined exposure history model. Their model failed to predict neuropsychological test outcomes. Proctor and colleagues[8] examined male Danish GWVs, assessing mood and neuropsychological performance by comparing deployed (N = 143) to non-deployed (N = 72) veterans. No significant neurocogntive differences were seen between the two groups although mood complaints, particularly fatigue and confusion, were higher in the deployed group. In a study of 341 United Kingdom GWVs researchers[18] found significantly decreased performance in symptomatic GWV compared to healthy Gulf War veterans. However, these differences lost significance after adjusting for multiple comparisons or depressed mood. Wallin et al[17]., compared symptomatic GWV (N = 25) and healthy GWV controls (N = 16) on a battery of neuropsychological tests. No statistically significant differences in composite functional domain scores were seen between the two groups of deployed veterans in this small study sample.

Results from some studies also revealed differences in GWV neuropsychological performance once in-theater environmental exposures were taken into consideration. White and colleagues[28] examined neuropsychological performance in deployed GWV (N = 193) and non-deployed GW-era veterans (N = 47). Differences were found between the groups but they were no longer significant after adjusting for multiple comparisons with the exception of mood complaints, which remained higher in deployed GWV. However, when the deployed GWV reporting chemical warfare agents were compared with those not reporting such exposures, significant reductions in neuropsychological performance in memory, and executive function and increased mood complaints were seen in exposed GWV. Sullivan and colleagues[21] conducted a study comparing neuropsychological performance in treatment-seeking GWV (N = 207) to treatment-seeking non-deployed Gulf-era veterans (N = 57). Findings showed worse performance in the treatment seeking GWV in the attention, visuospatial, learning and memory and mood domains. Additionally, when GWV with PB exposure were compared in the GW-deployed group, to those who did not report taking PB, the exposed group performed significantly worse on a task of executive functioning. Chao et al.,[26, 27] conducted two studies, using separate cohorts, specifically examining neuropsychological and neuroimaging data in GWV exposed to sarin/cyclosarin nerve agents compared to unexposed matched GWV controls. The authors report no statistically significant differences between the groups on the neuropsychological test battery but reduced gray matter volumes in the exposed GWV. Using a different study group, a stronger MRI magnet (4T) and a slightly different neuropsychological test battery, results of their second study showed a statistically significant reduction in gray and white matter volumes in 64 exposed and 64 unexposed matched GWV controls and the exposed group performed significantly worse on tests in the attention and motor domains including the CPT, Grooved Pegboard and the TMT Part A.

Given the heterogeneity of approaches to evaluating neuropsychological dysfunction in ill GWV, we applied meta-analytic techniques to the collective examination of the existing neuropsychological literature on GWV. These techniques allow evaluation of each of the neuropsychological domains and of the individual tests within the domain with increased power in order to detect subtle differences between population groups. We approached these analyses by grouping the existing studies in two ways, analyzing the studies that compared deployed GWV as a whole to non-deployed controls and normative populations (Group A analysis) and the studies that compared symptomatic GWV to their GW counter-parts who were not ill (Group B analysis). These two types of studies were viewed as fundamentally different, because the Gulf-deployed versus non-deployed investigations include healthy individuals in the Gulf-deployed group. The studies that included only ill and healthy GWV in their patient populations allowed a view of the types of cognitive dysfunction that characterize GWI more specifically. The ultimate goal of both analyses was to identify the neuropsychological domains of function that show objective evidence of being problematic for GWV, with implications for ultimately refining the case definition of GWI.

Materials and methods

Literature search and exclusion/inclusion criteria

A comprehensive search of the literature using electronic databases, PubMed and PsychINFO as well as published VA Research Advisory Committee on GWV Illnesses (RAC-GWVI) reports, was conducted to extract all relevant research studies. The search was restricted to papers published between January 1992 and May 2015. As shown in Fig 1, the key search terms were selected to identify all studies that assessed cognitive functioning in GW veterans and included the following terms; (Desert Storm, Persian Gulf, gulf war, gulf war illness, gulf war syndrome, gulf war veteran, Persian gulf war) and (neurobehavior, neurobehavioral, neuropsychology, neuropsychological, cognitive, cognition, neurocognitive, neurocognition, mood). The references of each paper were also then examined for additional relevant studies to be included in the analysis. The final selection into the study was based on four criteria. First, the study had to include GWVs who served in the Gulf between 1990 and 1991. Second, the study needed to assess and report results of neuropsychological performance. Third, the results needed to be reported in a usable form for meta-analytic tools. Finally, the population examined could not overlap with any other study to be examined in the meta-analysis. When overlapping populations were identified, the study with the largest population size and breath of test scores was selected for use in the meta-analysis.

Download:

Fig 1. Search strategy for meta-analysis on neuropsychological performance in Gulf War veterans.

From: Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med 6(7): e1000097. doi:10.1371/journal.pmed1000097. For more information, visit www.prisma-statement.org.

https://doi.org/10.1371/journal.pone.0177121.g001

Data extraction

For the studies included in the final model, each underwent a detailed review of neuropsychological data presented. With numerous domains of cognitive function and a plethora of tests available to assess these domains, an extraction procedure was enforced to assure that data from each test were placed in the appropriate domain for analysis. Three members of the research team examined the list of tests administered in all studies[14–21, 23–29] included in the analysis and grouped them into the following domains (Table 2): visuospatial abilities, academic achievement, attention and executive function, learning and memory, and motor skills (Table 2). Data reported outside these domains (e.g. health symptoms and mood) were not examined.

Download:

Table 2. Summary of neuropsychological tests used in studies of Gulf War veterans.

https://doi.org/10.1371/journal.pone.0177121.t002

Descriptive data was extracted from each paper for each individual test administered. Data for the following variables were extracted; total n, % male/female, mean age, mean test score and standard deviation or standard error depending on available data, population definition and GWI symptom definition (Table 1), for both GWV and non-GWV populations. For studies reporting standard deviations, the standard error was calculated prior to analysis.

Meta-analytic procedures

Meta-analyses were performed for cognitive test measures that were reported in 3 or more studies. All cognitive tests examined are raw score variables, and effect sizes for the difference between the two study groups are described using Cohen’s d, the difference between group means divided by the pooled standard deviation. Heterogeneity of difference across studies was tested with the I² statistic. The I² statistic describes the percentage of variation across studies due to heterogeneity rather than chance[30]. I² is calculated from the Q statistic, calculated from the fixed effects inverse variance-weighted model (I² = 100% x (Q-df)/Q). A confidence interval for I² was constructed using the iterative non-central chi-squared distribution method of Hedges and Piggott[31]. I² is an intuitive and simple expression of the inconsistency of studies’ results. Determination to use fixed vs. random effects model was based on a cut-off of 30% for I² –if I² < 30%, then we used a fixed effects model, otherwise we used a random effects model. Forest plots were used to graphically represent the results.

There is currently no consensus on study design among epidemiologists who conduct research on GWI about which study populations are best to compare. Cohorts/populations used included Gulf-deployed vs. non-deployed veterans, Gulf-deployed veterans vs. population norms, and Gulf-deployed symptomatic vs. Gulf-deployed non-symptomatic veterans. There was great variation among the 15 studies included in this analysis in comparison populations. Therefore, two major types of comparison groups were analyzed separately. The Group A analysis utilized studies comparing Gulf-deployed to non-deployed veterans (and population norms), while the Group B analyses assessed studies comparing Gulf-deployed symptomatic vs. Gulf-deployed non-symptomatic veterans. It was not possible to carry out a meta-analysis on studies that examined groups exposed to specific neurotoxicants in theater because of the small number of studies published to-date on this topic.

To evaluate possible effects of publication bias on the main analysis, we used a method described in Levy et al. (2001)[32]. For studies that did not report a result for each individual test or did not administer that particular test, within a cognitive domain that was evaluated in the meta-analysis, a mean difference of zero was assigned to that study and the standard error was assumed to be equivalent to the minimum standard error amongst the studies that reported the individual test result. A new summary mean difference was estimated using a maximum likelihood random-effects model. The bias analysis assumed a maximum of 8 reportable study results for Group A analysis (Gulf-deployed vs. non-deployed) and a maximum of 7 reportable study results for Group B (deployed-ill vs deployed healthy) analysis.

Results

The literature review yielded 238 papers published between January 1992 and May 2015 (Fig 1). Once duplicate studies and those with other military cohorts (Operation Iraqi Freedom/Operation Enduring Freedom) were removed, there were 169 investigations remaining. Review articles, commentaries, non-neurological outcome studies and health symptom studies were excluded, leaving 38 studies for detailed review. Review of the papers was completed by three members of the research team (PAJ, MHK, KS), individually. Differences in review results were resolved through group consensus. Detailed review resulted in exclusions of 24 additional studies that had overlapping populations or no usable data. After all reviews were completed, a total of 14[14–21, 23–29] studies remained for inclusion in the meta-analysis (Fig 1). These studies were then divided into two groups. The Group A analyses compared deployed GWVs to non-deployed populations (8 studies). The Group B studies compared symptomatic GWVs to non-symptomatic GWVs (6 studies).

A total of 25 separate neuropsychological tests have been administered in published studies of GWVs over the past two decades (Table 2). These tests assess visuospatial abilities (3 tests), academic achievement (2 tests), attention and executive function (11 tests), learning and memory (5 tests), and motor skills (4 tests) (Table 2). As summarized in Table 3, there is great variability among the studies analyzed in the neuropsychological domains assessed, tests administered and results. A test met inclusion criteria for the final analysis if three or more studies reported usable data on it. After applying these criteria, the following domains were assessed in both Group A and B: visuospatial abilities (1 test), attention and executive function (2 tests), learning and memory (2 tests) and motor function (2 tests). For Group B, two additional tests were examined, one each in the domains of attention and executive function and academic achievement.

Download:

Table 3. Summary of neuropsychological findings from 14 selected studies.

https://doi.org/10.1371/journal.pone.0177121.t003

A total of 16 neuropsychological tests were examined using meta-analytic tools from a total sample of 14 publications (Tables 4 and 5). Group A had 13 individual neuropsychological tests analyzed. Group B had 8 individual neuropsychological tests. Only neuropsychological outcomes with a sample size of 3 or more studies reporting results were analyzed.

Download:

Table 4. Meta-analysis of Group A studies: Neurocognitive performance for deployed Gulf War veterans compared to non-deployed Gulf-era veterans.

https://doi.org/10.1371/journal.pone.0177121.t004

Download:

Table 5. Meta-analysis of Group B studies: Neurocognitive performance for symptomatic versus non-symptomatic Gulf War veterans.

https://doi.org/10.1371/journal.pone.0177121.t005

Results of the meta-analysis of Group A studies showed statistically significant differences in the domains of visuospatial abilities, attention and executive functioning, and learning and memory (Table 4). Individual test differences included 8 outcomes as follows: visuospatial abilities (Block Designs, SMD: -1.39, 95% CI: -2.45,-0.33), attention and executive function (Digit Span Backwards, SMD: -0.17, 95% CI:-0.25,-0.09; Trail-making Test Part B, seconds, SMD: 0.36, 95% CI:0.20,0.51; Trail-making Test Part A, seconds, SMD: 0.10, 95% CI:0.035,0.18; Digit Span Forward, SMD: -0.07, 95% CI: -0.14,-0.01), and learning and memory (California Verbal Learning Test (CVLT) Trials 1–5, SMD: -0.09, 95% CI: -0.17,-0,02, recognition, SMD:-0.21, 95% CI:-0.29,-0.13. For each of these 8 outcomes the deployed veterans performed worse than the non-deployed. The forest plot for Block Design is given in Fig 2. All 4 studies reporting Block Design showed a negative SMD, indicating poorer performance for GW-deployed veterans, although the size of the effect varied across studies. The random effects model pooled estimate of the SMD showed a large effect of -1.39 with a 95% CI -2.45, -0.33. There was no statistically significant difference in performance in the motor domain. There were not enough Group A studies with usable data on academic achievement to analyze this domain. Academic achievement was generally not hypothesized to be different in the groups and was assessed as a hold measure in the study design.

Download:

Fig 2. Group A, forest plot for block design subtest: Deployed Gulf War veterans compared to non-deployed Gulf-era veterans.

https://doi.org/10.1371/journal.pone.0177121.g002

Meta-analytic comparisons in the Group B studies are shown in Table 5. Statistically significant differences between the groups, with the ill veterans performing worse than the non-ill veterans, were found in the domains of visuospatial abilities (Block Designs, SMD: -0.83, 95% CI: -1.43,-0.24), attention and executive function (Continuous Performance Test Reaction time, milliseconds, SMD: 0.49, 95% CI: 0.26, 0.73), and learning and memory (CVLT long delay total recall, SMD:-0.28, 95% CI:-0.53,-0.02). The forest plots for Block Design and CPT are given in Fig 3a and 3b, respectively. Similar to the Group A studies, the three Group B studies reporting Block Design all showed a negative SMD. The random effects model pooled estimate of the SMD showed a large effect of -0.83 with a 95% CI -1.49, -0.24. Three of the 4 studies reporting CPT showed a positive SMD, indicating poorer performance for the symptomatic veterans. The one study reporting little effect on the CPT had a wide CI, reflecting little precision in this result. The pooled SMD for the CPT showed a moderate effect of 0.49, 95% CI 0.26, 0.79. There were no statistically significant differences in performance in the academic achievement or motor domains.

Download:

Fig 3. Fig 3a Group B, forest plot for block design subtest: Symptomatic versus non-symptomatic Gulf War veterans and Fig 3b Group B forest plot for Continuous Performance Test (CPT) subtest: Symptomatic versus non-symptomatic Gulf War veterans.

https://doi.org/10.1371/journal.pone.0177121.g003

Results of the bias assessment demonstrate that Gulf-deployed veterans performed worse than non-deployed GW era veterans and normative populations on measures of visuospatial abilities, attention and executive functioning and learning and memory, although some subtests were no longer statistically significant (Table 4). The bias assessment for the Group B studies produced similar results: the symptomatic deployed GWVs performed worse than the non-symptomatic deployed GWVs and some of the subtest differences were not statistically significant.

Discussion

Cognitive complaints are one of the most debilitating hallmark symptoms of GWI[3, 5] and over the past 25 years researchers have assessed the nature of the dysfunction associated with the disorder using neuropsychological methods. Although most ill GWV complain of memory and concentration problems, results among the studies published to date have been inconsistent. Despite the number of studies that have utilized neuropsychological measures, it has been unclear which functional domains are most affected and which tests are most sensitive for GWI. This largely reflects the fact that many studies used different test batteries, were underpowered and differed in populations comprising the comparison and control groups.

To our knowledge this is the first meta-analysis conducted to quantify and clarify the neuropsychological profile of GWI. Our results validate previously reported cognitive decrement findings in GWV.[1–3, 9, 14–16, 18–21, 26, 27, 33] Across all neuropsychological tests, the Group A analysis showed that the Gulf-deployed veterans performed worse, with statistically significant reduction in performance on the visuospatial subtest, all four of the attention and executive function outcomes, and two of the six learning and memory subtests. No tests in the motor domain were significantly different between subject groups. In the Group B analysis, the ill veterans performed worse than their healthy counterparts on the visuospatial task, one of the three attention and executive function outcomes, and all of the learning and memory measures. No tests in the motor domain or academic achievement were significantly different. Most of the studies in this meta-analysis used either matched or similar cohorts based on demographics such as age, education and premorbid IQ suggesting that the current study results are robust and indicate differences reflecting deployment to the GW rather than simple demographic differences among the groups. In addition, the visuospatial, executive, attention and learning/memory result differences were expected due to similar patterns in other groups with similar OP pesticide exposures[34–36].

The neuropsychological tests that appeared to show the largest standardized mean difference in both types of population comparisons (Group A and B studies) were the Block Design subtest, Trail-making Test (A), the Continuous Performance Test (CPT) and the California Verbal Learning Test (CVLT). For both meta-analyses, the domains that were significant were the same (attention and executive function, visuospatial, and learning and memory).

Although individual studies among those analyzed for the present paper and within the GWI literature have demonstrated relationships between exposures to specific hazards in the GW theater and neuropsychological outcome[22, 26, 27], there were insufficient numbers of studies with overlapping outcomes to explore exposure effects using our meta-analytic approach.

As with all studies, there were limitations to this meta-analysis. The primary challenge was our inability to assess all neuropsychological tests reported in each of the 14 studies. Not all neuropsychological tests reported in the papers queried could be included in the final model due to small numbers of tests overlapping among studies.

For example, a number of visuospatial tests that were administered in the 14 studies, could be included in this meta-analysis because data were not available from for the same task in at least 3 studies. This was also true for the learning and memory, attention and executive function and motor domains as well. In addition, we were not able to control for potential confounding variables such as age and education in our model because we lacked that data at the individual participant level. Despite these challenges, there were a number of commonly administered outcomes. These include Block Design, TMT, CVLT long delay recall and Grooved Pegboard, dominant hand. Performance on the Block Design task was significantly reduced among GWVs or ill GWVs compared to controls in both meta-analyses, while the grooved pegboard and finger tapping were not significant in any of the comparisons. This suggests that diminished visuospatial functions, but not psychomotor skills, are associated with GW deployment. The Block Design results appear to reflect a predictable outcome because OP exposures are known to be related to visuospatial and visual motor impairments, likely due to cortical and white matter pathway alterations. Specifically, neuroimaging results reporting lower occipital and parietal lobe volumes in GW veterans correspond with these cognitive outcomes[37]. The CVLT long delay recall and CPT reaction time performances were significantly reduced in the GWV vs. ill GWV analyses. Neuroimaging studies reporting lower hippocampal and white matter volumes in GWV are consistent with these findings behavioral outcomes[26, 27, 37].

Meta-analysis of exposure groupings for sarin, pesticides and PB was not possible due to a lack of overlapping tests in the studies that compared exposures and cognitive outcomes. However, results from exposure-related neuropsychological and neuroimaging outcome studies suggest that they are observable neuropathological and neurocognitive consequences of GW-related exposures. Self-report of chemical/biological exposures was significantly associated with verbal memory, visual memory and attention decrements in GW veterans[28]. And a recent MRI study of veterans reporting hearing chemical alarms sound during the war showed a significant inverse relationship between exposure and overall gray matter volumes and reductions in frontal, parietal and occipital lobe volumes[38]. Examination of a large group of sarin-exposed GWV (verified by DOD exposure plume analysis) also reported significant group differences in verbal memory on the CVLT, while MRI studies reported significantly smaller CA2, CA3, dentate gyrus and overall hippocampal volumes in sarin-exposed GWV[20, 26, 37]. An additional sarin exposure study reported decrements on CPT reaction time and omission errors in exposed veterans compared to controls that significantly corresponded with lower white matter volumes in the sarin-exposed veterans[27]. A final study comparing sarin exposure-outcomes in GW veterans reported dose-response decrements in visuoconstruction and psychomotor dexterity on the Block Design subtest and Purdue pegboard[22]. Ingestion of PB pills was associated with significant decrements in executive system functioning on the Wisconsin Card Sort Test in exposed veterans compared to unexposed veterans[21]. These results are similar to exposure-outcome decrements recently noted in meta-analyses of OP and carbamate occupationally exposed pesticide applicators and agricultural workers[34, 35, 39]. Collectively, these results indicate chronic cognitive effects from neurotoxicant exposures that would be expected given the functional correlates of neuroimaging findings in exposed GW populations (lower cortical, hippocampal and white matter volumes in exposed groups) [26, 27, 37, 38, 40]. Researchers in the field of GWI have called for a better-refined case definition of the disorder[1]. These findings confirm that cognitive dysfunction is an appropriate criterion for diagnosis of GWI and that specific types of cognitive decrements may be especially important to consider in a new case definition.

As the field of GWI research moves forward, the focus is shifting towards developing treatments for ill GW veterans. Conducting a treatment trial requires that the outcome be a sensitive measure of disease status. This meta-analysis suggests neuropsychological domains and specific outcomes within those domains that may be appropriate to assess when examining treatment efficacy. Based on the results of this meta-analysis, the domains of visuospatial abilities, attention and executive function, and learning and memory should be represented in test batteries assessing GWV in biomarker research and in treatment trials. In particular, Block Design, Trail-making Test Digit Span, CPT, and CVLT appear to be sensitive outcomes in veterans with GWI.

Conclusions

To our knowledge, this is the first meta-analysis conducted to quantify the cognitive effects of deployment to the 1991 GW in American, British and Danish cohorts. GW deployment is associated with significant impact on visuospatial, attention, executive function, and learning and memory domains but not simple motor function.

Supporting information

S1 Checklist. PRISMA 2009 checklist.

https://doi.org/10.1371/journal.pone.0177121.s001

(DOC)

Author Contributions

Conceptualization: PAJ MHK AM TH KS.
Data curation: PAJ AM JC TH.
Formal analysis: PAJ AM ES.
Funding acquisition: KS.
Investigation: PAJ MHK AM JC KS.
Methodology: PAJ TH.
Project administration: PAJ KS.
Resources: PAJ KS.
Software: PAJ AM TH.
Supervision: PAJ MHK RFW TH KS.
Validation: PAJ AM MHK RFW TH KS.
Visualization: PAJ AM JC MHK RFW TH KS ES.
Writing – original draft: PAJ.
Writing – review & editing: PAJ MHK AM RFW JC TH KS.

References

1. RAC-GWVI. Gulf War Illness and the Health of Gulf War Veterans: Research Update and Recommendations. Washington, DC: U.S. Government Printing Office; 2014.
2. RAC-GWVI. Gulf War Illness and the Health of Gulf War Veterans: Scientific Findings and Recommendations. Washington, DC: U.S. Government Printing Office; 2008.
3. White RF, Steele L., O’Callaghan J. P., Sullivan K., Binns J. H., Golomb B. A., Grashow R.. Recent research on Gulf War illness and other health problems in veterans of the 1991 Gulf War: Effects of toxicant exposures during deployment. Cortex; a Journal Devoted to the Study of the Nervous System and Behavior. 2016;74:449–75. http://doi.org/10.1016/j.cortex.2015.08.022. pmid:26493934
- View Article
- PubMed/NCBI
- Google Scholar
4. Kang HK, L B Mahan CM, Eisen SA, Engel CC.,. Health of US veterans of 1991 Gulf War: a follow-up survey in 10 years. Journal of occupational and environmental medicine. 2009;51:401–10. pmid:19322107
- View Article
- PubMed/NCBI
- Google Scholar
5. Smith BN, Wang J. M., Vogt D., Vickers K., King D. W., & King L. A.. Gulf War Illness: Symptomatology Among Veterans 10 Years After Deployment. J J Occup Environ Med 2012. pmid:23235463
- View Article
- PubMed/NCBI
- Google Scholar
6. Yee M, Seichepine DR., Janulewicz PA., Sullivan KA., Proctor SP., Krengel MH.. Self-Reported Traumatic Brain Injury, Health and Rate of Chronic Multisymptom Illness in Veterans From the 1990–1991 Gulf War. J Head Trauma Rehabil. 2015. Epub Aug 19.
- View Article
- Google Scholar
7. Steele L. Prevalence and patterns of Gulf War illness in Kansas veterans: association of symptoms with characteristics of person, place, and time of military service. Am J Epidemiol. 2000;152:992–1002. pmid:11092441
- View Article
- PubMed/NCBI
- Google Scholar
8. Proctor S, Heeren T., White R., Wolfe J., Borgos M., Davis J., Pepper L., Class R., Sutker P., Vasterling J. Health status of Persian Gulf War veterans: self-reported symptoms, environmental exposures and the effect of stress. International Journal of Epidemiology. 1998;27:1000–10. pmid:10024195
- View Article
- PubMed/NCBI
- Google Scholar
9. White R, Sullivan K.. Response to is Gulf War Illness “Real”: The jury is still out by DR Orme. Federal Practitioner. 2011.
- View Article
- Google Scholar
10. Vasterling JJ, Bremner JD. The impact of the 1991 Gulf War on the mind and brain: findings from neuropsychological and neuroimaging research. Philos Trans R Soc Lond B Biol Sci. 2006;361(1468):593–604. Epub 2006/05/12. pmid:16687264;.
- View Article
- PubMed/NCBI
- Google Scholar
11. Binns J, Steele L.. The ‘Reality’ of Gulf War Illness. Federal Practitioner. 2011;28(3):37.
- View Article
- Google Scholar
12. Fukuda K, Nisenbaum R., Stewart G., Thompson W. W., Robin L., Washko R. M.,… Reeves W. C.. Chronic multisymptom illness affecting Air Force veterans of the Gulf War. JAMA. 1998;280(11):981–8. pmid:9749480
- View Article
- PubMed/NCBI
- Google Scholar
13. Medicine Io. Chronic Multisymptom Illness in Gulf War Veterans: Case Definitions Reexamined. Washington (DC): National Academies Press; 2014.
14. Hom J, Haley R., Kurt T. neuropsychological correlates of gulf war syndrome. Archives of Clinical Neuropsychology. 1997;12(6):531–44. pmid:14590665
- View Article
- PubMed/NCBI
- Google Scholar
15. Bunegin L, Mitzel H., Miller C., Gelineau J., Tolstykh G. Cognitive performance and cerebrohemodynamics associated with the Persian Gulf Syndrome. Toxicology and Industrial Health. 2001;17(4):128–37. pmid:12479508
- View Article
- PubMed/NCBI
- Google Scholar
16. Lange G, Tiersky LA., DeLuca J., Scharer JB., Policastro T. Cognitive Functioning in Gulf War Illness. Journal of Clinical and Experimental Neuropsychology. 2001;23(2):240–9. pmid:11309677
- View Article
- PubMed/NCBI
- Google Scholar
17. Wallin M, Wilken J., Alfaro M., Rogers C., Mahan C., Chapman J., Fratto T., Sullivan C., Kang H., Kane R. Neuropsychologic Assessment of a Population-based Sample of Gulf War Veterans. Cognitive and Behavioral Neurology. 2009;22(3):155–66. pmid:19741325
- View Article
- PubMed/NCBI
- Google Scholar
18. David A, Farrin L., Hull L., Unwin C., Wessely S., Wykes T. Cognitive functioning and disturbances of mood in UK veterans of the Persian Gulf War: a comparative study. Psychological Medicine 2002;32:1357–70. pmid:12455934
- View Article
- PubMed/NCBI
- Google Scholar
19. Anger K, Storzbach D., Binder L., Campbell K., Rothman D., Mccauley L., Kovera C., Davis K. Neurobehavioral Deficits in Persian Gulf Veterans: Additional Evidence from a Population-Based Study. Journal of the International Neuropsychological Society. 1999;5:203–12.
- View Article
- Google Scholar
20. Toomey R, Alpern R., Vasterling J., Baker D., Reda D., Lyons M., Henderson W., Kang H., Eisen S., Murphy F. Neuropsycholical functioning of U.S. Gulf War veterans 10 years after the war. Journal of the International Neuropsychological Society. 2009;15(5):717–29. pmid:19640317
- View Article
- PubMed/NCBI
- Google Scholar
21. Sullivan K, Krengel M., Proctor S., Devine S., Heeren T., White R. Cognitive Functioning in Treatment-Seeking Gulf War Veterans: Pyridostigmine Bromide Use and PTSD. Journal of Psychopathology and Behavioral Assessment. 2003;25(2):95–103.
- View Article
- Google Scholar
22. Proctor SP, Heaton KJ, Heeren T, White RF. Effects of sarin and cyclosarin exposure during the 1991 Gulf War on neurobehavioral functioning in US army veterans. Neurotoxicology. 2006;27:931–9. pmid:16982099
- View Article
- PubMed/NCBI
- Google Scholar
23. Axelrod B, Milner B. Neuropsychological findings in a sample of Operation Desert Storm veterans. Journal of Neuropsychiatry. 1997;9(1):23–8. pmid:9017525
- View Article
- PubMed/NCBI
- Google Scholar
24. Goldstein G, Beers S. R., Morrow L., Shemansky W. J.,&Steinhauer S. R.. A preliminary neuropsychological study of Persian Gulf veterans. Journal of the International Neuropsychological Society,. 1996;2(368–371). pmid:9375186
- View Article
- PubMed/NCBI
- Google Scholar
25. Sillanpaa M, Agar L., Milner B., Podany E., Axelrod B., Brown G. Gulf war veterans: A neuropsychological examination. Journal of Clinical and Experimental Neuropsychology. 1997;19(2):211–9. pmid:9240481
- View Article
- PubMed/NCBI
- Google Scholar
26. Chao L, Rothlind JC, Cardenas VA, Meyerhoff DJ, Weiner MW. Effects of low-level exposure to sarin and cyclosarin during the 1991 Gulf War on brain function and brain structure in US veterans. NeuroToxicology. 2010;31:493–501. pmid:20580739
- View Article
- PubMed/NCBI
- Google Scholar
27. Chao LL, Abadjian L, Hlavin J, Meyerhoff DJ, Weiner MW. Effects of low-level sarin and cyclosarin exposure and Gulf War Illness on Brain Structure and Function: A study at 4 T. NeuroToxicology. 2011;32(6):814–22. pmid:21741405
- View Article
- PubMed/NCBI
- Google Scholar
28. White RF, Proctor SP, Heeren T, Wolfe J, Krengel M, Vasterling J, et al. Neuropsychological function in Gulf War veterans: relationships to self-reported toxicant exposures. American Journal of Industrial Medicine. 2001;40(1):42–54. pmid:11439396
- View Article
- PubMed/NCBI
- Google Scholar
29. Proctor S, White R., Heeren T., Debes F., Gloerfelt B., Appleyard M., Ishoy T., Guldager B., Suadicani P., Gyntelberg F., Ozonoff D. Neuropsychological Functioning in Danish Gulf War Veterans. Journal of Psychopathology and Behavioral Assessment. 2003;25(2).
- View Article
- Google Scholar
30. Higgins JP, Thompson S. G. Quantifying heterogeneity in a meta-analysis. Statistics in medicine. 2002;21(11):1539–58. Epub 2002/07/12. pmid:12111919.
- View Article
- PubMed/NCBI
- Google Scholar
31. Hedges LV, Pigott T. D. The power of statistical tests in meta-analysis. Psychological methods. 2001;6(3):203–17. Epub 2001/09/26. pmid:11570228.
- View Article
- PubMed/NCBI
- Google Scholar
32. Levy JI, Carrothers T. J., Tuomisto J. T., Hammitt J. K., Evans J. S. Assessing the public health benefits of reduced ozone concentrations. Environmental health perspectives. 2001;109(12):1215–26. Epub 2001/12/19. pmid:11748028;
- View Article
- PubMed/NCBI
- Google Scholar
33. Goldstein G, Beers SR, Morrow LA, Shemansky WJ, Steinhauer SR. A preliminary neuropsychological study of Persian Gulf veterans. Journal of the International Neuropsychological Society 1996;2(04):368–71.
- View Article
- Google Scholar
34. Ismail A.A. B TE, Rohlman D.S.. Neurobehavioral performance among agricultural workers and pesticide applicators: a meta-analytic study. Occupational and environmental medicine. 2012.
- View Article
- Google Scholar
35. Ross SM M I, Harrison V, Mason O. Neurobehavioral problems following low-level exposure to organophosphate pesticides: a systematic and meta-analytic review. Critical reviews in toxicology 2013;43:21–44. pmid:23163581
- View Article
- PubMed/NCBI
- Google Scholar
36. Rohlman D.S. A WK, Lein P.J.. Correlating neurobehavioral performance with biomarkers of organophosphorous pesticide exposure. Neurotoxicology 2011;32:268–76. pmid:21182866
- View Article
- PubMed/NCBI
- Google Scholar
37. Chao LL K S, Buckley S, Ng P, Mueller SG. Effects of low-level sarin and cyclosarin exposure on hippocampal subfields in Gulf War Veterans. NeuroToxicology. 2014;44:263–9. pmid:25058901
- View Article
- PubMed/NCBI
- Google Scholar
38. Chao L, Reeb R., Esparza IL., Abadjian LR. Associations between the self-reported frequency of hearing chemical alarms in theater and regional brain volume in Gulf War Veterans. Neurotoxicology. 2016;53:246–56. pmid:26920621
- View Article
- PubMed/NCBI
- Google Scholar
39. Rohlman D, Anger WK., Lein PJ.. Correlating neurobehavioral performance with biomarkers of organophosphorous pesticide exposure. Neurotoxicology. 2011;32:268–76. pmid:21182866
- View Article
- PubMed/NCBI
- Google Scholar
40. Heaton KJ, Palumbo C. L., Proctor S. P., Killiany R. J., Yurgelun-Todd D. A., & White R. F. Quantitative magnetic resonance brain imaging in US army veterans of the 1991 Gulf War potentially exposed to sarin and cyclosarin. Neurotoxicology. 2007;28(4):761–9. pmid:17485118
- View Article
- PubMed/NCBI
- Google Scholar
41. Delis DC, Kramer J.H., Kaplan E., Ober BA. California Verbal Learning Test: Adult Version. San Antonio, TX: The Psychological Corporation; 1987.
42. Taylor E. Psychological Appraisal of Children With Cerebral Defecits. Cambridge, MA: Harvard University Press; 1959.
43. Corwin J.,B F. W.. Translations of excerpts from Andre Rey’s Psychological examination of traumatic encephalopathy and P. A. Osterrieth’s The Complex Figure Copy Test. The Clinical neuropsychologist 1993;7:3–15.
- View Article
- Google Scholar
44. Wechsler D. Wechsler Memory Scale-Revised Manual. San Antonio, TX: The Psychological Corporation; 1987.
45. Benton A, Hamsher K. Multilingual Asphasia Examination Iowa City, IA: AJA Associates; 1989.
46. Letz R. NES2 user's manual (version 4.4). Winchester, MA: Neurobehavioral Systems Inc.; 1991.
47. Gronwall D. Paced Auditory Serial-Addition Task: a measure of recovery from concussion. Perceptual Motor Skills. 1977;44:367–73. pmid:866038
- View Article
- PubMed/NCBI
- Google Scholar
48. Wetzel L, Boll T. Short Category test, booklet format. Los Angeles: Western Psychological Services; 1987.
49. Golden CS. Stroop Color and Word Test: A manual for Clinical and Experimental Uses. Wood Dale, IL: Stoelting; 1978.
50. Reitan R. Trail Making Test: Manual for Administration and Scoring. Tuscon, AZ: Reitan Neuropsychological Laboratory; 1992.
51. Wechsler D. Manual for the Wechsler Adult Intelligence Scale—III. San Antonio, TX: Psychological Corporation; 1997.
52. Smith A. A neuropsychological test for economic hearing. Hearing disorders. 1968;3:83–91.
- View Article
- Google Scholar
53. Heaton R. Wisconsin Card Sorting Test Manual. Odessa, FL: Psychological Assessment Resources, Inc; 1981.
54. Wechsler D. Manual for the Wechsler Adult Intelligence Scale. New York: The Psychological Corporation; 1955.
55. Reitan R, Wolfson D. The Halstead Reitan neuropsychological test battery. Tuscon, AZ: Neuropsychology Press; 1985.
56. Reitan R. Clinical Neuropsychology: Current Status and Applications. New York: Winson/Wiley; 1974.
57. Matthews C, Klove H. Instruction manual for the Adult Neuropsychological Battery. Madison, WI: University of Wisconsin Medical School; 1964.
58. Foundation PR. Examiner's Manual for the Purdue Pegboard. Chicago: Science Research Associates; 1948.
59. Jastak S, Wilkinson G.S. Wide Range Achievement Test—III: Administration Manual. Wilmington, DL: Jastak Associates; 1997.
60. Wilkinson G. The Wide Range Achievement Test. Wilmington: Wide Range Inc.; 1993.

[ref1] 1. RAC-GWVI. Gulf War Illness and the Health of Gulf War Veterans: Research Update and Recommendations. Washington, DC: U.S. Government Printing Office; 2014.

[ref2] 2. RAC-GWVI. Gulf War Illness and the Health of Gulf War Veterans: Scientific Findings and Recommendations. Washington, DC: U.S. Government Printing Office; 2008.

[ref3] 3. White RF, Steele L., O’Callaghan J. P., Sullivan K., Binns J. H., Golomb B. A., Grashow R.. Recent research on Gulf War illness and other health problems in veterans of the 1991 Gulf War: Effects of toxicant exposures during deployment. Cortex; a Journal Devoted to the Study of the Nervous System and Behavior. 2016;74:449–75. http://doi.org/10.1016/j.cortex.2015.08.022. pmid:26493934
View Article
PubMed/NCBI
Google Scholar

[4] View Article

[5] PubMed/NCBI

[6] Google Scholar

[ref4] 4. Kang HK, L B Mahan CM, Eisen SA, Engel CC.,. Health of US veterans of 1991 Gulf War: a follow-up survey in 10 years. Journal of occupational and environmental medicine. 2009;51:401–10. pmid:19322107
View Article
PubMed/NCBI
Google Scholar

[8] View Article

[9] PubMed/NCBI

[10] Google Scholar

[ref5] 5. Smith BN, Wang J. M., Vogt D., Vickers K., King D. W., & King L. A.. Gulf War Illness: Symptomatology Among Veterans 10 Years After Deployment. J J Occup Environ Med 2012. pmid:23235463
View Article
PubMed/NCBI
Google Scholar

[12] View Article

[13] PubMed/NCBI

[14] Google Scholar

[ref6] 6. Yee M, Seichepine DR., Janulewicz PA., Sullivan KA., Proctor SP., Krengel MH.. Self-Reported Traumatic Brain Injury, Health and Rate of Chronic Multisymptom Illness in Veterans From the 1990–1991 Gulf War. J Head Trauma Rehabil. 2015. Epub Aug 19.
View Article
Google Scholar

[16] View Article

[17] Google Scholar

[ref7] 7. Steele L. Prevalence and patterns of Gulf War illness in Kansas veterans: association of symptoms with characteristics of person, place, and time of military service. Am J Epidemiol. 2000;152:992–1002. pmid:11092441
View Article
PubMed/NCBI
Google Scholar

[19] View Article

[20] PubMed/NCBI

[21] Google Scholar

[ref8] 8. Proctor S, Heeren T., White R., Wolfe J., Borgos M., Davis J., Pepper L., Class R., Sutker P., Vasterling J. Health status of Persian Gulf War veterans: self-reported symptoms, environmental exposures and the effect of stress. International Journal of Epidemiology. 1998;27:1000–10. pmid:10024195
View Article
PubMed/NCBI
Google Scholar

[23] View Article

[24] PubMed/NCBI

[25] Google Scholar

[ref9] 9. White R, Sullivan K.. Response to is Gulf War Illness “Real”: The jury is still out by DR Orme. Federal Practitioner. 2011.
View Article
Google Scholar

[27] View Article

[28] Google Scholar

[ref10] 10. Vasterling JJ, Bremner JD. The impact of the 1991 Gulf War on the mind and brain: findings from neuropsychological and neuroimaging research. Philos Trans R Soc Lond B Biol Sci. 2006;361(1468):593–604. Epub 2006/05/12. pmid:16687264;.
View Article
PubMed/NCBI
Google Scholar

[30] View Article

[31] PubMed/NCBI

[32] Google Scholar

[ref11] 11. Binns J, Steele L.. The ‘Reality’ of Gulf War Illness. Federal Practitioner. 2011;28(3):37.
View Article
Google Scholar

[34] View Article

[35] Google Scholar

[ref12] 12. Fukuda K, Nisenbaum R., Stewart G., Thompson W. W., Robin L., Washko R. M.,… Reeves W. C.. Chronic multisymptom illness affecting Air Force veterans of the Gulf War. JAMA. 1998;280(11):981–8. pmid:9749480
View Article
PubMed/NCBI
Google Scholar

[37] View Article

[38] PubMed/NCBI

[39] Google Scholar

[ref13] 13. Medicine Io. Chronic Multisymptom Illness in Gulf War Veterans: Case Definitions Reexamined. Washington (DC): National Academies Press; 2014.

[ref14] 14. Hom J, Haley R., Kurt T. neuropsychological correlates of gulf war syndrome. Archives of Clinical Neuropsychology. 1997;12(6):531–44. pmid:14590665
View Article
PubMed/NCBI
Google Scholar

[42] View Article

[43] PubMed/NCBI

[44] Google Scholar

[ref15] 15. Bunegin L, Mitzel H., Miller C., Gelineau J., Tolstykh G. Cognitive performance and cerebrohemodynamics associated with the Persian Gulf Syndrome. Toxicology and Industrial Health. 2001;17(4):128–37. pmid:12479508
View Article
PubMed/NCBI
Google Scholar

[46] View Article

[47] PubMed/NCBI

[48] Google Scholar

[ref16] 16. Lange G, Tiersky LA., DeLuca J., Scharer JB., Policastro T. Cognitive Functioning in Gulf War Illness. Journal of Clinical and Experimental Neuropsychology. 2001;23(2):240–9. pmid:11309677
View Article
PubMed/NCBI
Google Scholar

[50] View Article

[51] PubMed/NCBI

[52] Google Scholar

[ref17] 17. Wallin M, Wilken J., Alfaro M., Rogers C., Mahan C., Chapman J., Fratto T., Sullivan C., Kang H., Kane R. Neuropsychologic Assessment of a Population-based Sample of Gulf War Veterans. Cognitive and Behavioral Neurology. 2009;22(3):155–66. pmid:19741325
View Article
PubMed/NCBI
Google Scholar

[54] View Article

[55] PubMed/NCBI

[56] Google Scholar

[ref18] 18. David A, Farrin L., Hull L., Unwin C., Wessely S., Wykes T. Cognitive functioning and disturbances of mood in UK veterans of the Persian Gulf War: a comparative study. Psychological Medicine 2002;32:1357–70. pmid:12455934
View Article
PubMed/NCBI
Google Scholar

[58] View Article

[59] PubMed/NCBI

[60] Google Scholar

[ref19] 19. Anger K, Storzbach D., Binder L., Campbell K., Rothman D., Mccauley L., Kovera C., Davis K. Neurobehavioral Deficits in Persian Gulf Veterans: Additional Evidence from a Population-Based Study. Journal of the International Neuropsychological Society. 1999;5:203–12.
View Article
Google Scholar

[62] View Article

[63] Google Scholar

[ref20] 20. Toomey R, Alpern R., Vasterling J., Baker D., Reda D., Lyons M., Henderson W., Kang H., Eisen S., Murphy F. Neuropsycholical functioning of U.S. Gulf War veterans 10 years after the war. Journal of the International Neuropsychological Society. 2009;15(5):717–29. pmid:19640317
View Article
PubMed/NCBI
Google Scholar

[65] View Article

[66] PubMed/NCBI

[67] Google Scholar

[ref21] 21. Sullivan K, Krengel M., Proctor S., Devine S., Heeren T., White R. Cognitive Functioning in Treatment-Seeking Gulf War Veterans: Pyridostigmine Bromide Use and PTSD. Journal of Psychopathology and Behavioral Assessment. 2003;25(2):95–103.
View Article
Google Scholar

[69] View Article

[70] Google Scholar

[ref22] 22. Proctor SP, Heaton KJ, Heeren T, White RF. Effects of sarin and cyclosarin exposure during the 1991 Gulf War on neurobehavioral functioning in US army veterans. Neurotoxicology. 2006;27:931–9. pmid:16982099
View Article
PubMed/NCBI
Google Scholar

[72] View Article

[73] PubMed/NCBI

[74] Google Scholar

[ref23] 23. Axelrod B, Milner B. Neuropsychological findings in a sample of Operation Desert Storm veterans. Journal of Neuropsychiatry. 1997;9(1):23–8. pmid:9017525
View Article
PubMed/NCBI
Google Scholar

[76] View Article

[77] PubMed/NCBI

[78] Google Scholar

[ref24] 24. Goldstein G, Beers S. R., Morrow L., Shemansky W. J.,&Steinhauer S. R.. A preliminary neuropsychological study of Persian Gulf veterans. Journal of the International Neuropsychological Society,. 1996;2(368–371). pmid:9375186
View Article
PubMed/NCBI
Google Scholar

[80] View Article

[81] PubMed/NCBI

[82] Google Scholar

[ref25] 25. Sillanpaa M, Agar L., Milner B., Podany E., Axelrod B., Brown G. Gulf war veterans: A neuropsychological examination. Journal of Clinical and Experimental Neuropsychology. 1997;19(2):211–9. pmid:9240481
View Article
PubMed/NCBI
Google Scholar

[84] View Article

[85] PubMed/NCBI

[86] Google Scholar

[ref26] 26. Chao L, Rothlind JC, Cardenas VA, Meyerhoff DJ, Weiner MW. Effects of low-level exposure to sarin and cyclosarin during the 1991 Gulf War on brain function and brain structure in US veterans. NeuroToxicology. 2010;31:493–501. pmid:20580739
View Article
PubMed/NCBI
Google Scholar

[88] View Article

[89] PubMed/NCBI

[90] Google Scholar

[ref27] 27. Chao LL, Abadjian L, Hlavin J, Meyerhoff DJ, Weiner MW. Effects of low-level sarin and cyclosarin exposure and Gulf War Illness on Brain Structure and Function: A study at 4 T. NeuroToxicology. 2011;32(6):814–22. pmid:21741405
View Article
PubMed/NCBI
Google Scholar

[92] View Article

[93] PubMed/NCBI

[94] Google Scholar

[ref28] 28. White RF, Proctor SP, Heeren T, Wolfe J, Krengel M, Vasterling J, et al. Neuropsychological function in Gulf War veterans: relationships to self-reported toxicant exposures. American Journal of Industrial Medicine. 2001;40(1):42–54. pmid:11439396
View Article
PubMed/NCBI
Google Scholar

[96] View Article

[97] PubMed/NCBI

[98] Google Scholar

[ref29] 29. Proctor S, White R., Heeren T., Debes F., Gloerfelt B., Appleyard M., Ishoy T., Guldager B., Suadicani P., Gyntelberg F., Ozonoff D. Neuropsychological Functioning in Danish Gulf War Veterans. Journal of Psychopathology and Behavioral Assessment. 2003;25(2).
View Article
Google Scholar

[100] View Article

[101] Google Scholar

[ref30] 30. Higgins JP, Thompson S. G. Quantifying heterogeneity in a meta-analysis. Statistics in medicine. 2002;21(11):1539–58. Epub 2002/07/12. pmid:12111919.
View Article
PubMed/NCBI
Google Scholar

[103] View Article

[104] PubMed/NCBI

[105] Google Scholar

[ref31] 31. Hedges LV, Pigott T. D. The power of statistical tests in meta-analysis. Psychological methods. 2001;6(3):203–17. Epub 2001/09/26. pmid:11570228.
View Article
PubMed/NCBI
Google Scholar

[107] View Article

[108] PubMed/NCBI

[109] Google Scholar

[ref32] 32. Levy JI, Carrothers T. J., Tuomisto J. T., Hammitt J. K., Evans J. S. Assessing the public health benefits of reduced ozone concentrations. Environmental health perspectives. 2001;109(12):1215–26. Epub 2001/12/19. pmid:11748028;
View Article
PubMed/NCBI
Google Scholar

[111] View Article

[112] PubMed/NCBI

[113] Google Scholar

[ref33] 33. Goldstein G, Beers SR, Morrow LA, Shemansky WJ, Steinhauer SR. A preliminary neuropsychological study of Persian Gulf veterans. Journal of the International Neuropsychological Society 1996;2(04):368–71.
View Article
Google Scholar

[115] View Article

[116] Google Scholar

[ref34] 34. Ismail A.A. B TE, Rohlman D.S.. Neurobehavioral performance among agricultural workers and pesticide applicators: a meta-analytic study. Occupational and environmental medicine. 2012.
View Article
Google Scholar

[118] View Article

[119] Google Scholar

[ref35] 35. Ross SM M I, Harrison V, Mason O. Neurobehavioral problems following low-level exposure to organophosphate pesticides: a systematic and meta-analytic review. Critical reviews in toxicology 2013;43:21–44. pmid:23163581
View Article
PubMed/NCBI
Google Scholar

[121] View Article

[122] PubMed/NCBI

[123] Google Scholar

[ref36] 36. Rohlman D.S. A WK, Lein P.J.. Correlating neurobehavioral performance with biomarkers of organophosphorous pesticide exposure. Neurotoxicology 2011;32:268–76. pmid:21182866
View Article
PubMed/NCBI
Google Scholar

[125] View Article

[126] PubMed/NCBI

[127] Google Scholar

[ref37] 37. Chao LL K S, Buckley S, Ng P, Mueller SG. Effects of low-level sarin and cyclosarin exposure on hippocampal subfields in Gulf War Veterans. NeuroToxicology. 2014;44:263–9. pmid:25058901
View Article
PubMed/NCBI
Google Scholar

[129] View Article

[130] PubMed/NCBI

[131] Google Scholar

[ref38] 38. Chao L, Reeb R., Esparza IL., Abadjian LR. Associations between the self-reported frequency of hearing chemical alarms in theater and regional brain volume in Gulf War Veterans. Neurotoxicology. 2016;53:246–56. pmid:26920621
View Article
PubMed/NCBI
Google Scholar

[133] View Article

[134] PubMed/NCBI

[135] Google Scholar

[ref39] 39. Rohlman D, Anger WK., Lein PJ.. Correlating neurobehavioral performance with biomarkers of organophosphorous pesticide exposure. Neurotoxicology. 2011;32:268–76. pmid:21182866
View Article
PubMed/NCBI
Google Scholar

[137] View Article

[138] PubMed/NCBI

[139] Google Scholar

[ref40] 40. Heaton KJ, Palumbo C. L., Proctor S. P., Killiany R. J., Yurgelun-Todd D. A., & White R. F. Quantitative magnetic resonance brain imaging in US army veterans of the 1991 Gulf War potentially exposed to sarin and cyclosarin. Neurotoxicology. 2007;28(4):761–9. pmid:17485118
View Article
PubMed/NCBI
Google Scholar

[141] View Article

[142] PubMed/NCBI

[143] Google Scholar

[ref41] 41. Delis DC, Kramer J.H., Kaplan E., Ober BA. California Verbal Learning Test: Adult Version. San Antonio, TX: The Psychological Corporation; 1987.

[ref42] 42. Taylor E. Psychological Appraisal of Children With Cerebral Defecits. Cambridge, MA: Harvard University Press; 1959.

[ref43] 43. Corwin J.,B F. W.. Translations of excerpts from Andre Rey’s Psychological examination of traumatic encephalopathy and P. A. Osterrieth’s The Complex Figure Copy Test. The Clinical neuropsychologist 1993;7:3–15.
View Article
Google Scholar

[147] View Article

[148] Google Scholar

[ref44] 44. Wechsler D. Wechsler Memory Scale-Revised Manual. San Antonio, TX: The Psychological Corporation; 1987.

[ref45] 45. Benton A, Hamsher K. Multilingual Asphasia Examination Iowa City, IA: AJA Associates; 1989.

[ref46] 46. Letz R. NES2 user's manual (version 4.4). Winchester, MA: Neurobehavioral Systems Inc.; 1991.

[ref47] 47. Gronwall D. Paced Auditory Serial-Addition Task: a measure of recovery from concussion. Perceptual Motor Skills. 1977;44:367–73. pmid:866038
View Article
PubMed/NCBI
Google Scholar

[153] View Article

[154] PubMed/NCBI

[155] Google Scholar

[ref48] 48. Wetzel L, Boll T. Short Category test, booklet format. Los Angeles: Western Psychological Services; 1987.

[ref49] 49. Golden CS. Stroop Color and Word Test: A manual for Clinical and Experimental Uses. Wood Dale, IL: Stoelting; 1978.

[ref50] 50. Reitan R. Trail Making Test: Manual for Administration and Scoring. Tuscon, AZ: Reitan Neuropsychological Laboratory; 1992.

[ref51] 51. Wechsler D. Manual for the Wechsler Adult Intelligence Scale—III. San Antonio, TX: Psychological Corporation; 1997.

[ref52] 52. Smith A. A neuropsychological test for economic hearing. Hearing disorders. 1968;3:83–91.
View Article
Google Scholar

[161] View Article

[162] Google Scholar

[ref53] 53. Heaton R. Wisconsin Card Sorting Test Manual. Odessa, FL: Psychological Assessment Resources, Inc; 1981.

[ref54] 54. Wechsler D. Manual for the Wechsler Adult Intelligence Scale. New York: The Psychological Corporation; 1955.

[ref55] 55. Reitan R, Wolfson D. The Halstead Reitan neuropsychological test battery. Tuscon, AZ: Neuropsychology Press; 1985.

[ref56] 56. Reitan R. Clinical Neuropsychology: Current Status and Applications. New York: Winson/Wiley; 1974.

[ref57] 57. Matthews C, Klove H. Instruction manual for the Adult Neuropsychological Battery. Madison, WI: University of Wisconsin Medical School; 1964.

[ref58] 58. Foundation PR. Examiner's Manual for the Purdue Pegboard. Chicago: Science Research Associates; 1948.

[ref59] 59. Jastak S, Wilkinson G.S. Wide Range Achievement Test—III: Administration Manual. Wilmington, DL: Jastak Associates; 1997.

[ref60] 60. Wilkinson G. The Wide Range Achievement Test. Wilmington: Wide Range Inc.; 1993.

Figures

Abstract

Objective

Methods

Results

Conclusions

Introduction

Materials and methods

Literature search and exclusion/inclusion criteria

Data extraction

Meta-analytic procedures

Results

Discussion

Conclusions

Supporting information

S1 Checklist. PRISMA 2009 checklist.

Author Contributions

References