Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Childhood Internalizing and Externalizing Problems Predict the Onset of Clinical Panic Attacks over Adolescence: The TRAILS Study

  • Christina M. Mathyssek,

    Affiliation Department of Child and Adolescent Psychiatry/Psychology, Erasmus University Medical Center, Rotterdam, The Netherlands

  • Thomas M. Olino,

    Affiliation Department of Psychiatry, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America

  • Frank C. Verhulst,

    Affiliation Department of Child and Adolescent Psychiatry/Psychology, Erasmus University Medical Center, Rotterdam, The Netherlands

  • Floor V. A. van Oort

    f.vanoort@erasmusmc.nl

    Affiliation Department of Child and Adolescent Psychiatry/Psychology, Erasmus University Medical Center, Rotterdam, The Netherlands

Abstract

Background

Panic attacks are a source of individual suffering and are an independent risk factor for later psychopathology. However, much less is known about risk factors for the development of panic attacks, particularly during adolescence when the incidence of panic attacks increases dramatically. We examined whether internalizing and externalizing problems in childhood predict the onset of panic attacks in adolescence.

Method

This study is part of the TRacking Adolescents’ Individual Lives Survey (TRAILS), a Dutch longitudinal population cohort study (N = 1,584). Internalizing and Externalizing Problems were collected using the Youth Self-Report (YSR) and the parent-report Child Behavior Checklist (CBCL) at baseline (age 10–12). At age 18–20, DSM-IV defined panic attacks since baseline were assessed with the Composite International Diagnostic Interview (CIDI). We investigated whether early adolescent Internalizing and Externalizing Problems predicted panic attacks between ages 10–20 years, using survival analysis in univariate and multivariate models.

Results

There were N = 314 (19.8%) cases who experienced at least one DSM-IV defined panic attack during adolescence and N = 18 (1.2%) who developed panic disorder during adolescence. In univariate analyses, CBCL Total Problems, Internalizing Problems and three of the eight syndrome scales predicted panic attack onset, while on the YSR all broad-band problem scales and each narrow-band syndrome scale predicted panic attack onset. In multivariate analyses, CBCL Social Problems (HR 1.19, p<.05), and YSR Thought Problems (HR 1.15, p<.05) and Social Problems (HR 1.26, p<.01) predicted panic attack onset.

Conclusion

Risk indicators of panic attack include the wide range of internalizing and externalizing problems. Yet, when adjusted for co-occurring problem behaviors, Social Problems were the most consistent risk factor for panic attack onsets in adolescence.

Introduction

The DSM-IV [1] classification includes clinical criteria for both panic attacks and panic disorder. The criteria for a diagnosis of panic attack are a discrete period of intense fear or discomfort, in which four or more out of thirteen (specified) panic symptoms (e.g., palpitations, sweating, trembling or shaking, feeling of choking) developed abruptly and reached a peak within ten minutes. Panic disorder requires (1) recurrent unexpected panic attacks and (2) at least one of the attacks has been followed by at least one month of persistent concern or worry about having panic attacks or its consequences and/or a significant change in behavior related to the attacks. Panic attacks may occur in the context of multiple anxiety disorders. They are considered to be amongst the most debilitating psychiatric conditions [2] and are associated with high level of mental health treatment seeking [3]. While it is known that early identification and subsequent intervention can reduce deleterious outcomes of psychiatric disorders [4], including panic disorder and panic attacks, research on risk factors for the onset of panic attacks is scarce. Some recent studies have identified panic attacks as a risk factor for other anxiety [4][6] and mood disorders [4], [5], independent of comorbid internalizing psychopathology. Although there is less consistency, there is some support for panic attacks to precede certain externalizing disorders, including alcohol use disorders [5], [7] and substance use [8], [9]. Hence, identifying predictors for the onset of panic attacks is an important research direction [7], [10].

The reported life-time prevalence of panic attacks when assessed by a clinical interview according to DSM criteria in youth samples ranges from 3.3% [4] to 11.6% [11]. This shows that the reported prevalence rate varies markedly across studies. Importantly, the lower prevalence rate was reported in a sample of 9–17 year olds, and the higher prevalence rate in a sample of 14–16 year olds, indicating that the prevalence rates increase with age in adolescent samples. Even higher lifetime prevalence rates are reported in studies using questionnaires instead of interviews to assess the DSM-criteria (21.4% [5] –63.3% [12]. Females typically have a higher prevalence than males [12], while no differences were found in socio-demographic characteristics between adolescents with and without panic attacks [4]. In addition, a meta-analysis [13] of the heritability of panic disorder revealed that genetic factors accounted for a large proportion of variance (43%). However, to our knowledge, no study has reported heritability for panic attacks.

As the typical age of onset of panic attacks is in late adolescence or early adulthood [14], with a peak between 15 and 19 years [15], it is crucial to examine prospective associations beginning in early adolescence. Identification of predictors of panic attacks early in development is also critical as earlier onsets are associated with increased rates of later psychopathology [16].

The few longitudinal studies on predictors of panic attacks have mostly focused on internalizing problems (emotional problems, e.g. anxiety, depression, other mood disorders). In a sample of high school students assessed over a 4-year period, negative affect [17], [18], anxiety sensitivity [5], [18], as well as separation anxiety disorder [17] were associated with an increased risk for panic attack onset in adolescents. Despite the fact that our knowledge of predictors for adolescent panic attacks is limited, no study to date has prospectively incorporated a broader range of problems, including externalizing problems (behavioral problems, e.g. conduct disorder, oppositional defiant disorder) as possible predictors. Besides internalizing problems, it is important to study other mental health problems as predictors of DSM-IV defined panic attacks since Roza et al. [19] found that both internalizing and externalizing problems in children and adolescents were predictive of anxiety disorders in young adulthood.

The aim of the current study is to extend the limited literature on predictors of panic attack onset, including both internalizing and externalizing problems in early adolescence. We hypothesized that a range of adolescent mental health problems including internalizing problems predict panic attack onset in adolescence. Furthermore, we explore if externalizing problems are part of these predictors. This study is part of the Tracking Adolescents’ Individual Lives Survey (TRAILS), a Dutch general population cohort study following 2,230 children from early adolescence (age 10–12 years) into young adulthood.

Methods

Ethics Statement

Written informed consent was obtained at each assessment wave from each participant and their parents. The study was approved by the Dutch Central Medical Ethics Committee (CCMO) and all participants were compensated for their involvement in this study.

Study Design and Population

Participants were recruited from the general population in five municipalities in the northern part of the Netherlands, including both urban and rural areas. All children living in these municipalities and born between October 1989 and September 1990 (two sites) and October 1990 and September 1991 (three sites) were selected (N = 3,483). Their date of birth and contact information was obtained through the municipality administrations. The first exclusion criterion was non-participation of the school (9.6% of schools, N = 338 children). If the school of a selected child was willing to participate, parents were approached with information brochures (one for themselves and one for their children) and a follow-up phone call in which they were invited to participate. Inability to participate in the study due to severe mental retardation, a severe physical illness, or language-limitations (N = 210) was the second exclusion criterion. Of the 3,483 selected children, 2,935 were eligible for the study, of whom 2,230 (76.0%, of which 50.8% girls) participated in the first wave (T1; 2001–2002; age range 10–12 years). Non-response was due to explicit refusal or inability to establish contact [20]. This response rate was considered adequate given the fact that both parent and child had to agree to participate [21]. Extensive efforts were taken to minimize non-response, including reminder letters and personal house visits [22]. Details of TRAILS have been described elsewhere [21] and are available upon request. Non-response bias was analyzed based on information about mental health determinants and outcomes as reported by teachers of responders and non-responders [20]. Responders and non-responders did not differ in prevalence of psychopathology at T1, and did not differ regarding associations between socio-demographic variables and mental health variables [20]. At T4 (2008–2010; age range 17–20 years), 1,881 respondents (84.3%) continued to participate. Of those, 1,584 subjects provided outcome data, which is 84.2% of T4 participants and 71.0% of T1 participants. When comparing the T1 sample with participants who provided T4 outcome data, we found that T1 predictors of not providing outcome data were male gender (T1 49.2% vs. T4 46.0%), low socio-economic status (T1 25.2% vs. T4 19.6%), ethnic minority background (T1 10.6% vs. T4 7.6%), one-parent family (T1 15.5% vs. T4 13.5%), and a Total Problem score of the Child Behavior Checklist (CBCL/6–18) [23] in the clinical range at baseline (T1 16.1% vs. T4 13.9%).

Of these 1,584 subjects, 405 subjects reported a life-time history of DSM-IV defined panic attacks. Subjects with panic attack onset before the T1 assessment (N = 90) as well as subjects who did not report an age of onset (N = 1) were excluded from the analyses to avoid potential reverse-causal inferences. This rendered N = 1,493 for analyses.

Instruments

Life-time prevalence of DSM-IV [1] panic attacks and panic disorder was assessed with the Composite International Diagnostic Interview (CIDI) [24], [25]. This is a comprehensive, fully-structured clinical interview for the diagnosis of mental disorders according to the definitions and criteria from DSM-IV. The first part of the CIDI interview consists of a set of probing screening question for all conditions and disorders of interest. If the panic attack/panic disorder screening question is endorsed, the trained interviewer uses the disorder-specific portion of the CIDI to assess exactly which DSM-IV criteria were met as well as the age of onset and frequency of the attacks. A computer algorithm uses these answers to determine whether DSM criteria for disorders were fulfilled. For this study, we used the life-time diagnosis of panic attack and the self-reported age of onset. Good reliability and validity have been reported for the CIDI [26].

For the assessment of internalizing and externalizing problems, we used the Dutch translations of the parent reported Child Behavior Checklist (CBCL/6–18) [23], [27] and the Youth Self-Report (YSR) [28], [29]. Both questionnaires assess internalizing and externalizing problems during the past six months on a 3-point scale (0 = not true; 1 = somewhat/sometimes true; 2 = very/often true). The CBCL and YSR are scored on eight narrow-band syndrome scales: Anxious/Depressed, Somatic Complaints, Withdrawn, Aggressive Behavior, Rule Breaking Behavior, Attention Problems, Social Problems and Thought Problems. In addition, broad-band Internalizing, Externalizing and Total Problem scores can be calculated [23], [28]. The Internalizing Problems score is the sum of the three scales Anxious/Depressed, Somatic Complaints and Withdrawn. Externalizing Problems is the sum of the two scales Aggressive Behavior and Rule Breaking Behavior. The Total Problem score is the sum of the eight subscales as well as additional items not included in the subscales (CBCL: 16 additional items; YSR: 10 additional items). The items and subscales on the youth self-report and the parent-report questionnaire correspond. The Dutch translation has adequate psychometric properties [27], [29].

Socio-economic status (SES) was based on ratings of occupation and education of both mother and father, as well as income. Z-scores of all five components were calculated and categorized into low (lowest 25%), medium (mid 50%) and high (upper 25%) SES. Ethnicity was self-reported and dichotomized as Dutch or non-Dutch.

Analysis

First, to examine if the panic attack sufferers between T1 and T4 differed from the subjects without panic attacks with respect to sex, age, SES, ethnicity and Internalizing and Externalizing Problems as assessed by their subscale scores of the CBCL and YSR at T1, we used Chi-square tests and analysis of variance (ANOVAs). All descriptive statistics and group comparisons were carried out using SPSS 18 for Windows.

To examine if internalizing and externalizing problems at T1 predict onset of panic attacks over adolescence, we performed continuous time survival analysis, using the maximum likelihood estimator with robust standard error (MLR), which adjusts for non-normality. The baseline hazard was non-parametrical and all survival analyses were carried out in MPlus 5.1 [30]. Sex and SES was included as covariate due to its relation to panic attacks and to multiple dimensions of problem behaviors. Survival time was the interval in years between participants’ age at T1 and age of onset of panic attacks (uncensored), or, in case of no CIDI diagnosis, age at T4 (censored). The resulting hazard ratio of this analysis describes the association between early adolescence internalizing and externalizing problems and onset of panic attacks. They are the log odds of the incremental probability of panic attacks for a unit change in the standardized score (mean = 0; standard deviation = 1) of the predictor. We performed the survival analyses in univariate as well as multivariate models. For all analyses, the significance level was set to p<.05.

Results

Prevalence of panic attacks between T1 (age 10–12) and T4 (age 17–20) was 19.8%, and the prevalence of panic disorder 1.2%. Girls were significantly more likely than boys to have had at least one panic attack between T1 and T4 and individuals from a high SES were significantly less likely to have had at least one panic attack between T1 and T4 than individuals from a low or medium SES background (Table 1). The mean age of onset of panic attacks was 15.8 years (median 16 years) and the age of onset did not differ between girls and boys, F(1) = .837, p = .36.

thumbnail
Table 1. Sample characteristics and syndrome sum scores for the unsplit sample, and separately for subjects with and without panic attack onset between T1 and T4.

https://doi.org/10.1371/journal.pone.0051564.t001

Table 1 shows the sum scores of the CBCL and YSR scales at T1. Adolescents with at least one panic attack between T1 and T4 had higher scores for parent-rated Anxious/Depressed, Social Problems and Internalizing Problems and Somatic Complaints at age 10–12 years than adolescents without a panic attack. Adolescents with at least one panic attack between T1 and T4 had higher scores on all of the self-report YSR scales at T1 than adolescents without a panic attack.

Continuous-time survival analyses were performed to examine whether problems scores at age 10–12 years predicted first onsets of panic attacks during adolescence. The hazard ratios (HR) with 95% confidence interval (CI) adjusted for gender and SES are shown in Table 2 (parent-report) and Table 3 (self-report).

thumbnail
Table 2. Results of univariate and multivariate models of survival analysis, predicting the onset of panic attacks with standardized CBCL scores and adjusted for gender and SES.

https://doi.org/10.1371/journal.pone.0051564.t002

thumbnail
Table 3. Results of univariate and multivariate models of survival analysis, predicting the onset of panic attacks with standardized YSR scores and adjusted for gender and SES.

https://doi.org/10.1371/journal.pone.0051564.t003

The CBCL Anxious/Depressed, Social Problems, Somatic Complaints, Internalizing, and Total Problems scores significantly predicted panic attack onset between T1 and T4 (all ps<.01, HR range from 1.15–1.17). As the individual problem scales share variance, we performed multivariate analyses to identify the unique contribution of each CBCL syndrome scale. With all eight syndrome scales in one model, only parent-reported Social Problems (HR = 1.19, 95%CI = 1.01–1.41) at age 10–12 years independently predicted panic attack onset (p<.05). In a final model, we examined the broad-band Internalizing and Externalizing problem scores simultaneously. In this model, only Internalizing Problems predicted panic attack onset (HR = 1.15, 95%CI = 1.02–1.28, p<.05).

Each of the eight YSR syndrome scales, as well as the Internalizing, Externalizing and Total Problems scales significantly predicted panic attack onset between T1 and T4. When the eight subscales were entered into a multivariate model, only the Social Problems (HR = 1.26, 95%CI = 1.06–1.49, p<.01) and Thought Problems (HR = 1.15, 95%CI = 1.01–1.30, p<.05) at age 10–12 years scales independently predicted panic attack onset. When examining Internalizing and Externalizing Problems simultaneously, both Internalizing Problems (HR = 1.14, 95%CI = 1.01–1.30, p<.05) and Externalizing Problems remained significant (HR = 1.19, 95%CI = 1.04–1.36, p<.01).

Discussion

While having panic attacks increases risk for psychopathology, little is known about predictors of panic attacks. In this study, we measured panic attacks and tested the power of a broad range of both parent- and self-reported problems in 10 to 12 year-old children assessed with the CBCL and YSR to predict the onset of panic attacks across adolescence.

We found a life-time prevalence rate of panic attacks of 19.8%, which is higher than the few previous studies that have assessed panic attacks with a structured interview according to DSM criteria. We suspect that the age range of our study influenced this finding. The other population samples were younger, and lifetime prevalence increases relative to the age of the sample (prevalence 3.3% at age range 9–17 years [4]; prevalence 11.6% at age range 14–16 years [11]; prevalence 19.8% at age range 17–20 years). As the peak onset of panic attacks is between 15 and 19 years, it follows that the prevalence rate of our study sample is higher than in the previous studies.

The parent-reported CBCL scales Anxious/Depressed, Social Problems, Somatic Complaints, Internalizing, and Total Problems scores predicted first onset of panic attack in adolescence. Only the Social Problems and Somatic Complaints syndrome scale predicted panic attack onset when we controlled for shared variance of the scales. All eight self-reported YSR syndrome scales, as well as the Internalizing, Externalizing and Total Problems scales predicted the onset of panic attacks. After controlling for shared variance among the eight syndrome scales and among the Internalizing and Externalizing scales in the multivariate analyses, we found that the Social Problems, Thought Problems and Externalizing scales predicted adolescent panic attack onset.

At first sight, a broad range of problem perceptions are predictive of panic attack onset. This is consistent with Hayward et al.’s suggestion that there are different pathways that lead to adolescent panic attacks [17]; however, their focus was on pathways within the internalizing spectrum of problems. Our findings extend this beyond internalizing problems to include externalizing problems and also a more wide-ranging, general perception of problematic emotions and behavior. All types of problems reported by adolescents on the YSR were risk indicators of later panic attacks. Yet, when we look closer, only a few subscales were independent risk factors. Social Problems was the most consistent risk factor for panic attacks.

This cross-informant consistent result offers broader generalizability and greater theoretical significance than if derived from just one source. The Social Problems scale comprises items such as “acts too young for age,” “too dependent,” “does not get along with other kids,” “gets teased a lot,” “not liked by other kids,” “poorly coordinated or clumsy,” and “prefers being with younger kids”. The long-term consequences of problems with peer relations are supported by findings in other longitudinal research, among which TRAILS: Adolescents who reported to be bullied at age 10–12 years reported persistently higher scores of anxiety symptoms, including symptoms of panic over adolescence, regardless of the continuation of victimization at later ages [31]. In another sample, Roza et al. [19] reported a unique prospective relation between the CBCL Social Problems scale (4–16 years) and lifetime incidence of anxiety disorders (among which panic disorder) assessed 14 years later.

The association found between Social Problems and onset of panic attacks may be the result of a downward spiral starting with poor social skills and difficulties in peer relations, which in turn can lead to even lower self-confidence, and feelings of lack of control and helplessness. Yet, it may also be an expression of genetic transmission of vulnerability from parents to their children, or gene-environment interaction. An adolescent who reports panic attacks is likely to have parents who experience panic attacks or panic disorder [13], [32], [33]. Cross-sectional studies show that adults with panic attacks have problems with relations with others [34][36], which may lead to transmission of less developed social skills to their offspring, eventually resulting in social problems in children.

The current study has several strengths and weaknesses. The main strength is that we used a large adolescent sample representative of the general population of adolescents, covering the age range from 10 to 20 years. Also, our predictor variables were assessed prospectively, which avoids selective recall bias. Furthermore, we used information from multiple informants and we assessed panic attacks with strictly defined criteria. The main weakness of this study is that our data were censored at age 17–20 (T4) and consequentially, they did not extend through the entire peak risk period. Generalization of our findings to panic attack onset beyond adolescence will need to be confirmed in future studies. Second, we relied on a snap-shot assessment of clinical symptoms rather than relying on information about longitudinal course of symptoms. It is possible that incorporating symptom course may result in stronger effects. Lastly, our analyses focused on clinical scales to forecast risk for future panic attacks. Additional domains of risk, including social functioning, stress reactivity, anxiety sensitivity [37], and family history could be plausibly related to the onset of panic attacks or panic disorder. Future work in these areas could be interesting. Due to the novelty of our findings, there are limited direct implications for clinical interventions. In the context of prevention, however, there are some potential areas of clinical relevance. First, as associations are found using predictors in early adolescence, early assessment of these indicators can be important for effective preventative intervention. Second, predictors of panic attacks are not limited to the internalizing spectrum only. Assessment of risk for panic attacks is warranted among youth with externalizing problems as well. Thus, by recognizing early risk for panic attacks, problems associated with panic may be averted. Importantly, additional research on predictors of panic attacks is needed before specific clinical intervention recommendations can be formulated.

An important direction for future research is to focus on identifying pathways and mechanisms that explain how early Internalizing, Externalizing and Social Problems increase the risk of panic attack onset in adolescence. In this, an important first step is to identify specific aspects of Social Problems that predict panic attacks. Furthermore, information about panic attacks and panic disorder from first degree relatives should be included to advance understanding of how panic attacks may be transmitted across generations, including genetic and environmental means. Lastly, it is relevant to examine factors that predict and explain the progression from panic attacks to panic disorder. To conclude, we identified childhood Social Problems as consistent independent risk factor of adolescent panic attacks. In addition, we find that the risk markers of developing adolescent panic attacks are diverse and extend beyond problems in the internalizing spectrum to include externalizing problems and a broad-spectrum problems perception.

Acknowledgments

This research is part of the TRacking Adolescents’ Individual Lives Survey (TRAILS). Participating centers of TRAILS include various departments of the University Medical Center and University of Groningen, the Erasmus University Medical Center Rotterdam, the University of Utrecht, the Radboud Medical Center Nijmegen, and the Parnassia Bavo group, all in the Netherlands. We are grateful to all adolescents, their parents and teachers who participated in this research and to everyone who worked on this project and made it possible.

Author Contributions

Conceived and designed the experiments: FV. Analyzed the data: CM TO FvO FV. Wrote the paper: CM TO FvO FV.

References

  1. 1. American Psychiatric Association (2000) Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR). Washington, DC: American Psychiatric Association.
  2. 2. Angst J (1995) History and epidemiology of panic. Eur Psychiat 10: S57–S59.
  3. 3. Norton GR, Cox BJ, Malan J (1992) Nonclinical panickers - A critical-review Clin Psychol Rev. 12: 121–139.
  4. 4. Goodwin RD, Gotlib IH (2004) Panic attacks and psychopathology among youth. Acta Psychiatr Scand 109: 216–221.
  5. 5. Hayward C, Killen JD, Kraemer HC, Blair-Greiner A, Strachowski D, et al. (1997) Assessment and phenomenology of nonclinical panic attacks in adolescent girls. J Anxiety Disord 11: 17–32.
  6. 6. Mattis SG, Ollendick TH (2002) Nonclinical panic attacks in late adolescence prevalence and associated psychopathology. J Anxiety Disord 16: 351–367.
  7. 7. Goodwin RD, Lieb R, Hoefler M, Pfister H, Bittner A, et al. (2004) Panic attack as a risk factor for severe psychopathology. Am J Psychiat 161: 2207–2214.
  8. 8. Kinley DJ, Walker JR, Enns MW, Sareen J (2011) Panic attacks as a risk for later psychopathology: results from a nationally representative survey. Depress Anxiety 28: 412–419.
  9. 9. Valentiner DP, Mounts NS, Deacon BJ (2004) Panic attacks, depression and anxiety symptoms, and substance use behaviors during late adolescence. J Anxiety Disord 18: 573–585.
  10. 10. Craske MG, Kircanski K, Epstein A, Wittchen HU, Pine DS, et al. (2010) Panic disorder: a review of DSM-IV panic disorder and proposals for DSM-V. Depress Anxiety 27: 93–112.
  11. 11. Hayward C, Killen JD, Taylor CB (1989) Panic attacks in young adolescents. Am J Psychiat 146: 1061–1062.
  12. 12. Macaulay JL, Kleinknecht RA (1989) Panic and panic attacks in adolescents. J Anxiety Disord 3: 221–241.
  13. 13. Hettema JM, Neale MC, Kendler KS (2001) A review and meta-analysis of the genetic epidemiology of anxiety disorders. Am J Psychiat 158: 1568–1578.
  14. 14. Reed V, Wittchen HU (1998) DSM-IV panic attacks and panic disorder in a community sample of adolescents and young adults: how specific are panic attacks? J Psychiatr Res 32: 335–345.
  15. 15. Ollendick TH, Mattis SG, King NJ (1994) Panic in children and adolescents - a review. J Child Psychol Psychiatry Allied Discip 35: 113–134.
  16. 16. Goodwin RD, Hamilton SP (2002) The early-onset fearful panic attack as a predictor of severe psychopathology. Psychiatry Res 109: 71–79.
  17. 17. Hayward C, Wilson KA, Lagle K, Killen JD, Taylor CB (2004) Parent-reported predictors of adolescent panic attacks. J Am Acad Child Adolesc Psychiatr 43: 613–620.
  18. 18. Hayward C, Killen JD, Kraemer HC, Taylor CB (2000) Predictors of panic attacks in adolescents. J Am Acad Child Adolesc Psychiatr 39: 207–214.
  19. 19. Roza SJ, Hofstra MB, van der Ende J, Verhulst FC (2003) Stable prediction of mood and anxiety disorders based on behavioral and emotional problems in childhood: A 14-year follow-up during childhood, adolescence, and young adulthood. Am J Psychiat 160: 2116–2121.
  20. 20. de Winter AF, Oldehinkel AJ, Veenstra R, Brunnekreef JA, Verhulst FC, et al. (2005) Evaluation of non-response bias in mental health determinants and outcomes in a large sample of pre-adolescents. Eur J Epidemiol 20: 173–181.
  21. 21. Huisman M, Oldehinkel AJ, de Winter A, Minderaa RB, de Bildt A, et al. (2008) Cohort Profile: The Dutch ‘TRacking Adolescents Individual Lives’ Survey’; TRAILS. Int J Epidemiol 37: 1227–1235.
  22. 22. Nederhof E, Jorg F, Raven D, Veenstra R, Verhulst FC, et al.. (2012) Benefits of extensive recruitment effort persist during follow-ups and are consistent across age group and survey method. The TRAILS study. BMC Medical Research Methodology 12.
  23. 23. Achenbach TM, Rescorla LA (2003) Manual for the ASEBA Adult Forms & Profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families.
  24. 24. Kessler RC, Ustun TB (2004) The World Mental Health (WMH) Survey Initiative Version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI). Int J Methods Psychiatr Res 13: 93–121.
  25. 25. World Health Organization (1990) Composite International Diagnostic Interview (CIDI) version 3.0. Geneva: World Health Organization.
  26. 26. Andrews G, Peters L (1998) The psychometric properties of the composite international diagnostic interview. Soc Psychiatry Psychiatr Epidemiol 33: 80–88.
  27. 27. Verhulst FC, Van der Ende J, Koot HM (1996) Handleiding voor de CBCL/4–18 [Dutch manual for the CBCL/4–18]. Rotterdam: Academic Medical Center Rotterdam/Erasmus University, Sophia Children’s Hospital, Department of Child and Adolescent Psychiatry.
  28. 28. Achenbach TM, Rescorla LA (2001) Manual for the ASEBA School-Age Forms and Profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families.
  29. 29. Verhulst FC, Van der Ende J, Koot HM (1997) Handleiding voor de Youth Self-Report (YSR) [Manual for the Youth Self-Report (YSR)]. Rotterdam: Academic Medical Center Rotterdam/Erasmus University, Sophia Children’s Hospital, Department of Child and Adolescent Psychiatry.
  30. 30. Muthén LK, Muthén BO (1998–2007) Mplus User’s Guide, 5th edition. Los Angeles, CA: Muthén & Muthén.
  31. 31. van Oort FVA, Greaves-Lord K, Ormel J, Verhulst FC, Huizink AC (2011) Risk indicators of anxiety throughout adolescence: The TRAILS study. Depress Anxiety 28: 485–494.
  32. 32. Goldstein RB, Wickramaratne PJ, Horwath E, Weissman MM (1997) Familial aggregation and phenomenology of ‘early’-onset (at or before age 20 years) panic disorder. Archives of General Psychiatry 54: 271–278.
  33. 33. Schumacher J, Kristensen AS, Wendland JR, Nothen MM, Mors O, et al. (2011) The genetics of panic disorder. J Med Genet 48: 361–368.
  34. 34. Scocco P, Barbieri I, Frank E (2007) Interpersonal problem areas and onset of panic disorder. Psychopathology 40: 8–13.
  35. 35. Bradley SJ, Hood J (1993) Psychiatrically referred adolescents with panic attacks - presenting symptoms, stressors, and comorbidity. J Am Acad Child Adolesc Psychiatr 32: 826–829.
  36. 36. Svanborg C, Baarnhielm S, Wistedt AA, Lutzen K (2008) Helpful and hindering factors for remission in dysthymia and panic disorder at 9-year follow-up: A mixed methods study. BMC Psychiatry: http://www.biomedcentral.com/content/pdf/1471-244X-8-52.pdf. Accessed 16 April 2012.
  37. 37. Schmidt NB, Zvolensky MJ, Maner JK (2006) Anxiety sensitivity: Prospective prediction of panic attacks and Axis I pathology. J Psychiatr Res 40: 691–699.