Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Open Access

Peer-reviewed

Research Article

Use of the MATRICS consensus cognitive battery (MCCB) to evaluate cognitive deficits in bipolar disorder: A systematic review and meta-analysis

  • Qijing Bo ,

    Contributed equally to this work with: Qijing Bo, Zhen Mao

    Affiliations Beijing Key Laboratory of Mental Disorders, Department of Psychiatry, Beijing Anding Hospital, Capital Medical University, Beijing, China, Center of Schizophrenia, Beijing Institute for Brain Disorders, Laboratory of Brain Disorders (Capital Medical University), Ministry of Science and Technology, Beijing, China

    ⨯
  • Zhen Mao ,

    Contributed equally to this work with: Qijing Bo, Zhen Mao

    Affiliations Beijing Key Laboratory of Mental Disorders, Department of Psychiatry, Beijing Anding Hospital, Capital Medical University, Beijing, China, Center of Schizophrenia, Beijing Institute for Brain Disorders, Laboratory of Brain Disorders (Capital Medical University), Ministry of Science and Technology, Beijing, China

    ⨯
  • Xianbin Li,

    Affiliations Beijing Key Laboratory of Mental Disorders, Department of Psychiatry, Beijing Anding Hospital, Capital Medical University, Beijing, China, Center of Schizophrenia, Beijing Institute for Brain Disorders, Laboratory of Brain Disorders (Capital Medical University), Ministry of Science and Technology, Beijing, China

    ⨯
  • Zhimin Wang,

    Affiliations Beijing Key Laboratory of Mental Disorders, Department of Psychiatry, Beijing Anding Hospital, Capital Medical University, Beijing, China, Center of Schizophrenia, Beijing Institute for Brain Disorders, Laboratory of Brain Disorders (Capital Medical University), Ministry of Science and Technology, Beijing, China

    ⨯
  • Chuanyue Wang,

    Affiliations Beijing Key Laboratory of Mental Disorders, Department of Psychiatry, Beijing Anding Hospital, Capital Medical University, Beijing, China, Center of Schizophrenia, Beijing Institute for Brain Disorders, Laboratory of Brain Disorders (Capital Medical University), Ministry of Science and Technology, Beijing, China

    ⨯
  • Xin Ma

    mxmanu@163.com

    Affiliation Beijing Key Laboratory of Mental Disorders, Department of Psychiatry, Beijing Anding Hospital, Capital Medical University, Beijing, China

    ⨯

Abstract

Background

The Measurement and Treatment Research to Improve Cognition Schizophrenia Consensus Cognitive Battery (MCCB) has also been proposed for use in clinical trials to assess cognitive deficits in patients with bipolar disorder (BD). The aim of this study was to evaluate cognitive function assessed by the MCCB in BD.

Methods

A literature search of the PubMed, Embase, PsycINFO, SCI, Cochrane Library databases and the Cochrane Controlled Trials Register was conducted. Case reports, reviews and meta-analyses were excluded and a systematic review of the remaining studies of cognitive function in BD was carried out. The cognitive outcome measure was the MCCB, including 7 domains and overall cognition. A random-effects model was applied.

Results

Eighty eight studies were initially identified. Seven clinical studies comprising a total of 487 patients and 570 healthy controls (HC) were included in the meta-analysis. Patients with BD performed worse than HC in overall cognition and processing speed with a large effect size of >0.8; with a medium effect size (0.5–0.8) in attention, working memory, verbal learning and visual learning; and with a small effect size (0.2–0.5) in reasoning and problem solving and social cognition.

Conclusion

Patients with BD performed worse than HC in overall cognition and all cognitive domains of the MCCB. Cognitive deficits in domains of processing speed and working memory are prominent in patients with BD. Our findings suggest that MCCB can be usefully applied in BD.

Citation: Bo Q, Mao Z, Li X, Wang Z, Wang C, Ma X (2017) Use of the MATRICS consensus cognitive battery (MCCB) to evaluate cognitive deficits in bipolar disorder: A systematic review and meta-analysis. PLoS ONE 12(4): e0176212. https://doi.org/10.1371/journal.pone.0176212

Editor: Peter John McKenna, SPAIN

Received: October 26, 2016; Accepted: March 20, 2017; Published: April 24, 2017

Copyright: © 2017 Bo et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data are within the paper.

Funding: Supported by Beijing Municipal Administration of Hospitals Clinical Medicine Development of Special Funding Support (ZYLX201403) and the Beijing Science and Technology Commission (D121100005012002).

Competing interests: The authors have declared that no competing interests exist.

Introduction

Cognitive impairment in schizophrenia has been noted for more than a century and has been a focus of research interest from the 1980s onwards [1]. Cognitive impairment is also recognized in major affective disorder: it has been recognized and studied in major depression for a long time [2], although studies of cognition in bipolar disorder (BD) are a more recent development [3]. Cognitive impairment is thus an important clinical symptom in bipolar disorder, and it may be that measures which produce improvements in cognition could provide better functioning and quality of life in patients [4]. Cognitive deficits in BD have been found in many domains of function, including attention, verbal learning/memory and executive function. Impairment of cognition has also been documented in first episode BD [5], in both bipolar type I (BD-I) and type II disorder (BD-II) patients, in the premorbid stage [6] and during periods of euthymic [7], with many of the findings being supported by meta-analysis [8–10].

Up to 167 instruments are currently available for the clinical assessment of cognitive dysfunction in schizophrenia, major depressive disorder and BD. However only two instruments frequently used in BD have been deemed appropriate [11]. In schizophrenia, a consensus clinical battery, The Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) has been developed with the purpose of showing practical utility, good test–retest reliability and especially potential sensitivity to treatments designed to improve cognitive function in the disorder [12]. The MATRICS Consensus Cognitive Battery (MCCB) has been recommended by the United States Food and Drug Administration (FDA) to assess cognitive impairment as the primary outcome measure in registry trials of schizophrenia [13]. In contrast, no consensus has been reached on the optimal assessment of cognition in BD. Based on the clinical and cognitive overlap between schizophrenia and BD, some data have suggested that the MCCB might be a useful outcome measure for the assessment of cognitive function in BD [14]. The application of the MCCB in BD has been explored and proposed by the international society for bipolar disorder (ISBD) as a part of the battery for assessment of neurocognition in BD [15]. The objectives of this study were to assess cognitive function assessed by MCCB in BD.

Materials and methods

Search strategy

Studies evaluating cognitive performance in BD using the MCCB were identified by two authors by searching PubMed, Embase, PsycINFO, SCI, the Cochrane Library databases, the Cochrane Controlled Trials Register and the Chinese databases (CBM, CNKI, and WanFang). The search terms included: bipolar disorder, manic-depress, mania, psychosis, MCCB, MATRICS. All studies from inception to July 2016 were reviewed. Both indexing and free text search were used. No language restriction was set. The keywords were used in combination with the Boolean operators AND, OR, and NOT. The references of included articles were also screened to identify additional relevant studies.

Before initiating the study, our protocol for the review of cognitive function in bipolar disorder by MATRICS was registered online (http://www.crd.york.ac.uk/prospero/; registration number CRD42016046737 at the Preferred Reporting Items for Systematic Reviews and Meta-Analyses, PRISMA). PRISMA provides an evidence-based minimum set of items for reporting in systematic reviews and meta-analyses [16]. PRISMA Checklist has been included as supporting information “BPcognition-PRISMA checklist.doc” (S1 Checklist).

Study selection criteria

Studies were included if performance was evaluated in BD using the MCCB. The specific meta-analysis criteria were as follows, i) Individuals were diagnosed with BD; if a study included patients with both schizophrenia and bipolar disorder, independent assessment of the bipolar disorder patients was required; ii) Cognitive performance was assessed using the MCCB; articles that used tests not covered by MCCB were excluded; iii) A healthy control (HC) group was included in the study. Review articles and case reports were not considered. If data were provided but were incomplete for the current aim, the authors were contacted by e-mail and asked to provide related information; where the authors did not respond the articles were excluded. Studies to be included for the meta-analysis were assessed by authors QJ-B and Z-M independently. Where the authors’ opinions differs a third author was consulted.

Measures of cognition function

Cognitive function was measured according to the 7 cognitive domains of the MCCB derived from scores on 10 cognitive measures: speed of processing (Trail Making Test Part A; Brief Assessment of Cognition in Schizophrenia: Symbol coding; Category fluency test, animal naming), attention/vigilance (Continuous Performance Test: Identical Pairs), working memory (Wechsler Memory Scale, spatial span subset; Letter Number Span test), verbal learning (refers to immediate verbal memory, Hopkins Verbal Learning Test (HVLT)-Revised, immediate recall), visual learning (refers to immediate visual memory, Brief Visuospatial Memory Test-Revised), reasoning and problem solving (Neuropsychological Assessment Battery (NAB), mazes subtest), and social cognition (Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT): managing emotions branch) [13, 17].

Data analyses

Descriptive statistics for the sample characteristics and meta-analysis were performed with the software STATA (Stata Corporation, USA). A random-effects models was applied using the Metan command [18]. Cohen's method was performed to calculate standardized mean differences (SMD): effect sizes were calculated according to the difference between the means of BD and HC group divided by the pooled standard deviation (Cohen's d). Values over 0.8 are considered to represent a large effect size (ES), while values ranging from 0.5–0.8 and 0.2–0.5 represent medium and small ES respectively. The weighting to each SMD was calculated based on the sample size to compute the overall SMDs. Heterogeneity was assessed by the I2 test, which calculates the percentage of variation across studies due to heterogeneity rather than chance [19, 20]. Values of 25%, 50% and 75% correspond to low, moderate and high heterogeneity respectively. Tau2 was used as a measure of between study heterogeneity to undertake a random-effects. Publication bias was examined by the Egger's test [21] using the STATA Metabias command. Sensitivity analyses were performed by the metaninf command to investigate the influence of each individual study on the overall pooled ES estimate for each cognitive domain. To control for outlying outcomes from single study, the resiliency of every pooled ES to individual studies was estimated. The significance level was set at P < 0.05.

Results

Included studies

As shown in Fig 1, 88 studies were identified in the initial literature search. Of these, 17 were examined in detail, and that this led to 10 studies were excluded, leaving 7 in the meta-analysis (Table 1). Table 2 summarizes the objectives, samples, methods and results of the 10 studies that were excluded.

thumbnail
Download:
Fig 1. Literature search flow.

https://doi.org/10.1371/journal.pone.0176212.g001

thumbnail
Download:
Table 1. Studies included in the meta-analysis.

https://doi.org/10.1371/journal.pone.0176212.t001

thumbnail
Download:
Table 2. Studies excluded in meta-analysis but included in qualitative synthesis.

https://doi.org/10.1371/journal.pone.0176212.t002

Table 1 summarizes the characteristics of the 7 studies that met the eligibility criteria for meta-analysis in full. Six studies were published in English and one in Chinese. Five studies were conducted in the United States, one in Australia and one in China. Publication year ranged from 2011 to 2016.

A total of 487 BD patients and 570 HC were included in the meta-analyses. The sample sizes of the selected studies ranged from 71 to 284. The majority of patients were diagnosed with BD-I (76.6%), followed by BD-II (10.7%) and BD NOS (1.2%). In the remaining 11.5% BD subclassification was not reported. 30.2% of patients were diagnosed with euthymic BD and 21.8% with symptomatic BD, while diagnosis of the remaining 48% was not reported. The characteristics of the whole sample were described in Table 3.

thumbnail
Download:
Table 3. Sample characteristics of included 7 studies.

https://doi.org/10.1371/journal.pone.0176212.t003

Differences between BD and HC

The results of the meta-analysis are summarized in Table 4; forest plots are shown in Fig 2. The BD patients performed more poorly than the HC in all 7 domains and in the composite score. Patients with BD exhibited worse performance than HC in overall cognition and processing speed with large ES (>0.8); in attention, working memory, verbal learning and visual learning with medium ES (0.5–0.8); in reasoning and problem solving and social cognition with small ES (0.2–0.5).

thumbnail
Download:
Fig 2. Forest plots of individual and pooled estimates of the SMD with random effect model between BD and HC groups for seven domains and composite scores of MCCB.

https://doi.org/10.1371/journal.pone.0176212.g002

thumbnail
Download:
Table 4. Test for effect (Z, P), homogeneity (I2, Tau2), publication bias, and sensitivity analyses (pooled ES range; each study removed).

https://doi.org/10.1371/journal.pone.0176212.t004

Heterogeneity

Composite scores were moderately heterogeneous across studies (P = 0.048, I2 = 52.7%, tau2 = 0.0358). In particular, attention had a high heterogeneity (P <0.001, I2 = 78.9%, tau2 = 0.1147) and processing speed had a moderate heterogeneity (P = 0.001, I2 = 72.6%, tau2 = 0.0856). Other cognitive domains displayed lower heterogeneity with I2s ranging from 0 to 48.6% (Table 4).

Publication bias

Among the MCCB test scores, only working memory (t = 2.85, df = 6, P = 0.029) showed evidence of being influenced by publication bias (Egger's test, Table 4).

Sensitivity analyses

Sensitivity analyses were performed for composite score and each significant cognitive domain. The statistical significance remained unchanged no matter which study was removed from the analysis. Examining the range of pooled ES in the composite score and each cognitive domain (Table 4) revealed that removal of each individual study from the pooled effect produced only a relatively little instability of the current findings.

Discussion

This is the first meta-analysis examining the cognitive function of patients with BD as assessed using the MCCB. Among studies without language restrictions, it was possible to include seven studies comprising 487 patients with BD and 570 HC. Impairment in cognitive functions across all MCCB domains was detected in patients with BD compared to HC, with ES ranging from small to large. Cognitive deficits in domains of processing speed and working memory were found to be most prominent.

A previous meta-analyses found medium to large ES for differences between BD patients and HC in attention, processing speed, episodic memory and executive function [22]. Another meta-analysis reported impairment in verbal learning and memory and phonemic fluency with medium to large ES [23]. Findings have been similar in subsequent meta-analyses [9, 24, 25]. A systematic review of cognitive function in young BD patients during the first episode [6] found evidence of deficits across a range of domains, including verbal memory, attention, and executive functions, as did another systematic review of euthymic late-life BD subjects [26]. Our findings are consistent with these previous studies, but indicate impairment in a larger range of domains. Medium to large ES differences were observed in overall cognition, processing speed, attention, working memory, verbal learning and visual learning. Impairments in processing speed and working memory were found to be more prominent than those in attention, verbal learning and visual learning.

Social cognition is not usually considered in the assessment of cognitive function. However the MCCB includes social cognition measures, seemingly because of its negative effects on functional outcome in schizophrenia. The present meta-analysis finds that social cognitive deficits are also present in BD, in line with the results of existing studies [27, 28] and meta-analyses [29, 30]. While earlier work has found that social cognition impairment in BD has a medium ES, the current meta-analysis found it to be in the small range (-0.29), when assessed using the MCCB. Social cognition contains three main dimensions, namely emotion comprehension (ability to infer and appraise the emotional state displayed by other people), theory of mind (ability to ascribe mental states such as intents, desires, beliefs, knowledge and pretending) and attribution theory (interpretation of reward/punishment in relation to the individual’s thinking and behavior) [31, 32]. Further studies will be required to clarify the overall degree of social cognition impairment in BD and to further specify the degree of impairment in its different subdomains.

The MCCB was developed for schizophrenia and is frequently used in clinical trials in patients with this disorder. Nevertheless, the ISBD consider that it is also suitable for BD research and it has been included in the International Society for Bipolar Disorders–Battery for Assessment of Neurocognition (ISBD-BANC) [15]. The application of MCCB in BD patients began in 2011 and has increased gradually by year partly as a result of the ISBD recommendation. In comparison to previous meta-analyses of cognitive performance in BD patients, the present study focused on one instrument, avoiding differences in cognitive assessment instruments, helpful for pooling data for meta-analysis, and to be benefit of comparing with other psychoses such as schizophrenia.

Certain methodological limitations of the current study should be taken into account. Firstly, basing the analysis on group means in BD patients may tend to mask the effects of heterogeneity, ie the fact that some patients have no cognitive deficits while in others they are severe. Reporting of group means is the standard approach in neuropsychological studies of BD, and as a result there is no other way to pool data for meta-analytic purposes. Secondly, our meta-analysis does not provide any information regarding the longitudinal trajectory of cognitive dysfunction from the early stage to the chronic phase of disease. We note here that previous longitudinal meta-analysis of cognitive deficits in BD suggested that there was not enough evidence to indicate that cognitive dysfunction was a progressive course [33]. More in-depth studies will be required to explore the development of cognition and the magnitude of neuropsychological deficits in BD. Another limitation was that the potential effect of medications used in BD which impact cognition, e.g. mood stabilizers, antipsychotics, benzodiazepines, could not be examined. Similarly, the effects of BP subtypes (BP I vs BP II; psychotic vs nonpsychotic BD) and mood state (euthymic vs symptomatic) were not explored in this study due to the lack of data availability. The small number of studies included in the meta-analysis hindered analysis of moderator variables, which may influence cognitive performance. Lastly, various levels of heterogeneity were found among the cognitive domains and only the working memory domain displayed publication bias, which may indicate variability among the cognitive domains and the presence of bias or asymmetry in the literature.

Supporting information

S1 Checklist. “BPcognition-PRISMA checklist.doc”.

https://doi.org/10.1371/journal.pone.0176212.s001

(DOC)

Acknowledgments

The authors thank Medjaden Bioscience Limited for editorial assistance.

Author Contributions

  1. Conceptualization: QB ZM XM.
  2. Data curation: QB ZM.
  3. Formal analysis: QB XL.
  4. Funding acquisition: XM.
  5. Investigation: ZW CW.
  6. Methodology: QB ZM.
  7. Project administration: XM.
  8. Resources: QB XL.
  9. Software: QB ZM.
  10. Supervision: CW.
  11. Validation: ZW CW.
  12. Writing – original draft: QB ZM.
  13. Writing – review & editing: CW XM.

References

  1. 1. Goldberg T, David A, Gold J. Neurocognitive deficits in schizophrenia. In Schizophrenia, 2nd edition, ed Hirsch SR and n DR. Oxford: Blackwell.168–86.
    • 2. Miller WR. Psychological deficit in depression. Psychological bulletin. 1975;82(2):238–60. Epub 1975/03/01. pmid:1096208
    • 3. Murphy FC, Sahakian BJ. Neuropsychology of bipolar disorder. The British journal of psychiatry: the journal of mental science. 2001;178(Suppl 41):S120–7. Epub 2001/06/05.
    • 4. Martinez-Aran A, Vieta E. Cognition as a target in schizophrenia, bipolar disorder and depression. European neuropsychopharmacology: the journal of the European College of Neuropsychopharmacology. 2015;25(2):151–7.
    • 5. Bora E, Pantelis C. Meta-analysis of Cognitive Impairment in First-Episode Bipolar Disorder: Comparison With First-Episode Schizophrenia and Healthy Controls. Schizophr Bull. 2015;41(5):1095–104. PubMed Central PMCID: PMCPMC4535631. pmid:25616505
    • 6. Martino DJ, Samame C, Ibanez A, Strejilevich SA. Neurocognitive functioning in the premorbid stage and in the first episode of bipolar disorder: a systematic review. Psychiatry Res. 2015;226(1):23–30. pmid:25618475
    • 7. Harvey PD, Wingo AP, Burdick KE, Baldessarini RJ. Cognition and disability in bipolar disorder: lessons from schizophrenia research. Bipolar Disord. 2010;12(4):364–75. Epub 2010/07/20. pmid:20636633
    • 8. Cardenas SA, Kassem L, Brotman MA, Leibenluft E, McMahon FJ. Meta-analysis of Cognitive Impairment in First-Episode Bipolar Disorder: Comparison With First-Episode Schizophrenia and Healthy Controls. Neuroscience & Biobehavioral Reviews. 2016;69:193–215.
    • 9. Cardenas SA, Kassem L, Brotman MA, Leibenluft E, McMahon FJ. Neurocognitive functioning in euthymic patients with bipolar disorder and unaffected relatives: A review of the literature. Neuroscience and biobehavioral reviews. 2016;69:193–215. PubMed Central PMCID: PMCPMC5030183. pmid:27502749
    • 10. Bortolato B, Miskowiak KW, Kohler CA, Vieta E, Carvalho AF. Cognitive dysfunction in bipolar disorder and schizophrenia: a systematic review of meta-analyses. Neuropsychiatr Dis Treat. 2015;11:3111–25. PubMed Central PMCID: PMCPMC4689290. pmid:26719696
    • 11. Bakkour N, Samp J, Akhras K, El Hammi E, Soussi I, Zahra F, et al. Systematic review of appropriate cognitive assessment instruments used in clinical trials of schizophrenia, major depressive disorder and bipolar disorder. Psychiatry research. 2014;216(3):291–302. Epub 2014/03/25. pmid:24656516
    • 12. Green MF, Nuechterlein KH. The MATRICS initiative: developing a consensus cognitive battery for clinical trials. Schizophr Res. 2004;72(1):1–3. Epub 2004/11/09. pmid:15531401
    • 13. Nuechterlein KH, Green MF, Kern RS, Baade LE, Barch DM, Cohen JD, et al. The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. The American journal of psychiatry. 2008;165(2):203–13. Epub 2008/01/04. pmid:18172019
    • 14. Burdick KE, Goldberg TE, Cornblatt BA, Keefe RS, Gopin CB, Derosse P, et al. The MATRICS consensus cognitive battery in patients with bipolar I disorder. Neuropsychopharmacology: official publication of the American College of Neuropsychopharmacology. 2011;36(8):1587–92. Epub 2011/04/01. PubMed Central PMCID: PMCPmc3138672.
    • 15. Yatham LN, Torres IJ, Malhi GS, Frangou S, Glahn DC, Bearden CE, et al. The International Society for Bipolar Disorders-Battery for Assessment of Neurocognition (ISBD-BANC). Bipolar Disord. 2010;12(4):351–63. pmid:20636632
    • 16. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine. 2009;151(4):264–9. pmid:19622511
    • 17. Nuechterlein KH, Barch DM, Gold JM, Goldberg TE, Green MF, Heaton RK. Identification of separable cognitive factors in schizophrenia. Schizophr Res. 2004;72(1):29–39. Epub 2004/11/09. pmid:15531405
    • 18. DerSimonian R, Laird N. Meta-analysis in clinical trials. Controlled clinical trials. 1986;7(3):177–88. Epub 1986/09/01. pmid:3802833
    • 19. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. Bmj. 2003;327(7414):557–60. Epub 2003/09/06. PubMed Central PMCID: PMCPMC192859. pmid:12958120
    • 20. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Statistics in medicine. 2002;21(11):1539–58. Epub 2002/07/12. pmid:12111919
    • 21. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. Bmj. 1997;315(7109):629–34. PubMed Central PMCID: PMCPMC2127453. pmid:9310563
    • 22. Torres IJ BV, Yatham LN. Neuropsychological functioning in euthymic bipolar disorder: a meta-analysis. Acta Psychiatr Scand Suppl. 2007.
    • 23. Kurtz MM, Gerraty RT. A meta-analytic investigation of neurocognitive deficits in bipolar illness: profile and effects of clinical state. Neuropsychology. 2009;23(5):551–62. PubMed Central PMCID: PMC2804472. pmid:19702409
    • 24. Bourne C, Aydemir O, Balanza-Martinez V, Bora E, Brissos S, Cavanagh JT, et al. Neuropsychological testing of cognitive impairment in euthymic bipolar disorder: an individual patient data meta-analysis. Acta psychiatrica Scandinavica. 2013;128(3):149–62. Epub 2013/04/27. pmid:23617548
    • 25. Daglas R, Yucel M, Cotton S, Allott K, Hetrick S, Berk M. Cognitive impairment in first-episode mania: a systematic review of the evidence in the acute and remission phases of the illness. Int J Bipolar Disord. 2015;3:9. PubMed Central PMCID: PMCPMC4408302. pmid:25914866
    • 26. Samamé C, Martino DJ, Strejilevich SA. A quantitative review of neurocognition in euthymic late-life bipolar disorder. Bipolar Disorders. 2013;15(6):633–44. pmid:23651122
    • 27. Bora E, Vahip S, Gonul AS, Akdeniz F, Alkan M, Ogut M, et al. Evidence for theory of mind deficits in euthymic patients with bipolar disorder. Acta psychiatrica Scandinavica. 2005;112(2):110–6. Epub 2005/07/05. pmid:15992392
    • 28. Montag C, Ehrlich A, Neuhaus K, Dziobek I, Heekeren HR, Heinz A, et al. Theory of mind impairments in euthymic bipolar patients. Journal of affective disorders. 2010;123(1–3):264–9. Epub 2009/09/15. pmid:19748680
    • 29. Samamé C, Martino DJ, Strejilevich SA. Social cognition in euthymic bipolar disorder: systematic review and meta-analytic approach. Acta Psychiatrica Scandinavica. 2012;125(4):266–80. pmid:22211280
    • 30. Bora E, Pantelis C. Social cognition in schizophrenia in comparison to bipolar disorder: A meta-analysis. Schizophr Res. 2016;175(1–3):72–8. pmid:27117677
    • 31. Cusi AM, Nazarov A, Holshausen K, Macqueen GM, McKinnon MC. Systematic review of the neural basis of social cognition in patients with mood disorders. Journal of psychiatry & neuroscience: JPN. 2012;37(3):154–69. Epub 2012/02/03. PubMed Central PMCID: PMCPMC3341408.
    • 32. Colom F. Social cognition and its potential role in bipolar disorder roughening: an editorial comment to Samame C, Matino DJ, Strejilevich S. 'Social cognition in euthymic bipolar disorder: systematic review and meta-analytic approach' (1). Acta psychiatrica Scandinavica. 2012;125(4):264–5. Epub 2012/03/13. pmid:22404207
    • 33. Samame C, Martino DJ, Strejilevich SA. Longitudinal course of cognitive deficits in bipolar disorder: a meta-analytic study. Journal of affective disorders. 2014;164:130–8. pmid:24856566
    • 34. Lewandowski KE, Whitton AE, Pizzagalli DA, Norris LA, Ongur D, Hall MH. Reward Learning, Neurocognition, Social Cognition, and Symptomatology in Psychosis. Frontiers in psychiatry. 2016;7:100. Epub 2016/07/06. PubMed Central PMCID: PMCPMC4906007. pmid:27378952
    • 35. Sperry SH, O'Connor LK, Ongur D, Cohen BM, Keshavan MS, Lewandowski KE. Measuring Cognition in Bipolar Disorder with Psychosis Using the MATRICS Consensus Cognitive Battery. Journal of the International Neuropsychological Society: JINS. 2015;21(6):468–72. Epub 2015/07/15. pmid:26154947
    • 36. Burdick KE, Russo M, Frangou S, Mahon K, Braga RJ, Shanahan M, et al. Empirical evidence for discrete neurocognitive subgroups in bipolar disorder: clinical implications. Psychological medicine. 2014;44(14):3083–96. Epub 2014/07/30. PubMed Central PMCID: PMCPmc4797987. pmid:25065409
    • 37. Russo M, Mahon K, Shanahan M, Ramjas E, Solon C, Braga RJ, et al. Affective temperaments and neurocognitive functioning in bipolar disorder. Journal of affective disorders. 2014;169:51–6. Epub 2014/08/26. PubMed Central PMCID: PMCPmc4172290. pmid:25151191
    • 38. Van Rheenen TE, Rossell SL. An empirical evaluation of the MATRICS Consensus Cognitive Battery in bipolar disorder. Bipolar Disord. 2014;16(3):318–25. pmid:24119238
    • 39. Li Z, Gao H, Zhu Y, Shi C, Ma Y, Yu X. Neuroeognitive functioning in bipolar I disorder patients with euthymia or depression state. Chin Ment Health (Chinese). 2014;28(5):332–8.
    • 40. Garcia M, Montalvo I, Creus M, Cabezas A, Sole M, Algora MJ, et al. Sex differences in the effect of childhood trauma on the clinical expression of early psychosis. Comprehensive psychiatry. 2016;68:86–96. Epub 2016/05/29. pmid:27234188
    • 41. Nitzburg GC, Russo M, Cuesta-Diaz A, Ospina L, Shanahan M, Perez-Rodriguez M, et al. Coping strategies and real-world functioning in bipolar disorder. Journal of affective disorders. 2016;198:185–8. Epub 2016/03/28. pmid:27017375
    • 42. Sanchez-Morla EM, Mateo J, Aparicio A, Garcia-Jimenez MA, Jimenez E, Santos JL. Prepulse inhibition in euthymic bipolar disorder patients in comparison with control subjects. Acta psychiatrica Scandinavica. 2016. Epub 2016/06/14.
    • 43. Barbero JD, Gutierrez-Zotes A, Montalvo I, Creus M, Cabezas A, Sole M, et al. Free thyroxine levels are associated with cognitive abilities in subjects with early psychosis. Schizophrenia research. 2015;166(1–3):37–42. Epub 2015/05/20. pmid:25982813
    • 44. Kenney J, Anderson-Schmidt H, Scanlon C, Arndt S, Scherz E, McInerney S, et al. Cognitive course in first-episode psychosis and clinical correlates: A 4 year longitudinal study using the MATRICS Consensus Cognitive Battery. Schizophrenia research. 2015;169(1–3):101–8. Epub 2015/09/30. pmid:26416442
    • 45. Minor KS, Friedman-Yakoobian M, Leung YJ, Meyer EC, Zimmet SV, Caplan B, et al. The impact of premorbid adjustment, neurocognition, and depression on social and role functioning in patients in an early psychosis treatment program. The Australian and New Zealand journal of psychiatry. 2015;49(5):444–52. Epub 2015/01/15. pmid:25586755
    • 46. Russo M, Mahon K, Shanahan M, Ramjas E, Solon C, Purcell SM, et al. The relationship between sleep quality and neurocognition in bipolar disorder. Journal of affective disorders. 2015;187:156–62. Epub 2015/09/05. PubMed Central PMCID: PMCPmc4598049. pmid:26339925
    • 47. Cassidy C, Buchy L, Bodnar M, Dell'elce J, Choudhry Z, Fathalli F, et al. Association of a risk allele of ANK3 with cognitive performance and cortical thickness in patients with first-episode psychosis. Journal of psychiatry & neuroscience: JPN. 2014;39(1):31–9. Epub 2013/09/11. PubMed Central PMCID: PMCPmc3868663.
    • 48. Kessler U, Schoeyen HK, Andreassen OA, Eide GE, Malt UF, Oedegaard KJ, et al. The effect of electroconvulsive therapy on neurocognitive function in treatment-resistant bipolar disorder depression. The Journal of clinical psychiatry. 2014;75(11):e1306–13. Epub 2014/12/04. pmid:25470096
    • 49. Kessler U, Schoeyen HK, Andreassen OA, Eide GE, Hammar A, Malt UF, et al. Neurocognitive profiles in treatment-resistant bipolar I and bipolar II disorder depression. BMC psychiatry. 2013;13:105. Epub 2013/04/06. PubMed Central PMCID: PMCPmc3637095. pmid:23557429