Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2011

Open Access 01-12-2011 | Research

Validation of the Excited Component of the Positive and Negative Syndrome Scale (PANSS-EC) in a naturalistic sample of 278 patients with acute psychosis and agitation in a psychiatric emergency room

Authors: Alonso Montoya, Amparo Valladares, Luis Lizán, Luis San, Rodrigo Escobar, Silvia Paz

Published in: Health and Quality of Life Outcomes | Issue 1/2011

Login to get access

Abstract

Background

Despite the wide use of the Excited Component of the Positive and Negative Syndrome Scale (PANSS-EC) in a clinical setting to assess agitated patients, a validation study to evaluate its psychometric properties was missing.

Methods

Data from the observational NATURA study were used. This research describes trends in the use of treatments in patients with acute psychotic episodes and agitation seen in emergency departments. Exploratory principal component factor analysis was performed. Spearman's correlation and regression analyses (linear regression model) as well as equipercentile linking of Clinical Global Impression of Severity (CGI-S), Agitation and Calmness Evaluation Scale (ACES) and PANSS-EC items were conducted to examine the scale's diagnostic validity. Furthermore, reliability (Cronbach's alpha) and responsiveness were evaluated.

Results

Factor analysis resulted in one factor being retained according to eigenvalue ≥1. At admission, the PANSS-EC and CGI-S were found to be linearly related, with an average increase of 3.4 points (p < 0.001) on the PANSS-EC for each additional CGI-S point. The PANSS-EC and ACES were found to be linearly and inversely related, with an average decrease of 5.5 points (p < 0.001) on the PANSS-EC for each additional point. The equipercentile method shows the poor sensitivity of the ACES scale. Cronbach's alpha was 0.86 and effect size was 1.44.

Conclusions

The factorial analyses confirm the unifactorial structure of the PANSS-EC subscale. The PANSS-EC showed a strong linear correlation with rating scales such as CGI-S and ACES. PANSS-EC has also shown an excellent capacity to detect real changes in agitated patients.
Appendix
Available only for authorised users
Literature
1.
go back to reference Allen MH, Currier GW, Hughes DH, Reyes-Harde M, Docherty JP: Expert Consensus Panel for Behavioral Emergencies, 2001. The Expert Consensus Guidelines Series. Treatment of behavioural emergencies. Postgraduate Medicine 2001, (Spec No):1–88. quiz 89–90 Allen MH, Currier GW, Hughes DH, Reyes-Harde M, Docherty JP: Expert Consensus Panel for Behavioral Emergencies, 2001. The Expert Consensus Guidelines Series. Treatment of behavioural emergencies. Postgraduate Medicine 2001, (Spec No):1–88. quiz 89–90
2.
go back to reference Allen MH, Currier GW, Carpenter D, Ross RW, Docherty JP: Expert Consensus Panel for Behavioral Emergencies, 2005. The expert consensus guideline series. Treatment of behavioral emergencies. Journal of Psychiatric Practice 2005, 11: 5–108. 10.1097/00131746-200511001-00002PubMedCrossRef Allen MH, Currier GW, Carpenter D, Ross RW, Docherty JP: Expert Consensus Panel for Behavioral Emergencies, 2005. The expert consensus guideline series. Treatment of behavioral emergencies. Journal of Psychiatric Practice 2005, 11: 5–108. 10.1097/00131746-200511001-00002PubMedCrossRef
3.
go back to reference Kay SR, Fiszbein A, Opler LA: The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophrenia Bulletin 1987, 13: 261–276.PubMedCrossRef Kay SR, Fiszbein A, Opler LA: The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophrenia Bulletin 1987, 13: 261–276.PubMedCrossRef
4.
go back to reference Emsley R, Rabinowitz J, Torreman M, RIS-INT-35 Early Psychosis Global Working Group: The factor structure for the Positive and Negative Syndrome Scale (PANSS) in recent-onset psychosis. Schizophrenia Research 2003, 61: 47–57. 10.1016/S0920-9964(02)00302-XPubMedCrossRef Emsley R, Rabinowitz J, Torreman M, RIS-INT-35 Early Psychosis Global Working Group: The factor structure for the Positive and Negative Syndrome Scale (PANSS) in recent-onset psychosis. Schizophrenia Research 2003, 61: 47–57. 10.1016/S0920-9964(02)00302-XPubMedCrossRef
5.
go back to reference Van den Oord EJ, Rujescu D, Robles JR, Gieling I, Birrell C, Bukszár J, et al.: Factor structure and external validity of the PANSS revisited. Schizophrenia Research 2006, 82: 213–223. 10.1016/j.schres.2005.09.002PubMedCrossRef Van den Oord EJ, Rujescu D, Robles JR, Gieling I, Birrell C, Bukszár J, et al.: Factor structure and external validity of the PANSS revisited. Schizophrenia Research 2006, 82: 213–223. 10.1016/j.schres.2005.09.002PubMedCrossRef
6.
go back to reference Lindenmayer JP, Bossie CA, Kujawa M, Zhu Y, Canuso CM: Dimensions of psychosis in patients with bipolar mania as measured by the positive and negative syndrome scale. Psychopathology 2008, 4: 264–270. 10.1159/000128325CrossRef Lindenmayer JP, Bossie CA, Kujawa M, Zhu Y, Canuso CM: Dimensions of psychosis in patients with bipolar mania as measured by the positive and negative syndrome scale. Psychopathology 2008, 4: 264–270. 10.1159/000128325CrossRef
7.
go back to reference Baker RW, Kinon BJ, Maguire GA, Liu H, Hill AL: Effectiveness of rapid initial dose escalation of up to forty milligrams per day of oral olanzapine in acute agitation. Journal of Clinical Psychopharmacology 2003, 23: 342–348. 10.1097/01.jcp.0000085406.08426.a8PubMedCrossRef Baker RW, Kinon BJ, Maguire GA, Liu H, Hill AL: Effectiveness of rapid initial dose escalation of up to forty milligrams per day of oral olanzapine in acute agitation. Journal of Clinical Psychopharmacology 2003, 23: 342–348. 10.1097/01.jcp.0000085406.08426.a8PubMedCrossRef
8.
go back to reference Barzman DH, DelBello MP, Adler CM, Stanford KE, Strakowski SM: The efficacy and tolerability of quetiapine versus divalproex for the treatment of impulsivity and reactive aggression in adolescents with co-occurring bipolar disorder and disruptive behavior disorder(s). Journal of Child and Adolescent Psychopharmacology 2006, 16: 665–670. 10.1089/cap.2006.16.665PubMedCrossRef Barzman DH, DelBello MP, Adler CM, Stanford KE, Strakowski SM: The efficacy and tolerability of quetiapine versus divalproex for the treatment of impulsivity and reactive aggression in adolescents with co-occurring bipolar disorder and disruptive behavior disorder(s). Journal of Child and Adolescent Psychopharmacology 2006, 16: 665–670. 10.1089/cap.2006.16.665PubMedCrossRef
9.
go back to reference Currier GW, Trenton AJ, Walsh PG, van Wijngaarden E: A pilot, open-label safety study of quetiapine for treatment of moderate psychotic agitation in the emergency setting. Journal of Psychiatric Practice 2006, 12: 223–228. 10.1097/00131746-200607000-00004PubMedCrossRef Currier GW, Trenton AJ, Walsh PG, van Wijngaarden E: A pilot, open-label safety study of quetiapine for treatment of moderate psychotic agitation in the emergency setting. Journal of Psychiatric Practice 2006, 12: 223–228. 10.1097/00131746-200607000-00004PubMedCrossRef
10.
go back to reference Pascual JC, Madre M, Puigdemont D, Oller S, Corripio I, Diaz A, et al.: A naturalistic study: 100 consecutive episodes of acute agitation in a psychiatric emergency department. Actas Españolas de Psiquiatría 2006, 34: 239–244.PubMed Pascual JC, Madre M, Puigdemont D, Oller S, Corripio I, Diaz A, et al.: A naturalistic study: 100 consecutive episodes of acute agitation in a psychiatric emergency department. Actas Españolas de Psiquiatría 2006, 34: 239–244.PubMed
11.
go back to reference Panjonk F, Holzbach R, Naber D: Comparing the efficacy of atypical antipsychotics in open uncontrolled versus double-blind controlled trials in schizophrenia. Psychopharmacology (Berl.) 2002, 162: 29–36. 10.1007/s00213-002-1055-9CrossRef Panjonk F, Holzbach R, Naber D: Comparing the efficacy of atypical antipsychotics in open uncontrolled versus double-blind controlled trials in schizophrenia. Psychopharmacology (Berl.) 2002, 162: 29–36. 10.1007/s00213-002-1055-9CrossRef
12.
go back to reference Breier A, Meehan K, Birkett M, David S, Ferchland I, Sutton V, et al.: A double-blind, placebo-controlled dose-response comparison of intramuscular olanzapine and haloperidol in the treatment of acute agitation in schizophrenia. Archives of General Psychiatry 2002, 59: 441–448. 10.1001/archpsyc.59.5.441PubMedCrossRef Breier A, Meehan K, Birkett M, David S, Ferchland I, Sutton V, et al.: A double-blind, placebo-controlled dose-response comparison of intramuscular olanzapine and haloperidol in the treatment of acute agitation in schizophrenia. Archives of General Psychiatry 2002, 59: 441–448. 10.1001/archpsyc.59.5.441PubMedCrossRef
13.
go back to reference Meehan KM, Wang H, David SR, Nisivoccia JR, Jones B, Beasley CM Jr, et al.: Comparison of rapidly acting intramuscular olanzapine, lorazepam, and placebo: a double-blind, randomized study in acutely agitated patients with dementia. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology 2002, 26: 494–504. 10.1016/S0893-133X(01)00365-7CrossRef Meehan KM, Wang H, David SR, Nisivoccia JR, Jones B, Beasley CM Jr, et al.: Comparison of rapidly acting intramuscular olanzapine, lorazepam, and placebo: a double-blind, randomized study in acutely agitated patients with dementia. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology 2002, 26: 494–504. 10.1016/S0893-133X(01)00365-7CrossRef
14.
go back to reference Casey DE, Daniel DG, Wassef AA, Tracy KA, Wozniak P, Sommerville KW: Effect of divalproex combined with olanzapine or risperidone in patients with an acute exacerbation of schizophrenia. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology 2003, 28: 182–192. 10.1038/sj.npp.1300023CrossRef Casey DE, Daniel DG, Wassef AA, Tracy KA, Wozniak P, Sommerville KW: Effect of divalproex combined with olanzapine or risperidone in patients with an acute exacerbation of schizophrenia. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology 2003, 28: 182–192. 10.1038/sj.npp.1300023CrossRef
15.
go back to reference Wright P, Meehan K, Birkett M, Lindborg SR, Taylor CC, Morris P, et al.: A comparison of the efficacy and safety of olanzapine versus haloperidol during transition from intramuscular to oral therapy. Clinical Therapeutics 2003, 25: 1420–1428. 10.1016/S0149-2918(03)80129-7PubMedCrossRef Wright P, Meehan K, Birkett M, Lindborg SR, Taylor CC, Morris P, et al.: A comparison of the efficacy and safety of olanzapine versus haloperidol during transition from intramuscular to oral therapy. Clinical Therapeutics 2003, 25: 1420–1428. 10.1016/S0149-2918(03)80129-7PubMedCrossRef
16.
go back to reference San L, Arranz B, Querejeta I, Barrio S, De la Gandara J, Perez V: A naturalistic multicenter study of intramuscular olanzapine in the treatment of acutely agitated manic or schizophrenic patients. European Psychiatry: the Journal of the Association of European Psychiatrists 2006, 21: 539–543.CrossRef San L, Arranz B, Querejeta I, Barrio S, De la Gandara J, Perez V: A naturalistic multicenter study of intramuscular olanzapine in the treatment of acutely agitated manic or schizophrenic patients. European Psychiatry: the Journal of the Association of European Psychiatrists 2006, 21: 539–543.CrossRef
17.
go back to reference Turczyński J, Bidzan L, Staszewska-Małys E: Olanzapine in the treatment of agitation in hospitalized patients with schizophrenia and schizoaffective and schizofreniform disorders. Medical Science Monitor: International Medical Journal of Experimental and Clinical Research 2004, 10: I74–180. Turczyński J, Bidzan L, Staszewska-Małys E: Olanzapine in the treatment of agitation in hospitalized patients with schizophrenia and schizoaffective and schizofreniform disorders. Medical Science Monitor: International Medical Journal of Experimental and Clinical Research 2004, 10: I74–180.
18.
go back to reference Zhong KX, Tariot PN, Mintzer J, Minkwitz MC, Devine NA: Quetiapine to treat agitation in dementia: a randomized, double-blind, placebo-controlled study. Current Alzheimer Research 2007, 4: 81–93. 10.2174/156720507779939805PubMedCrossRef Zhong KX, Tariot PN, Mintzer J, Minkwitz MC, Devine NA: Quetiapine to treat agitation in dementia: a randomized, double-blind, placebo-controlled study. Current Alzheimer Research 2007, 4: 81–93. 10.2174/156720507779939805PubMedCrossRef
19.
go back to reference Nordstrom K, Allen MH: Managing the acutely agitated and psychotic patient. CNS Spectrums 2007, 12: 5–11.PubMed Nordstrom K, Allen MH: Managing the acutely agitated and psychotic patient. CNS Spectrums 2007, 12: 5–11.PubMed
20.
go back to reference Montoya A, San L, Olivares JM, Pérez-Sola V, Casillas M, López-Carrero C, et al.: Clinical characteristics of agitated psychotic patients treated with an oral antipsychotics attended in the emergency room setting: NATURA study. International Journal of Psychiatry in Clinical Practice 2008, 12: 127–133. 10.1080/13651500701749859PubMedCrossRef Montoya A, San L, Olivares JM, Pérez-Sola V, Casillas M, López-Carrero C, et al.: Clinical characteristics of agitated psychotic patients treated with an oral antipsychotics attended in the emergency room setting: NATURA study. International Journal of Psychiatry in Clinical Practice 2008, 12: 127–133. 10.1080/13651500701749859PubMedCrossRef
21.
go back to reference Escobar R, San L, Pérez V, Olivares JM, Polavieja P, López-Carrero C, et al.: Effectiveness results of olanzapine in acute psychotic patients with agitation in the emergency room setting: results from NATURA study. Actas Españolas de Psiquiatría 2008, 36: 151–157.PubMed Escobar R, San L, Pérez V, Olivares JM, Polavieja P, López-Carrero C, et al.: Effectiveness results of olanzapine in acute psychotic patients with agitation in the emergency room setting: results from NATURA study. Actas Españolas de Psiquiatría 2008, 36: 151–157.PubMed
22.
go back to reference Guy W: ECDEU Assessment Manual for Psychopharmacology US Department of Health, Education, and Welfare publication, revised ed. National Institute of Mental Health, Rockville, MD; 1976. Guy W: ECDEU Assessment Manual for Psychopharmacology US Department of Health, Education, and Welfare publication, revised ed. National Institute of Mental Health, Rockville, MD; 1976.
23.
go back to reference Berk M, Ng F, Dodd S, Callaly T, Campbell S, Bernardo M, et al.: The validity of the CGI severity and improvement scales as measures of clinical effectiveness suitable for routine clinical use. Journal of Evaluation in Clinical Practice 2008, 14: 979–983. 10.1111/j.1365-2753.2007.00921.xPubMedCrossRef Berk M, Ng F, Dodd S, Callaly T, Campbell S, Bernardo M, et al.: The validity of the CGI severity and improvement scales as measures of clinical effectiveness suitable for routine clinical use. Journal of Evaluation in Clinical Practice 2008, 14: 979–983. 10.1111/j.1365-2753.2007.00921.xPubMedCrossRef
24.
go back to reference Battaglia J, Lindborg SR, Alaka J, Meehan K, Wright P: Calming versus sedative effects of intramuscular olanzapine in agitated patients. The American Journal of Emergency Medicine 2003, 21: 192–198. 10.1016/S0735-6757(02)42249-8PubMedCrossRef Battaglia J, Lindborg SR, Alaka J, Meehan K, Wright P: Calming versus sedative effects of intramuscular olanzapine in agitated patients. The American Journal of Emergency Medicine 2003, 21: 192–198. 10.1016/S0735-6757(02)42249-8PubMedCrossRef
25.
go back to reference Zumbo BD: Validity: foundational issues and statistical methodology. In Handbook of Statistics 26: Psychometrics. Edited by: Rao CR, Sinharay S. Elsevier, London; 2007. Zumbo BD: Validity: foundational issues and statistical methodology. In Handbook of Statistics 26: Psychometrics. Edited by: Rao CR, Sinharay S. Elsevier, London; 2007.
26.
go back to reference Zumbo BD, (Ed): Validity theory and the methods used in validation: perspectives from the social and behavioural sciences. In Special issue of the journal Social Indicators Resesarch: An International and Interdisciplinary Journal for Quality of Life Measurements. Volume 45. Amsterdam: Kluwer Acaddenic Press; 1998:1–359. Zumbo BD, (Ed): Validity theory and the methods used in validation: perspectives from the social and behavioural sciences. In Special issue of the journal Social Indicators Resesarch: An International and Interdisciplinary Journal for Quality of Life Measurements. Volume 45. Amsterdam: Kluwer Acaddenic Press; 1998:1–359.
27.
go back to reference Kolen MJ, Brennan RL: Test Equating, Scaling, and Linking: Methods and Practices. second edition. New York: Springer-Verlag; 2004.CrossRef Kolen MJ, Brennan RL: Test Equating, Scaling, and Linking: Methods and Practices. second edition. New York: Springer-Verlag; 2004.CrossRef
28.
go back to reference Holland PW, Dorans NJ: Linking and equating. In Educational Measurement. 4th edition. Edited by: Brennan RL. Wesport, CT: Praeger Publishers; 2006. Holland PW, Dorans NJ: Linking and equating. In Educational Measurement. 4th edition. Edited by: Brennan RL. Wesport, CT: Praeger Publishers; 2006.
29.
go back to reference Dorans NJ, Pommerich M, Holland PW: Linking and aligning scores and scales. New York: Springer; 2007.CrossRef Dorans NJ, Pommerich M, Holland PW: Linking and aligning scores and scales. New York: Springer; 2007.CrossRef
30.
go back to reference Guyatt GH, Walter SD, Norman G: Measuring change over time: assessing the usefulness of evaluative instruments. J Chronic Diseases 1987, 40: 171–178. 10.1016/0021-9681(87)90069-5CrossRef Guyatt GH, Walter SD, Norman G: Measuring change over time: assessing the usefulness of evaluative instruments. J Chronic Diseases 1987, 40: 171–178. 10.1016/0021-9681(87)90069-5CrossRef
31.
go back to reference Kazis LE, Anderson JJ, Meenan RF: Effect sizes for interpreting changes in health status. Medical Care 1989, 27: 178–189. 10.1097/00005650-198903001-00015CrossRef Kazis LE, Anderson JJ, Meenan RF: Effect sizes for interpreting changes in health status. Medical Care 1989, 27: 178–189. 10.1097/00005650-198903001-00015CrossRef
32.
go back to reference Brand A, Bradley MT, Best LA, Stoica G: Accuracy of effect size estimates from published psychological research. Perceptual and Motor Skills 2008, 106: 645–649. 10.2466/pms.106.2.645-649PubMedCrossRef Brand A, Bradley MT, Best LA, Stoica G: Accuracy of effect size estimates from published psychological research. Perceptual and Motor Skills 2008, 106: 645–649. 10.2466/pms.106.2.645-649PubMedCrossRef
33.
go back to reference Steinberg L, Thissen D: Using effect sizes for research reporting: examples using item response theory to analyze differential item functioning. Psychological Methods 2006, 11: 402–415. 10.1037/1082-989X.11.4.402PubMedCrossRef Steinberg L, Thissen D: Using effect sizes for research reporting: examples using item response theory to analyze differential item functioning. Psychological Methods 2006, 11: 402–415. 10.1037/1082-989X.11.4.402PubMedCrossRef
34.
go back to reference Cohen J: Statistical power analysis for the behavioural sciences. New York: Academic Press Inc; 1977. Cohen J: Statistical power analysis for the behavioural sciences. New York: Academic Press Inc; 1977.
35.
go back to reference Levine SZ, Rabinowitz J, Engel R, Etschel E, Leucht S: Extrapolation between measures of symptoms severity and change: an examination of the PANSS and CGI. Schizophrenia Research 2008, 98: 318–322. 10.1016/j.schres.2007.09.006PubMedCrossRef Levine SZ, Rabinowitz J, Engel R, Etschel E, Leucht S: Extrapolation between measures of symptoms severity and change: an examination of the PANSS and CGI. Schizophrenia Research 2008, 98: 318–322. 10.1016/j.schres.2007.09.006PubMedCrossRef
36.
go back to reference Laenen A, Alonso A, Molenberghs G, Vangeneugden T, Mallinckrodt CH: Using longitudinal data from a clinical trial in depression to assess the reliability of its outcome scales. J Psychiatr Res 2009, 43: 730–8. 10.1016/j.jpsychires.2008.09.010PubMedCrossRef Laenen A, Alonso A, Molenberghs G, Vangeneugden T, Mallinckrodt CH: Using longitudinal data from a clinical trial in depression to assess the reliability of its outcome scales. J Psychiatr Res 2009, 43: 730–8. 10.1016/j.jpsychires.2008.09.010PubMedCrossRef
37.
go back to reference Alonso A, Laenen A, Molenberghs G, Geys H, Vangeneugden T: A unified approach to multi-item reliability. Biometrics 2010, 66: 1061–8. 10.1111/j.1541-0420.2009.01373.xPubMedCrossRef Alonso A, Laenen A, Molenberghs G, Geys H, Vangeneugden T: A unified approach to multi-item reliability. Biometrics 2010, 66: 1061–8. 10.1111/j.1541-0420.2009.01373.xPubMedCrossRef
38.
go back to reference Wilhelm S, Schacht A, Wagner T: Use of antipsychotics and benzodiazepines in patients with psychiatric emergencies: results of an observational trial. BMC Psychiatry 2008, 8: 61. 10.1186/1471-244X-8-61PubMedCentralPubMedCrossRef Wilhelm S, Schacht A, Wagner T: Use of antipsychotics and benzodiazepines in patients with psychiatric emergencies: results of an observational trial. BMC Psychiatry 2008, 8: 61. 10.1186/1471-244X-8-61PubMedCentralPubMedCrossRef
39.
go back to reference Huber CG, Lambert M, Naber D, Schacht A, Hundemer HP, Wagner TT, et al.: Validation of a Clinical Global Impression Scale for Aggression (CGI-A) in a sample of 558 psychiatric patients. Schizophrenia Research 2008, 100: 342–348. 10.1016/j.schres.2007.12.480PubMedCrossRef Huber CG, Lambert M, Naber D, Schacht A, Hundemer HP, Wagner TT, et al.: Validation of a Clinical Global Impression Scale for Aggression (CGI-A) in a sample of 558 psychiatric patients. Schizophrenia Research 2008, 100: 342–348. 10.1016/j.schres.2007.12.480PubMedCrossRef
40.
go back to reference Leucht S, Kane JM, Kissling W, Hamann J, Etschel E, Engel RR: What does the PANS mean? Schizophrenia Research 2005, 79: 231–238. 10.1016/j.schres.2005.04.008PubMedCrossRef Leucht S, Kane JM, Kissling W, Hamann J, Etschel E, Engel RR: What does the PANS mean? Schizophrenia Research 2005, 79: 231–238. 10.1016/j.schres.2005.04.008PubMedCrossRef
Metadata
Title
Validation of the Excited Component of the Positive and Negative Syndrome Scale (PANSS-EC) in a naturalistic sample of 278 patients with acute psychosis and agitation in a psychiatric emergency room
Authors
Alonso Montoya
Amparo Valladares
Luis Lizán
Luis San
Rodrigo Escobar
Silvia Paz
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2011
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-9-18

Other articles of this Issue 1/2011

Health and Quality of Life Outcomes 1/2011 Go to the issue