Top

Published in:

01-12-2020 | Adjustment Disorder | Research article

Positive and Negative Affect Schedule (PANAS): psychometric properties of the online Spanish version in a clinical sample with emotional disorders

Authors: Amanda Díaz-García, Alberto González-Robles, Sonia Mor, Adriana Mira, Soledad Quero, Azucena García-Palacios, Rosa María Baños, Cristina Botella

Published in: BMC Psychiatry | Issue 1/2020

Abstract

Background

The Positive and Negative Affect Schedule (PANAS) is the most widely and frequently used scale to assess positive and negative affect. The PANAS has been validated in several languages, and it has shown excellent psychometric properties in the general population and some clinical samples, such as forensic samples, substance users, and adult women with fibromyalgia. Nevertheless, the psychometric properties of the scale have not yet been examined in clinical samples with anxiety, depressive, and adjustment disorders. In addition, the proliferation of Internet-based treatments has led to the development of a wide range of assessments conducted online with digital versions of pen and paper self-report questionnaires. However, no validations have been carried out to analyze the psychometric properties of the online version of the PANAS. The present study investigates the psychometric properties of the online Spanish version of the PANAS in a clinical sample of individuals with emotional disorders.

Methods

The sample was composed of 595 Spanish adult volunteers with a diagnosis of depressive disorder (n = 237), anxiety disorder (n = 284), or adjustment disorder (n = 74). Factor structure, construct validity, internal consistency, and sensitivity to change were analyzed.

Results

Confirmatory factor analysis yielded a latent structure of two independent factors, consistent with previous validations of the instrument. The analyses showed adequate convergent and discriminant validity, good internal consistency as well as sensitivity to change.

Conclusions

Overall, the results obtained in this study show that the online version of the PANAS has adequate psychometric properties for the assessment of positive and negative affect in a Spanish clinical population.

Available only for authorised users

Gray EK, Watson D. Assessing positive and negative affect via self-report. Handbook of emotion elicitation and assessment; 2007.

Rosenberg EL. Levels of analysis and the organization of affect. Rev Gen Psychol. 1998;2(3):247-70.CrossRef

Gross J, Sutton SK, Ketelaar T. Relations between affect and personality: support for the affect-level and affective-reactivity views. Clin Soc Psychol Bull. 1998;24(3):279–88.

Parkinson B, Totterdell P, Briner R, Reynolds S. Changing moods: the psychology of mood and mood regulation; 1996.

Lucas RE, Diener E, Larsen RJ. Measuring positive emotions. In: Positive psychological assessment: a handbook of models and measures. Washington: American Psychological Association; 2003. p. 201–18.CrossRef

Russell JA. A Circumplex model of affect. J Pers Soc Psychol. 1980;39(6):1161–78.CrossRef

Zevon MA, Tellegen A. The structure of mood change: An idiographic/nomothetic analysis. J Pers Soc Psychol. 1982;43(1):111.CrossRef

Watson D, Clark LA, Tellegen A. Cross-cultural convergence in the structure of mood: A Japanese replication and a comparison with US findings. J Pers Soc Psychol. 1984;47(1):127.CrossRef

Bradburn NM. The structure of psychological well-being; 1969.

10.

Watson D, Tellegen A. Toward a consensual structure of mood. Psychological bulletin. 1985;98(2):219.PubMedCrossRef

11.

Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988;54(6):1063–70.PubMedCrossRef

12.

Snyder CR, Lopez SJ. Oxford handbook of positive psychology. Oxford library of psychology; 2009.

13.

Fredrickson BL. The role of positive emotions in positive psychology: The broaden-and-build theory of positive emotions. Am Psychol. 2001;56(3):218.PubMedCrossRef

14.

Tellegen A. Structures of mood and personality and their relevance to assessing anxiety, with an emphasis on self-report. In A. H. Tuma & J. D. Maser (Eds.), Anxiety and the anxiety disorders (p. 681–706). Lawrence Erlbaum Associates, Inc; 1985.

15.

Watson D, Clark LA. On traits and temperament: general and specific factors of emotional experience and their relation to the five-factor model. J Pers. 1992;60(2):441–76.PubMedCrossRef

16.

Terracciano A, McCrae RR, Costa PT. J. Factorial and construct validity of the Italian positive and negative affect schedule (PANAS). Eur J Psychol Assess. 2003;19(2):131–41.PubMedPubMedCentralCrossRef

17.

Gaudreau P, Sanchez X, Blondin J-P. Positive and negative affective states in a performance-related setting. Eur J Psychol Assess. 2006;22(4):240–9.CrossRef

18.

Gyollai A, Simor P, Koteles F, Demetrovics Z. Psychometric properties of the Hungarian version of the original and the short form of the positive and negative affect schedule (PANAS). Neuropsychopharmacol Hung. 2011;13(2):73–9.PubMed

19.

Gençöz T. Positive and Negative Affect Schedule: A study of validity and reliability. Türk Psikoloji Dergisi. 2000;15(46):19-28.

20.

Robles R, Páez F. Estudio sobre la traducción al español y las propiedades psicométricas de las escalas de afecto positivo y negativo (panas). Salud Ment. 2003;26(1):69–75.

21.

Lim Y-J, Yu B-H, Kim D-K, Kim J-H. The positive and negative affect schedule: psychometric properties of the Korean version. Psychiatry Investig. 2010;7(3):163.PubMedPubMedCentralCrossRef

22.

Moriondo M, De Palma P, Medrano LA, Murillo P. Adaptación de la escala de afectividad positiva y negativa (PANAS) a la población de adultos de la ciudad de córdoba: Análisis psicométricos preliminares. Univ Psychol. 2012;11(1):187–96.CrossRef

23.

Pires P, Filgueiras A, Ribas R, Santana C. Positive and negative affect schedule: psychometric properties for the Brazilian Portuguese version. Span J Psychol. 2013;16(2013):E58.PubMedCrossRef

24.

Merz EL, Malcarne VL, Roesch SC, Ko CM, Emerson M, Roma VG, et al. Psychometric properties of positive and negative affect schedule (PANAS) original and short forms in an African American community sample. J Affect Disord. 2013;151(3):942–9.PubMedPubMedCentralCrossRef

25.

Pandey R, Srivastava N. Psychometric evaluation of a hindi version of positive-negative affect schedule. Ind Psychiatry J. 2008;17(1):49.

26.

Akhter N. Urdu translation and validation of shorter version of positive affect and negative affect schedule (PANAS) on Pakistani bank employees. J Pak Med Assoc. 2017;67(10):1517–23.PubMed

27.

Sandín B, Chorot P, Lostao L, Joiner TE, Santed MA, Valiente RM. Escalas PANAS de afecto positivo y negativo: Validacion factorial y convergencia transcultural. Psicothema. 1999;11:37–51.

28.

Leue A, Beauducel A. The PANAS structure revisited: on the validity of a Bifactor model in community and forensic samples. Psychol Assess. 2011;23(1):215–25.PubMedCrossRef

29.

Serafini K, Malin-Mayor B, Nich C, Hunkele K, Carroll KM. Psychometric properties of the positive and negative affect schedule (PANAS) in a heterogeneous sample of substance users. Am J Drug Alcohol Abuse. 2016;42(2):203–12.PubMedPubMedCentralCrossRef

30.

Estévez-López F, Pulido-Martos M, Armitage CJ, Wearden A, Álvarez-Gallardo IC, Arrayás-Grajera MJ, et al. Factor structure of the positive and negative affect schedule (PANAS) in adult women with fibromyalgia from southern Spain: the al-Ándalus project. Peer J. 2016;4:e1822.PubMedCrossRefPubMedCentral

31.

Alfonsson S, Maathz P, Hursti T. Interformat reliability of digital psychiatric self-report questionnaires: a systematic review. J Med Internet Res. 2014;16(12):e268.PubMedPubMedCentralCrossRef

32.

Seib-Pfeifer L-E, Pugnaghi G, Beauducel A, Leue A. On the replication of factor structures of the positive and negative affect schedule (PANAS). Pers Individ Dif. 2017;107:201–7.CrossRef

33.

van Ballegooijen W, Riper H, Cuijpers P, van Oppen P, Smit JH. Validation of online psychometric instruments for common mental health disorders: a systematic review. BMC Psychiatry. 2016;16(1):45.PubMedPubMedCentralCrossRef

34.

Hunsley J, Mash EJ. Evidence-based assessment. Annu Rev Clin Psychol. 2007;3(1):29–51.PubMedCrossRef

35.

Díaz-García A, González-Robles A, Fernández-Álvarez J, García-Palacios A, Baños RM, Botella C. Efficacy of a transdiagnostic internet-based treatment for emotional disorders with a specific component to address positive affect: study protocol for a randomized controlled trial. BMC Psychiatry. 2017;17(1):145.PubMedPubMedCentralCrossRef

36.

Rachyla I, Pérez-Ara M, Molés M, Campos D, Mira A, Botella C, et al. An internet-based intervention for adjustment disorder (TAO): study protocol for a randomized controlled trial. BMC Psychiatry. 2018;18(161):1–10.

37.

Castro A, García-Palacios A, García-Campayo J, Mayoral F, Botella C, García-Herrera JM, et al. Efficacy of low-intensity psychological intervention applied by ICTs for the treatment of depression in primary care: a controlled trial. BMC Psychiatry. 2015;15(1):106.PubMedPubMedCentralCrossRef

38.

Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 2):22–33 quiz 34–57.PubMed

39.

Lecrubier Y, Sheehan DV, Weiller E, Amorim P, Bonora I, Sheehan KH, et al. The MINI international neuropsychiatric interview (MINI). A short diagnostic structured interview: reliability and validity according to the CIDI. Eur Psychiatry. 1997;12(5):224–31.CrossRef

40.

Ferrando L, Bobes J, Gibert J. MINI. Mini International Neuropsychiatric Interview. Versión en Español 5.0.0 DSM-IV. Instrumentos Detección y Orientación Diagnóstica. 2000;0:2–26.

41.

Beck AT, Steer RA, Brown GK. Beck depression inventory. San Antonio: The Psychological Corporation; 1996.

42.

Sanz J, Navarro ME, Vázquez C. Adaptación española del Inventario para la Depresión de Beck-II (BDI-II): propiedades psicométricas en estudiantes universitarios. Análisis y Modif Conduct. 2003;29(124):239–88.

43.

Sanz J, Perdigón AL, Vázquez C. Adaptación española del Inventario para la Depresión de Beck-II (BDI-II): 2. Propiedades psicométricas en población general. Clin y Salud. 2003;14(3):249–80.

44.

Sanz J, García-Vera MP, Espinosa R, Fortún M, Vázquez C. Adaptación española del Inventario para la Depresión de Beck-II (BDI-II): 3. Propiedades psicométricas en pacientes con trastornos psicológicos. Clínica y Salud. 2005;16(2):121–42.

45.

Beck AT, Brown G, Epstein N, Steer RA. An inventory for measuring clinical anxiety: psychometrical properties. J Consult ans Clincal Psychol. 1988;56(6):893–7.CrossRef

46.

Sanz J, Navarro ME. Propiedades psicométricas de una versión española del Inventario de Ansiedad de Beck (BAI) en estudiantes universitarios. Ansiedad y Estrés. 2003;9(1):59–84.

47.

Magán I, Sanz J, García-Vera MP. Psychometric properties of a Spanish version of the Beck anxiety inventory (BAI) in general population. Span J Psychol. 2008;11(2):626–40.PubMedCrossRef

48.

Norman SB, Campbell-Sills L, Hitchcock CA, Sullivan S, Rochlin A, Wilkins KC, et al. Psychometrics of a brief measure of anxiety to detect severity and impairment: the overall anxiety severity and impairment scale (OASIS). J Psychiatr Res. 2011;45(2):262–8.PubMedCrossRef

49.

González-Robles A, Mira A, Miguel C, Molinari G, Díaz-García A, García-Palacios A, et al. A brief online transdiagnostic measure: Psychometric properties of the Overall Anxiety Severity and Impairment Scale (OASIS) among Spanish patients with emotional disorders. PLoS One. 2018;13(11):e0206516 Innamorati M, editor.PubMedPubMedCentralCrossRef

50.

Kroenke K, Spitzer RL, Williams JBW. The PHQ-9 validity of a brief depression severity measure. J Gen Intern Med banner. 2001;16(9):606–13.CrossRef

51.

Muñoz-Navarro R, Cano-Vindel A, Medrano LA, Schmitz F, Ruiz-Rodríguez P, Abellán-Maeso C, et al. Utility of the PHQ-9 to identify major depressive disorder in adult patients in Spanish primary care centres. BMC Psychiatry. 2017;17(1):291.PubMedPubMedCentralCrossRef

52.

Costa PT, McCrae RR. Normal personality assessment in clinical practice: the NEO personality inventory. Psychol Assess. 1992;4(1):5–13.CrossRef

53.

Aluja A. Garcı́a O, Rossier J, Garcı́a LF. Comparison of the NEO-FFI, the NEO-FFI-R and an alternative short version of the NEO-PI-R (NEO-60) in Swiss and Spanish samples. Pers Individ Dif. 2005;38(3):591–604.CrossRef

54.

De Vellis RF. Classical test theory. Medical Care. 2006;44(1):S50-9.PubMedCrossRef

55.

Caycho-Rodriguez T, Ventura-Leon J, Garcia-Cadena CH, Tomas JM, Dominguez-Vergara J, Daniel L, et al. Psychometric evidence of a brief measure of resilience in non-institutionalized Peruvian older adults. Psychosoc Interv. 2018;27(2):73–9.CrossRef

56.

Finney S, DiStefano C. Non-normal and categorical data in structural equation modeling. Struct Equ Model A Second course. 2013;10(6):269–314.

57.

Hoyle RH, Gottfredson NC. Sample size considerations in prevention research applications of multilevel modeling and structural equation modeling. Prev Sci. 2015;16(7):987–96.PubMedPubMedCentralCrossRef

58.

Tanaka, JS. Multifaceted conceptions of fit in structural equation models. In Bollen KA, Long JS (Eds.) Testing structural equation models. 1993:10-40.

59.

Marsh HW, Hau K-T, Wen Z. In search of Golden rule: comment on hypothesis testing approaches to setting cutoff value for fit indexes and danger in overgeneralizing Hu and Bentler’s (1999) finding. Struct Equ Model. 2004;11(3):320–41.CrossRef

60.

Muthén LK, Muthén BO. Statistical Analysis With Latent Variables User’s Guide; 1998.

61.

Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Erlbaum Associates; 1988.

62.

Barlow DH, Sauer-Zavala S, Carl JR, Bullis JR, Ellard KK. The nature, diagnosis, and treatment of neuroticism: Back to the future. Clin Psychol Sci. 2014;2(3):344–65.CrossRef

63.

Brown TA, Barlow DH. A proposal for a dimensional classification system based on the shared features of the DSM-IV anxiety and mood disorders: implications for assessment and treatment. Psychol Assess. 2009;21(3):256–71.PubMedPubMedCentralCrossRef

64.

McHorney CA, Tarlov AR. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res. 1995;4(4):293–307.PubMedCrossRef

65.

Morris SB, DeShon RP. Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychol Methods. 2002;7(1):105–25.PubMedCrossRef

66.

Rubio-Aparicio M, Marín-Martínez F, Sánchez-Meca J, López-López JA. A methodological review of meta-analyses of the effectiveness of clinical psychology treatments. Behav Res Methods. 2018;50(5):2057–73.PubMedCrossRef

67.

Gilbert KE, Nolen-Hoeksema S, Gruber J. Positive emotion dysregulation across mood disorders: how amplifying versus dampening predicts emotional reactivity and illness course. Behav Res Ther. 2013;51(11):736–41.PubMedCrossRef

68.

Barlow D, Allen LB, Choate ML. Toward a unified treatment for emotional disorders. Behav Ther. 2004;35:205–30.CrossRef

69.

Watson D, Naragon-Gainey K. On the specificity of positive emotional dysfunction in psychopathology: evidence from the mood and anxiety disorders and schizophrenia/schizotypy. Clin Psychol Rev. 2010;30(7):839–48.PubMedCrossRef

70.

Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):617–27.PubMedPubMedCentralCrossRef

71.

Nunnally J, Bernstein I. Psychometric Theory 3rd edition. New York: MacGraw-Hill; 1994.

72.

Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef

73.

Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009;38(4):196–205.PubMedCrossRef

74.

Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer Therapy for the Anxiety and Depressive Disorders Is Effective, Acceptable and Practical Health Care: A Meta-Analysis. PLoS One. 2010;5(10):e13196 Baune BT, editor.PubMedPubMedCentralCrossRef

75.

Mira A, Bretón-López J, García-Palacios A, Quero S, Baños RM, Botella C. An internet-based program for depressive symptoms using human and automated support: a randomized controlled trial. Neuropsychiatr Dis Treat. 2017;13:987–1006.PubMedPubMedCentralCrossRef

76.

Montero-Marín J, Araya R, Pérez-Yus MC, Mayoral F, Gili M, Botella C, et al. An Internet-Based Intervention for Depression in Primary Care in Spain: A Randomized Controlled Trial. J Med Internet Res. 2016;18(8):e231.PubMedPubMedCentralCrossRef

77.

Romero-Sanchiz P, Nogueira-Arjona R, Garcia-Ruiz A, Luciano JV, Campayo JG, Gili M, Botella C, Baños R, Castro A, López-Del-hoyo Y, Pérez ÁA, Modrego-Alarcón M, Cleríes FM. Economic evaluation of a guided and unguided internet-based CBT intervention for major depression: Results from a multicenter, three-armed randomized controlled trial conducted in primary care. PLoS One.2017;12(2):e0172741.PubMedPubMedCentralCrossRef

78.

Carlbring P, Brunt S, Bohman S, Austin D, Richards J, Öst L-G, et al. Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research. Comput Human Behav. 2007;23(3):1421–34.CrossRef

79.

Hedman E, Ljótsson B, Rück C, Furmark T, Carlbring P, Lindefors N, et al. Internet administration of self-report measures commonly used in research on social anxiety disorder: a psychometric evaluation. Comput Human Behav. 2010;26(4):736–40.CrossRef

80.

Vallejo MA, Jordán CM, Díaz MI, Comeche MI, Ortega J. Psychological assessment via the internet: a reliability and validity study of online (vs paper-and-pencil) versions of the general health Questionnaire-28 (GHQ-28) and the symptoms check-List-90-revised (SCL-90-R). J Med Internet Res. 2007;9(1):1–10.CrossRef

81.

Barak A, English N. Prospects and limitations of psychological testing on the internet. J Technol Hum Serv. 2002;19(2–3):65–89.CrossRef

82.

Quadri N, Wild D, Skerritt B, Muehlhausen W, O'Donohoe P. A literature review of the variance in interval length between administrations for assessment of test retest reliability and equivalence of pro measures. Value Health. 2013;16(3):A40–1.CrossRef

83.

Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.PubMedCrossRef

Title: Positive and Negative Affect Schedule (PANAS): psychometric properties of the online Spanish version in a clinical sample with emotional disorders
Authors: Amanda Díaz-García
Alberto González-Robles
Sonia Mor
Adriana Mira
Soledad Quero
Azucena García-Palacios
Rosa María Baños
Cristina Botella
Publication date: 01-12-2020
Publisher: BioMed Central
Keywords: Adjustment Disorder
Anxiety
Published in: BMC Psychiatry / Issue 1/2020
Electronic ISSN: 1471-244X
DOI: https://doi.org/10.1186/s12888-020-2472-1

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Positive and Negative Affect Schedule (PANAS): psychometric properties of the online Spanish version in a clinical sample with emotional disorders

Abstract

Background

Methods

Results

Conclusions

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2020

A case of co-occuring synesthesia, autism, prodigious talent and strong structural brain connectivity

Are quantity and content of psychiatric interventions associated with suicide? A case-control study of a Swedish sample

Anxiety symptoms and preventive measures during the COVID-19 outbreak in Taiwan

Severity and prevalence of various types of mental ill-health in a general adult population: age and sex differences

Socio-economic inequalities in the association between alcohol use disorder and depressive disorder among Thai adults: a population-based study

Prevalence of possible idiopathic normal pressure hydrocephalus in older inpatients with schizophrenia: a replication study