Skip to main content
Top
Published in: BMC Psychiatry 1/2017

Open Access 01-12-2017 | Research article

Diagnostic performance and optimal cut-off scores of the Massachusetts youth screening instrument-second version in a sample of Swiss youths in welfare and juvenile justice institutions

Authors: Claudia Dölitzsch, Laura E. W. Leenarts, Klaus Schmeck, Jorg M. Fegert, Thomas Grisso, Marc Schmid

Published in: BMC Psychiatry | Issue 1/2017

Login to get access

Abstract

Background

There is a growing consensus about the importance of mental health screening of youths in welfare and juvenile justice institutions. The Massachusetts Youth Screening Instrument-second version (MAYSI-2) was specifically designed, normed and validated to assist juvenile justice facilities in the United States of America (USA), in identifying youths with potential emotional or behavioral problems. However, it is not known if the USA norm-based cut-off scores can be used in Switzerland. Therefore, the primary purpose of the current study was to estimate the diagnostic performance and optimal cut-off scores of the MAYSI-2 in a sample of Swiss youths in welfare and juvenile justice institutions. As the sample was drawn from the French-, German- and Italian-speaking parts of Switzerland, the three languages were represented in the total sample of the current study and consequently we could estimate the diagnostic performance and the optimal cut-off scores of the MAYSI-2 for the language regions separately. The other main purpose of the current study was to identify potential gender differences in the diagnostic performance and optimal cut-off scores.

Methods

Participants were 297 boys and 149 girls (mean age = 16.2, SD = 2.5) recruited from 64 youth welfare and juvenile justice institutions (drawn from the French-, German- and Italian-speaking parts of Switzerland). The MAYSI-2 was used to screen for mental health or behavioral problems that could require further evaluation. Psychiatric classification was based on the Schedule for Affective Disorders and Schizophrenia for School-Age Children, Present and Lifetime version (K-SADS-PL). The MAYSI-2 scores were submitted into Receiver-Operating Characteristic (ROC) analyses to estimate the diagnostic performance and optimal ‘caution’ cut-off scores of the MAYSI-2.

Results

The ROC analyses revealed that nearly all homotypic mappings of MAYSI-2 scales onto (cluster of) psychiatric disorders revealed above chance level accuracy. The optimal ‘caution’ cut-off scores derived from the ROC curve for predicting (cluster of) psychiatric disorders were, for several MAYSI-2 scales, comparable to the USA norm-based ‘caution’ cut-off scores. For some MAYSI-2 scales, however, higher optimal ‘caution’ cut-off scores were found.

Conclusions

With adjusted optimal ‘caution’ cut-off scores, the MAYSI-2 screens potential emotional or behavioral problems well in a sample of Swiss youths in welfare and juvenile justice institutions. However, as for choosing the optimal ‘caution’ cut off score for the MAYSI-2, both language as well as gender seems to be of importance. The results of this study point to a compelling need to test the diagnostic performance and optimal ‘caution’ cut-off scores of the MAYSI-2 more elaborately in larger differentiated language samples in Europe.
Literature
1.
go back to reference Colins O, Vermeiren R, Schuyten G, Broekaert E. Psychiatric disorders in property, violent, and versatile offending detained male adolescents. Am J Orthop. 2009;79(1):31–8.CrossRef Colins O, Vermeiren R, Schuyten G, Broekaert E. Psychiatric disorders in property, violent, and versatile offending detained male adolescents. Am J Orthop. 2009;79(1):31–8.CrossRef
2.
go back to reference Fazel S, Doll H, Langström N. Mental disorders among adolescents in juvenile detention and correctional facilities: a systematic review and metaregression analysis of 25 surveys. J Am Acad Child Psychiatry. 2008;47(9):1010–9. Fazel S, Doll H, Langström N. Mental disorders among adolescents in juvenile detention and correctional facilities: a systematic review and metaregression analysis of 25 surveys. J Am Acad Child Psychiatry. 2008;47(9):1010–9.
4.
go back to reference Wasserman GA, Mc Reynolds L, Schwalbe CS, Keating JM, Jones SA. Psychiatric disorder, comorbidity, and suicidal behavior in juvenile justice youth. Crim Justice Behav. 2010;37(12):1361–76.CrossRef Wasserman GA, Mc Reynolds L, Schwalbe CS, Keating JM, Jones SA. Psychiatric disorder, comorbidity, and suicidal behavior in juvenile justice youth. Crim Justice Behav. 2010;37(12):1361–76.CrossRef
5.
go back to reference Grisso T, Underwood LA. Screening and assessing mental health and substance use disorders among youth in the juvenile justice system: a resource guide for practitioners. Washington, DC: Office of Juvenile Justice and Delinquency Prevention; 2004. Grisso T, Underwood LA. Screening and assessing mental health and substance use disorders among youth in the juvenile justice system: a resource guide for practitioners. Washington, DC: Office of Juvenile Justice and Delinquency Prevention; 2004.
6.
go back to reference Schmid M, Goldbeck L, Nuetzel J, Fegert JM. Prevalence of mental disorders among adolescents in German youth welfare institutions. Child Adolesc Psychiatry Ment Health. 2008;2:2.CrossRefPubMedPubMedCentral Schmid M, Goldbeck L, Nuetzel J, Fegert JM. Prevalence of mental disorders among adolescents in German youth welfare institutions. Child Adolesc Psychiatry Ment Health. 2008;2:2.CrossRefPubMedPubMedCentral
7.
go back to reference Dölitzsch C, Fegert JM, Künster AK, Kölch M, Schmeck K, Schmid M. Mehrfachdiagnosen bei Schweizer Heimjugendlichen. Kindh Entwickl. 2014;23(3):140–50.CrossRef Dölitzsch C, Fegert JM, Künster AK, Kölch M, Schmeck K, Schmid M. Mehrfachdiagnosen bei Schweizer Heimjugendlichen. Kindh Entwickl. 2014;23(3):140–50.CrossRef
8.
go back to reference Leve LD, Chamberlain P, Reid JB. Intervention outcomes for girls referred from juvenile justice: effects on delinquency. J Consult Clin Psych. 2005;73(6):1181–4.CrossRef Leve LD, Chamberlain P, Reid JB. Intervention outcomes for girls referred from juvenile justice: effects on delinquency. J Consult Clin Psych. 2005;73(6):1181–4.CrossRef
9.
go back to reference Wong TML. Girl delinquency: a study on sex differences in (risk factors for) delinquency. Amsterdam: Vrije Universiteit; 2012. Wong TML. Girl delinquency: a study on sex differences in (risk factors for) delinquency. Amsterdam: Vrije Universiteit; 2012.
10.
go back to reference Cauffman E. A statewide screening of mental health symptoms among juvenile offenders in detention. J Am Acad Child Psychiatry. 2004;43(4):430–9.CrossRef Cauffman E. A statewide screening of mental health symptoms among juvenile offenders in detention. J Am Acad Child Psychiatry. 2004;43(4):430–9.CrossRef
11.
go back to reference Grisso T. Why we need mental health screening and assessment in juvenile justice programs. In: Grisso T, Vincent G, Seagrave D, editors. Mental health screening and assessment in juvenile justice. New York: Guilford Press; 2005. p. 3–21. Grisso T. Why we need mental health screening and assessment in juvenile justice programs. In: Grisso T, Vincent G, Seagrave D, editors. Mental health screening and assessment in juvenile justice. New York: Guilford Press; 2005. p. 3–21.
12.
go back to reference National Mental Health Association. Mental health treatment for youth in the juvenile justice system: a compendium of promising practices. Alexandria: National Mental Health Association; 2004. National Mental Health Association. Mental health treatment for youth in the juvenile justice system: a compendium of promising practices. Alexandria: National Mental Health Association; 2004.
13.
go back to reference Achenbach TM. Manual of the child behavior checklist 4/18 and 1991 profile. Burlington: University of Vermont Department of Psychiatry; 1991. Achenbach TM. Manual of the child behavior checklist 4/18 and 1991 profile. Burlington: University of Vermont Department of Psychiatry; 1991.
14.
go back to reference Achenbach TM. Manual for the youth self-report and 1991 profile. Burlington: University of Vermont Department of Psychiatry; 1991. Achenbach TM. Manual for the youth self-report and 1991 profile. Burlington: University of Vermont Department of Psychiatry; 1991.
15.
go back to reference Derogatis LR. BSI Brief Symptom Inventory: administration, scoring, and procedures manual. 4th ed. Minneapolis: National Computer Systems; 1993. Derogatis LR. BSI Brief Symptom Inventory: administration, scoring, and procedures manual. 4th ed. Minneapolis: National Computer Systems; 1993.
16.
go back to reference Reynolds WM. Reynolds adolescent depression scale: professional manual. 2nd ed. Odessa: Psychological Assessment Resources Inc.; 2002. Reynolds WM. Reynolds adolescent depression scale: professional manual. 2nd ed. Odessa: Psychological Assessment Resources Inc.; 2002.
17.
go back to reference Grisso T, Barnum R. Massachusetts youth screening instrument-version 2 (MAYSI-2): user’s manual and technical report. Sarasota: Professional Resource Press; 2006. Grisso T, Barnum R. Massachusetts youth screening instrument-version 2 (MAYSI-2): user’s manual and technical report. Sarasota: Professional Resource Press; 2006.
18.
go back to reference Grisso T, Fusco S, Paiva-Salisbury M, Perrault R, Williams V, Barnum R. The Massachusetts youth screening instrument-version 2 (MAYSI-2): comprehensive research review. Worcester: University of Massachusets Medical School; 2012. Grisso T, Fusco S, Paiva-Salisbury M, Perrault R, Williams V, Barnum R. The Massachusetts youth screening instrument-version 2 (MAYSI-2): comprehensive research review. Worcester: University of Massachusets Medical School; 2012.
19.
go back to reference Colins OF, Grisso T, Mulder E, Vermeiren R. The relation of standardized mental health screening and categorical assessment in detained male adolescents. Eur Child Adolesc Psychiatry. 2015;24(3):339–49.CrossRefPubMed Colins OF, Grisso T, Mulder E, Vermeiren R. The relation of standardized mental health screening and categorical assessment in detained male adolescents. Eur Child Adolesc Psychiatry. 2015;24(3):339–49.CrossRefPubMed
20.
go back to reference Ford JD, Chapman JF, Pearson G, Borum R, Wolpaw JM. Psychometric status and clinical utility of the MAYSI-2 with girls and boys in juvenile detention. J Psychopathol Behav. 2008;30(2):87–99.CrossRef Ford JD, Chapman JF, Pearson G, Borum R, Wolpaw JM. Psychometric status and clinical utility of the MAYSI-2 with girls and boys in juvenile detention. J Psychopathol Behav. 2008;30(2):87–99.CrossRef
21.
go back to reference McCoy H, Vaughn MG, Maynard BR, Salas-Wright CP. Caution or warning? A validity study of the MAYSI-2 with juvenile offenders. Behav Sci Law. 2014;32(4):508–26.CrossRefPubMed McCoy H, Vaughn MG, Maynard BR, Salas-Wright CP. Caution or warning? A validity study of the MAYSI-2 with juvenile offenders. Behav Sci Law. 2014;32(4):508–26.CrossRefPubMed
22.
go back to reference Wasserman GA, McReynolds LS, Ko SJ, Katz LM, Cauffman E, Haxton W, et al. Screening for emergent risk and service needs among incarcerated youth: comparing MAYSI-2 and voice DISC-IV. J Am Acad Child Psychiatry. 2004;43(5):629–39.CrossRef Wasserman GA, McReynolds LS, Ko SJ, Katz LM, Cauffman E, Haxton W, et al. Screening for emergent risk and service needs among incarcerated youth: comparing MAYSI-2 and voice DISC-IV. J Am Acad Child Psychiatry. 2004;43(5):629–39.CrossRef
23.
go back to reference Devlieger E, Verschuere B. Youth delinquents and mental complaints: a study with the revised Massachusetts Youth Screening Instrument (MAYSI-2) with Flemish juvenile boys. Psychol Gezondh. 2010;38(3):138–42.CrossRef Devlieger E, Verschuere B. Youth delinquents and mental complaints: a study with the revised Massachusetts Youth Screening Instrument (MAYSI-2) with Flemish juvenile boys. Psychol Gezondh. 2010;38(3):138–42.CrossRef
24.
go back to reference Lennox C, O’Malley K, Bell V, Shaw J, Dolan M. The validity and clinical utility of the Massachusetts youth screening instrument-version 2 (MAYSI-2) in the UK. Crim Behav Ment Health. 2014;25:207–19.CrossRefPubMed Lennox C, O’Malley K, Bell V, Shaw J, Dolan M. The validity and clinical utility of the Massachusetts youth screening instrument-version 2 (MAYSI-2) in the UK. Crim Behav Ment Health. 2014;25:207–19.CrossRefPubMed
25.
go back to reference Zimring FE, Langer M, Tanenhaus DS. Juvenile justice in global perspective. New York: NYU Press; 2015.CrossRef Zimring FE, Langer M, Tanenhaus DS. Juvenile justice in global perspective. New York: NYU Press; 2015.CrossRef
26.
go back to reference Kenny D, Grant J. Reliability of self-report of health in juvenile offenders. Vulnerable Child Youth Stud. 2007;2(2):127–41.CrossRef Kenny D, Grant J. Reliability of self-report of health in juvenile offenders. Vulnerable Child Youth Stud. 2007;2(2):127–41.CrossRef
27.
go back to reference Leenarts LEW, Dölitzsch C, Schmeck K, Fegert JM, Grisso T, Schmid M. Relationship between Massachusetts youth screening instrument-second version and psychiatric disorders in youths in welfare and juvenile justice institutions in Switzerland. BMC Psychiatry. 2016;16(1):340.CrossRefPubMedPubMedCentral Leenarts LEW, Dölitzsch C, Schmeck K, Fegert JM, Grisso T, Schmid M. Relationship between Massachusetts youth screening instrument-second version and psychiatric disorders in youths in welfare and juvenile justice institutions in Switzerland. BMC Psychiatry. 2016;16(1):340.CrossRefPubMedPubMedCentral
28.
go back to reference Fischer JE, Bachmann LM, Jaeschke R. A readers’ guide to the interpretation of diagnostic test properties: clinical example of sepsis. Intens Care Med. 2003;29(7):1043–51.CrossRef Fischer JE, Bachmann LM, Jaeschke R. A readers’ guide to the interpretation of diagnostic test properties: clinical example of sepsis. Intens Care Med. 2003;29(7):1043–51.CrossRef
29.
go back to reference Plattner B, The SS, Kraemer HC, Williams RP, Bauer SM, Kindler J, et al. Suicidality, psychopathology, and gender in incarcerated adolescents in Austria. J Clin Psychiatry. 2007;68(10):1593–600.CrossRefPubMed Plattner B, The SS, Kraemer HC, Williams RP, Bauer SM, Kindler J, et al. Suicidality, psychopathology, and gender in incarcerated adolescents in Austria. J Clin Psychiatry. 2007;68(10):1593–600.CrossRefPubMed
30.
go back to reference Canetto SS. Meanings of gender and suicidal behavior during adolescence. Suicide Life Threat Behav. 1997;27(4):339–51.PubMed Canetto SS. Meanings of gender and suicidal behavior during adolescence. Suicide Life Threat Behav. 1997;27(4):339–51.PubMed
31.
go back to reference Kaufman J, Birmaher B, Brent D, Rao U, Ryan N. The Schedule for Affective Disorders and Schizophrenia for School-Age Children - Present and Lifetime version (K-SADS-PL, version 1.0). Pittsburgh: Dept. of Psychiatry, University of Pittsburgh School of Medicine; 1996. Kaufman J, Birmaher B, Brent D, Rao U, Ryan N. The Schedule for Affective Disorders and Schizophrenia for School-Age Children - Present and Lifetime version (K-SADS-PL, version 1.0). Pittsburgh: Dept. of Psychiatry, University of Pittsburgh School of Medicine; 1996.
32.
go back to reference Millon T. Millon adolescent clinical inventory: manual. Minneapolis: National Computer Systems; 1993. Millon T. Millon adolescent clinical inventory: manual. Minneapolis: National Computer Systems; 1993.
Metadata
Title
Diagnostic performance and optimal cut-off scores of the Massachusetts youth screening instrument-second version in a sample of Swiss youths in welfare and juvenile justice institutions
Authors
Claudia Dölitzsch
Laura E. W. Leenarts
Klaus Schmeck
Jorg M. Fegert
Thomas Grisso
Marc Schmid
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2017
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-017-1197-2

Other articles of this Issue 1/2017

BMC Psychiatry 1/2017 Go to the issue