Skip to main content
Top
Published in: Journal of Gambling Studies 3/2016

Open Access 01-09-2016 | Original Paper

Reliability, Validity, and Classification Accuracy of the DSM-5 Diagnostic Criteria for Gambling Disorder and Comparison to DSM-IV

Authors: Randy Stinchfield, John McCready, Nigel E. Turner, Susana Jimenez-Murcia, Nancy M. Petry, Jon Grant, John Welte, Heather Chapman, Ken C. Winters

Published in: Journal of Gambling Studies | Issue 3/2016

Login to get access

Abstract

The DSM-5 was published in 2013 and it included two substantive revisions for gambling disorder (GD). These changes are the reduction in the threshold from five to four criteria and elimination of the illegal activities criterion. The purpose of this study was to twofold. First, to assess the reliability, validity and classification accuracy of the DSM-5 diagnostic criteria for GD. Second, to compare the DSM-5–DSM-IV on reliability, validity, and classification accuracy, including an examination of the effect of the elimination of the illegal acts criterion on diagnostic accuracy. To compare DSM-5 and DSM-IV, eight datasets from three different countries (Canada, USA, and Spain; total N = 3247) were used. All datasets were based on similar research methods. Participants were recruited from outpatient gambling treatment services to represent the group with a GD and from the community to represent the group without a GD. All participants were administered a standardized measure of diagnostic criteria. The DSM-5 yielded satisfactory reliability, validity and classification accuracy. In comparing the DSM-5 to the DSM-IV, most comparisons of reliability, validity and classification accuracy showed more similarities than differences. There was evidence of modest improvements in classification accuracy for DSM-5 over DSM-IV, particularly in reduction of false negative errors. This reduction in false negative errors was largely a function of lowering the cut score from five to four and this revision is an improvement over DSM-IV. From a statistical standpoint, eliminating the illegal acts criterion did not make a significant impact on diagnostic accuracy. From a clinical standpoint, illegal acts can still be addressed in the context of the DSM-5 criterion of lying to others.
Appendix
Available only for authorised users
Literature
go back to reference American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author. American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author.
go back to reference American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed., revised). Washington, DC: Author. American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed., revised). Washington, DC: Author.
go back to reference American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
go back to reference American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
go back to reference Baldessarini, R. J., Finklestein, S., & Arana, G. W. (1983). The predictive power of diagnostic tests and the effect of prevalence of illness. Archives of General Psychiatry, 40, 569–573.CrossRefPubMed Baldessarini, R. J., Finklestein, S., & Arana, G. W. (1983). The predictive power of diagnostic tests and the effect of prevalence of illness. Archives of General Psychiatry, 40, 569–573.CrossRefPubMed
go back to reference Cichetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.CrossRef Cichetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.CrossRef
go back to reference Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.CrossRef Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.CrossRef
go back to reference Denis, C., Fatseas, M., & Auriacombe, M. (2012). Analyses related to the development of DSM-5 criteria for substance use related disorders: 3. An assessment of Pathological Gambling criteria. Drug and Alcohol Dependence, 122, 22–27.CrossRefPubMed Denis, C., Fatseas, M., & Auriacombe, M. (2012). Analyses related to the development of DSM-5 criteria for substance use related disorders: 3. An assessment of Pathological Gambling criteria. Drug and Alcohol Dependence, 122, 22–27.CrossRefPubMed
go back to reference DiStefano, C., & Morgan, G. (2011). Examining classification criteria: A comparison of three cut score methods. Psychological Assessment, 23(2), 354–363.CrossRefPubMed DiStefano, C., & Morgan, G. (2011). Examining classification criteria: A comparison of three cut score methods. Psychological Assessment, 23(2), 354–363.CrossRefPubMed
go back to reference Faraone, S. V., & Tsuang, M. T. (1994). Measuring diagnostic accuracy in the absence of a “Gold Standard”. American Journal of Psychiatry, 151, 650–657.CrossRefPubMed Faraone, S. V., & Tsuang, M. T. (1994). Measuring diagnostic accuracy in the absence of a “Gold Standard”. American Journal of Psychiatry, 151, 650–657.CrossRefPubMed
go back to reference Ferris, J., & Wynne, H. (2001). The Canadian problem gambling index: Final report. Ottawa, ON: Canadian Centre on Substance Abuse. Ferris, J., & Wynne, H. (2001). The Canadian problem gambling index: Final report. Ottawa, ON: Canadian Centre on Substance Abuse.
go back to reference Fisher, S. (2000). Developing the DSM-IV-MR-J criteria to identify adolescent problem gambling in non-clinical populations. Journal of Gambling Studies, 16, 253–273.CrossRefPubMed Fisher, S. (2000). Developing the DSM-IV-MR-J criteria to identify adolescent problem gambling in non-clinical populations. Journal of Gambling Studies, 16, 253–273.CrossRefPubMed
go back to reference Fleiss, J. L. (1981). Statistical methods for rates and proportions (2nd ed.). New York: Wiley. Fleiss, J. L. (1981). Statistical methods for rates and proportions (2nd ed.). New York: Wiley.
go back to reference Friedman, A. S., & Cacciola, J. (1998). Validation of the criteria for DSM diagnoses of cocaine abuse and cocaine dependence. American Journal of Drug and Alcohol Abuse, 24, 169–177.CrossRefPubMed Friedman, A. S., & Cacciola, J. (1998). Validation of the criteria for DSM diagnoses of cocaine abuse and cocaine dependence. American Journal of Drug and Alcohol Abuse, 24, 169–177.CrossRefPubMed
go back to reference Gambino, B. (2012). The validation of screening tests: Meet the new screen same as the old screen? Journal of Gambling Studies, 28, 573–605.CrossRefPubMed Gambino, B. (2012). The validation of screening tests: Meet the new screen same as the old screen? Journal of Gambling Studies, 28, 573–605.CrossRefPubMed
go back to reference Gebauer, L., LaBrie, R., & Shaffer, H. J. (2010). Optimizing DSM-IV-TR classification accuracy: A brief biosocial screen for detecting current gambling disorders among gamblers in the general household population. Canadian Journal of Psychiatry, 55(2), 82–90.PubMed Gebauer, L., LaBrie, R., & Shaffer, H. J. (2010). Optimizing DSM-IV-TR classification accuracy: A brief biosocial screen for detecting current gambling disorders among gamblers in the general household population. Canadian Journal of Psychiatry, 55(2), 82–90.PubMed
go back to reference Glascoe, F. P. (2005). Screening for developmental and behavioural problems. Mental Retardation and Developmental Disabilities Research Reviews, 11, 173–179.CrossRefPubMed Glascoe, F. P. (2005). Screening for developmental and behavioural problems. Mental Retardation and Developmental Disabilities Research Reviews, 11, 173–179.CrossRefPubMed
go back to reference Granero, R., Penelo, E., Stinchfield, R., Fernandez-Aranda, F., Aymami, N., Gomez-Pena, M., et al. (2014). Contribution of illegal acts to pathological gambling diagnosis: DSM-5 implications. Journal of Addictive Diseases. doi:10.1080/10550887.2014.882730. Granero, R., Penelo, E., Stinchfield, R., Fernandez-Aranda, F., Aymami, N., Gomez-Pena, M., et al. (2014). Contribution of illegal acts to pathological gambling diagnosis: DSM-5 implications. Journal of Addictive Diseases. doi:10.​1080/​10550887.​2014.​882730.
go back to reference Jimenez-Murcia, S., Stinchfield, R., Alvarez-Moya, E., Jaurrieta, N., Bueno, B., Granero, R., et al. (2012). Reliability, validity and classification accuracy of a Spanish translation of a measure of DSM-IV diagnostic criteria for pathological gambling [Data file]. Jimenez-Murcia, S., Stinchfield, R., Alvarez-Moya, E., Jaurrieta, N., Bueno, B., Granero, R., et al. (2012). Reliability, validity and classification accuracy of a Spanish translation of a measure of DSM-IV diagnostic criteria for pathological gambling [Data file].
go back to reference Jimenez-Murcia, S., Stinchfield, R., Alvarez-Moya, E., Jaurrieta, N., Bueno, B., Granero, R., et al. (2009). Reliability, validity and classification accuracy of a Spanish translation of a measure of DSM-IV diagnostic criteria for pathological gambling. Journal of Gambling Studies, 25(1), 93–104.CrossRefPubMed Jimenez-Murcia, S., Stinchfield, R., Alvarez-Moya, E., Jaurrieta, N., Bueno, B., Granero, R., et al. (2009). Reliability, validity and classification accuracy of a Spanish translation of a measure of DSM-IV diagnostic criteria for pathological gambling. Journal of Gambling Studies, 25(1), 93–104.CrossRefPubMed
go back to reference Ledgerwood, D. M., Weinstock, J., Morasco, B. J., & Petry, N. M. (2007). Clinical features and treatment prognosis of pathological gamblers with and without recent gambling-related illegal behavior. Journal of the American Academy of Psychiatry and the Law, 35(3), 294–301.PubMed Ledgerwood, D. M., Weinstock, J., Morasco, B. J., & Petry, N. M. (2007). Clinical features and treatment prognosis of pathological gamblers with and without recent gambling-related illegal behavior. Journal of the American Academy of Psychiatry and the Law, 35(3), 294–301.PubMed
go back to reference Lesieur, H. R. (1988). Altering the DSM-III criteria for pathological gambling. Journal of Gambling Behavior, 4, 38–47.CrossRef Lesieur, H. R. (1988). Altering the DSM-III criteria for pathological gambling. Journal of Gambling Behavior, 4, 38–47.CrossRef
go back to reference Lesieur, H. R., & Blume, S. B. (1987). The South Oaks Gambling Screen (SOGS): A new instrument for the identification of pathological gamblers. American Journal of Psychiatry, 144, 1184–1188.CrossRefPubMed Lesieur, H. R., & Blume, S. B. (1987). The South Oaks Gambling Screen (SOGS): A new instrument for the identification of pathological gamblers. American Journal of Psychiatry, 144, 1184–1188.CrossRefPubMed
go back to reference Lesieur, H. R., & Blume, S. B. (1993). Revising the South Oaks Gambling Screen in different settings. Journal of Gambling Studies, 9(3), 213–223.CrossRef Lesieur, H. R., & Blume, S. B. (1993). Revising the South Oaks Gambling Screen in different settings. Journal of Gambling Studies, 9(3), 213–223.CrossRef
go back to reference Lesieur, H. R., & Rosenthal, R. J. (1991). Pathological gambling: A review of the literature (prepared for the American Psychiatric Association Task Force on DSM-IV Committee on Disorders of Impulse Control Not Elsewhere Specified). Journal of Gambling Studies, 7, 5–39.CrossRefPubMed Lesieur, H. R., & Rosenthal, R. J. (1991). Pathological gambling: A review of the literature (prepared for the American Psychiatric Association Task Force on DSM-IV Committee on Disorders of Impulse Control Not Elsewhere Specified). Journal of Gambling Studies, 7, 5–39.CrossRefPubMed
go back to reference National Research Council. (1999). Pathological gambling: A critical review. Washington, DC: National Academy Press. National Research Council. (1999). Pathological gambling: A critical review. Washington, DC: National Academy Press.
go back to reference Nunnally, J. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill. Nunnally, J. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
go back to reference Petry, N. M. (2006). Should the scope of addictive behaviors be broadened to include pathological gambling? Addiction, 101(Suppl. 1), 152–160.CrossRefPubMed Petry, N. M. (2006). Should the scope of addictive behaviors be broadened to include pathological gambling? Addiction, 101(Suppl. 1), 152–160.CrossRefPubMed
go back to reference Petry, N. M., Blanco, C., Stinchfield, R., & Volberg, R. (2013). An empirical evaluation of proposed changes for gambling diagnosis in the DSM-5. Addiction, 108, 575–581.CrossRefPubMed Petry, N. M., Blanco, C., Stinchfield, R., & Volberg, R. (2013). An empirical evaluation of proposed changes for gambling diagnosis in the DSM-5. Addiction, 108, 575–581.CrossRefPubMed
go back to reference Rosenthal, R. J. (1989). Pathological gambling and problem gambling: Problems of definitions and diagnosis. In H. J. Shaffer, S. A. Stein, B. Gambino, & T. N. Cummings (Eds.), Compulsive gambling: Theory, research, and practice (pp. 101–125). Lexington, MA: Lexington Books. Rosenthal, R. J. (1989). Pathological gambling and problem gambling: Problems of definitions and diagnosis. In H. J. Shaffer, S. A. Stein, B. Gambino, & T. N. Cummings (Eds.), Compulsive gambling: Theory, research, and practice (pp. 101–125). Lexington, MA: Lexington Books.
go back to reference Stinchfield, R. (2001). Reliability, validity, and classification accuracy of the South Oaks Gambling Screen (SOGS). Addictive Behaviors, 27, 1–19.CrossRef Stinchfield, R. (2001). Reliability, validity, and classification accuracy of the South Oaks Gambling Screen (SOGS). Addictive Behaviors, 27, 1–19.CrossRef
go back to reference Stinchfield, R. (2003). Reliability, validity, and classification accuracy of a measure of DSM-IV diagnostic criteria for pathological gambling. American Journal of Psychiatry, 160, 180–182.CrossRefPubMed Stinchfield, R. (2003). Reliability, validity, and classification accuracy of a measure of DSM-IV diagnostic criteria for pathological gambling. American Journal of Psychiatry, 160, 180–182.CrossRefPubMed
go back to reference Stinchfield, R. (2014). A review of problem gambling assessment instruments and brief screens. In D. Richards, A. Blaszczynski, & L. Nower (Eds.), Wiley-Blackwell handbook of disordered gambling (pp. 165–203). Oxford: Wiley. Stinchfield, R. (2014). A review of problem gambling assessment instruments and brief screens. In D. Richards, A. Blaszczynski, & L. Nower (Eds.), Wiley-Blackwell handbook of disordered gambling (pp. 165–203). Oxford: Wiley.
go back to reference Stinchfield, R., Govoni, R., & Frisch, R. G. (2005). DSM-IV diagnostic criteria for pathological gambling: Reliability, validity, and classification accuracy. American Journal on Addictions, 14, 73–82.CrossRefPubMed Stinchfield, R., Govoni, R., & Frisch, R. G. (2005). DSM-IV diagnostic criteria for pathological gambling: Reliability, validity, and classification accuracy. American Journal on Addictions, 14, 73–82.CrossRefPubMed
go back to reference Stinchfield, R., McCready, J., & Govoni, R. (2012). DSM-IV diagnostic criteria for pathological gambling: Reliability, validity, and classification accuracy [Data file]. Stinchfield, R., McCready, J., & Govoni, R. (2012). DSM-IV diagnostic criteria for pathological gambling: Reliability, validity, and classification accuracy [Data file].
go back to reference Stinchfield, R., Winters, K. C., Botzet, A., Jerstad, S., & Breyer, J. (2007). Development and psychometric evaluation of the gambling treatment outcome monitoring system (GAMTOMS). Psychology of Addictive Behaviors, 21(2), 174–184.CrossRefPubMed Stinchfield, R., Winters, K. C., Botzet, A., Jerstad, S., & Breyer, J. (2007). Development and psychometric evaluation of the gambling treatment outcome monitoring system (GAMTOMS). Psychology of Addictive Behaviors, 21(2), 174–184.CrossRefPubMed
go back to reference Strong, D. R., & Kahler, C. W. (2007). Evaluation of the continuum of gambling problems using the DSM-IV. Addiction, 102, 713–721.CrossRefPubMed Strong, D. R., & Kahler, C. W. (2007). Evaluation of the continuum of gambling problems using the DSM-IV. Addiction, 102, 713–721.CrossRefPubMed
go back to reference Temcheff, C. E., Derevensky, J. L., & Paskus, T. S. (2011). Pathological and disordered gambling: A comparison of DSM-IV and DSM-V criteria. International Gambling Studies, 11(2), 213–220.CrossRef Temcheff, C. E., Derevensky, J. L., & Paskus, T. S. (2011). Pathological and disordered gambling: A comparison of DSM-IV and DSM-V criteria. International Gambling Studies, 11(2), 213–220.CrossRef
go back to reference Turner, N. E., Preston, D. L., McAvoy, S., & Gillam, L. (2013). Problem gambling inside and out: The assessment of community and institutional problem gambling in the Canadian correctional system. Journal of Gambling Studies, 29(3), 435–451. doi:10.1007/s10899-012-9321-1.CrossRefPubMed Turner, N. E., Preston, D. L., McAvoy, S., & Gillam, L. (2013). Problem gambling inside and out: The assessment of community and institutional problem gambling in the Canadian correctional system. Journal of Gambling Studies, 29(3), 435–451. doi:10.​1007/​s10899-012-9321-1.CrossRefPubMed
go back to reference Turner, N. E., Preston, D. L., Saunders, C., McAvoy, S., & Jain, U. (2009). The relationship of problem gambling to criminal behaviour in a sample of Canadian male federal offenders. Journal of Gambling Studies, 25, 153–169.CrossRefPubMed Turner, N. E., Preston, D. L., Saunders, C., McAvoy, S., & Jain, U. (2009). The relationship of problem gambling to criminal behaviour in a sample of Canadian male federal offenders. Journal of Gambling Studies, 25, 153–169.CrossRefPubMed
go back to reference Zimmerman, M., Chelminski, I., & Young, D. (2006). A psychometric evaluation of the DSM-IV pathological gambling diagnostic criteria. Journal of Gambling Studies, 22, 329–337.CrossRefPubMed Zimmerman, M., Chelminski, I., & Young, D. (2006). A psychometric evaluation of the DSM-IV pathological gambling diagnostic criteria. Journal of Gambling Studies, 22, 329–337.CrossRefPubMed
Metadata
Title
Reliability, Validity, and Classification Accuracy of the DSM-5 Diagnostic Criteria for Gambling Disorder and Comparison to DSM-IV
Authors
Randy Stinchfield
John McCready
Nigel E. Turner
Susana Jimenez-Murcia
Nancy M. Petry
Jon Grant
John Welte
Heather Chapman
Ken C. Winters
Publication date
01-09-2016
Publisher
Springer US
Published in
Journal of Gambling Studies / Issue 3/2016
Electronic ISSN: 1573-3602
DOI
https://doi.org/10.1007/s10899-015-9573-7

Other articles of this Issue 3/2016

Journal of Gambling Studies 3/2016 Go to the issue