Top

International Journal of Mental Health and Addiction

Published in:

Open Access 01-04-2018 | Original Article

Measurement Invariance of the Internet Gaming Disorder Scale–Short-Form (IGDS9-SF) Between Australia, the USA, and the UK

Authors: Vasileios Stavropoulos, Charlotte Beard, Mark D. Griffiths, Tyrone Buleigh, Rapson Gomez, Halley M. Pontes

Published in: International Journal of Mental Health and Addiction | Issue 2/2018

Abstract

The Internet Gaming Disorder Scale–Short-Form (IGDS9-SF) is widely used to assess Internet Gaming Disorder behaviors. Investigating cultural limitations and implications in its applicability is imperative. One way to evaluate the cross-cultural feasibility of the measure is through measurement invariance analysis. The present study used Multigroup Confirmatory Factor Analysis (MGCFA) to examine the IGDS9-SF measurement invariance across gamers from Australia, the United States of America (USA), and the United Kingdom (UK). To accomplish this, 171 Australian, 463 USA, and 281 UK gamers completed the IGDS9-SF. Although results supported the one-factor structure of the IGD construct, they indicated cross-country variations in the strength of the relationships between the indicators and their respective factor (i.e., non-invariant loadings of items 1, 2, 5), and that the same scores may not always indicate the same level of IGD severity across the three groups (i.e., non-invariant intercepts for items 1, 5, 7, 9).

Available only for authorised users

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.CrossRef

Anderson, E. L., Steen, E., & Stavropoulos, V. (2016). Internet use and problematic internet Use: A systematic review of longitudinal research trends in adolescence and emergent adulthood. International Journal of Adolescence and Youth, 1–25. doi:10.1080/02673843.2016.1227716.

Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57, 289–300.

Beyers, J. M., Toumbourou, J. W., Catalano, R. F., Arthur, M. W., & Hawkins, J. D. (2004). A cross-national comparison of risk and protective factors for adolescent substance use: the United States and Australia. Journal of Adolescent Health, 35(1), 3–16. doi:10.1016/j.jadohealth.2003.08.015.

Brown, T. A. (2014). Confirmatory factor analysis for applied research. New York: Guilford Publications.

Casler, K., Bickel, L., & Hackett, E. (2013). Separate but equal? A comparison of participants and data gathered via Amazon’s mechanical Turk, social media, and face-to-face behavioral testing. Computers in Human Behavior, 29(6), 2156–2160. doi:10.1016/j.chb.2013.05.009.CrossRef

Chandler, J., & Shapiro, D. (2016). Conducting clinical research using crowdsourced convenience samples. Annual Review of Clinical Psychology, 12, 53–81. doi:10.1146/annurev-clinpsy-021815-093623.CrossRefPubMed

Chen, S., & Bouvain, P. (2009). Is corporate responsibility converging? A comparison of corporate responsibility reporting in the USA, UK, Australia, and Germany. Journal of Business Ethics, 87, 299–317. doi:10.1007/s10551-008-9794-0.CrossRef

Cheung, G. W., & Lau, R. S. (2012). A direct comparison approach for testing measurement invariance. Organizational Research Methods, 15(2), 167–198. doi:10.1177/1094428111421987.CrossRef

Clemens, S., Begum, N., Harper, C., Whitty, J. A., & Scuffham, P. A. (2014). A comparison of EQ-5D-3L population norms in Queensland, Australia, estimated using utility value sets from Australia, the UK and USA. Quality of Life Research, 23(8), 2375–2381. doi:10.1007/s11136-014-0676-x.CrossRefPubMed

Coffey, C., Carlin, J. B., Lynskey, M., Li, N., & Patton, G. C. (2003). Adolescent precursors of cannabis dependence: Findings from the Victoria adolescent health cohort study. British Journal of Psychiatry, 182, 330–336. doi:10.1192/bjp.182.4.330.

Gjersing, L., Caplehorn, J. R. M., & Clausen, T. (2010). Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. Biomed Central Medical Research Methodology, 10(13). doi:10.1186/1471-2288-10-13.

Gomez, R., & Rohner, R. P. (2011). Tests of factor structure and measurement invariance in the United States and Australia using the adult version of the parental acceptance-rejection questionnaire. Cross- Cultural Research, 45(3), 267–285. doi:10.1177/1069397111403111.

Gomez, R. (2013). DSM-IV ADHD symptoms self-ratings by adolescents: Test of invariance across gender. Journal of Attention Disorders, 17(1), 3–10. doi:10.1177/1087054711403715.

Global Games Market Report (2016). Retrieved March 15, 2017, from: https://newzoo.com/insights/rankings/top-100-countries-by-game-revenues/.

Griffiths, M. D., & Hunt, N. (1998). Dependence on computer games by adolescents. Psychological Reports, 82(2), 475–480. doi:10.2466/pr0.1998.82.2.475.

Griffiths, M. D. (2010). The use of online methodologies in data collection for gambling and gaming addictions. International Journal of Mental Health and Addiction, 8, 8–20. doi:10.1007/s11469-009-9209-1.

Griffiths, M. D., van Rooij, A. J., Kardefelt-Winther, D., Starcevic, V., Király, O., Pallesen, S.& Demetrovics, Z. (2016). Working towards an international consensus on criteria for assessing internet gaming disorder: A critical commentary on Petry et al. (2014). Addiction, 111(1), 167–75. doi:10.1111/add.13057.

Hoeft, F., Watson, C. L., Kesler, S. R., Bettinger, K. E., & Reiss, A. L. (2008). Gender differences in the mesocorticolimbic system during computer game-play. Journal of Psychiatric Research, 42(4), 253–258. doi:10.1016/j.jpsychires.2007.11.010.

Kaptsis, D., King, D. L., Delfabbro, P. H., & Gradisar, M. (2016). Withdrawal symptoms in internet gaming disorder: a systematic review. Clinical Psychology Review, 43, 58–66. doi:10.1016/j.cpr.2015.11.006.CrossRefPubMed

King, D. L., & Delfabbro, P. H. (2014). Is preoccupation an oversimplification? A call to examine cognitive factors underlying internet gaming disorder. Addiction, 109(9), 1566–1567. doi:10.1111/add.12547.

King, D. L., Delfabbro, P. H., & Griffiths, M. D. (2010a). The role of structural characteristics in problem video game playing: A review. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 4(1), article 1.

King, D. L., Delfabbro, P. H., & Griffiths, M. D. (2010b). Video game structural characteristics: A new psychological taxonomy. International Journal of Mental Health and Addiction, 8(1), 90–106. doi:10.1007/s11469-009-9206-4.

King, D. L., Delfabbro, P. H., & Griffiths, M. D. (2011). The role of structural characteristics in problematic video game play: An empirical study. International Journal of Mental Health and Addiction, 9(3), 320–333. doi:10.1007/s11469-010-9289-y.

King, D. L., Haagsma, M. C., Delfabbro, P. H., Gradisar, M., & Griffiths, M. D. (2013). Toward a consensus definition of pathological video-gaming: A systematic review of psychometric assessment tools. Clinical Psychology Review, 33, 331–342. doi:10.1016/j.cpr.2013.01.002.

Király, O., Griffiths, M. D., & Demetrovics, Z. (2015). Internet gaming disorder and the DSM-5: Conceptualization, debates, and controversies. Current Addiction Reports, 2(3), 254-262. doi:10.1007/s40429-015-0066-7.

Király, O., Sleczka, P., Pontes, H. M., Urbán, R., Griffiths, M. D., & Demetrovics, Z. (2017). Validation of the ten-item Internet Gaming Disorder Test (IGDT-10) and evaluation of the nine DSM-5 Internet Gaming Disorder criteria. Addictive Behaviors, 64, 253–260. doi:10.1016/j.addbeh.2015.11.005.

Kuss, D. J., Griffiths, M. D., & Pontes, H. M. (2017). Chaos and confusion in DSM-5 diagnosis of Internet Gaming Disorder: Issues, concerns, and recommendations for clarity in the field. Journal of Behavioral Addictions, 6(2), 103–109. doi:10.1556/2006.5.2016.062.

Landrine, H., & Klonoff, E. K. (1992). Culture and health-related schemas: a review and proposal for interdisciplinary integration. Health Psychology, 11(4), 267–276. doi:10.1037/0278-6133.11.4.267.CrossRefPubMed

Lee, Y. H., & Wohn, D. Y. (2012). Are there cultural differences in how we play? Examining cultural effects on playing social network games. Computers in Human Behavior, 28(4), 1307–1314. doi:10.1016/j.chb.2012.02.014.CrossRef

Lemmens, J. S., Valkenburg, P. M., & Gentile, D. A. (2015). The Internet Gaming Disorder Scale. Psychological Assessment, 27(2), 567–582. doi:10.1037/pas0000062.CrossRefPubMed

Lopez-Fernandez, O., Kuss, D., Pontes, H., & Griffiths, M. (2016). Video game addiction: Providing evidence for internet gaming disorder through a systematic review of clinical studies. European Psychiatry, 33, S306. doi:10.1016/j.eurpsy.2016.01.1047.

Millsap, R. E., & Yun-Tein, J. (2004). Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39(3), 479–515. doi:10.1207/S15327906MBR3903_4.CrossRef

Monacis, L., De Palo, V., Griffiths, M. D., & Sinatra, M. (2016). Validation of the internet gaming disorder scale – short-form (IGDS9-SF) in an Italian-speaking sample. Journal of Behavioral Addictions, 5(4), 683–690. doi:10.1556/2006.5.2016.083.

Muthén, L. K., & Muthén, B. O. (2012). Mplus user’s guide (seventh ed.). Los Angeles, CA: Muthén & Mut.

Oyserman, D., Coon, H. M., & Kemmelmeier, M. (2002). Rethinking individualism and collectivism: Evaluation of theoretical assumptions and meta-analyses. Psychological Bulletin, 128(1), 3–72. doi:10.1037/0033-2909.128.1.3.

Petry, N. M., Rehbein, F., Gentile, D. A., Lemmens, J. S., Rumpf, H. J., Mößle, T., et al. (2014). An international consensus for assessing internet gaming disorder using the new DSM-5 approach. Addiction, 109(9), 1399–1406. doi:10.1111/add.12457.CrossRefPubMed

Petry, N. M., Rehbein, F., Ko, C. H., & O’Brien, C. P. (2015). Internet gaming disorder in the DSM-5. Current Psychiatry Reports, 17(72), 1–9. doi:10.1007/s11920-015-0610-0.

Pettit, F. A. (2002). A comparison of World-Wide Web and paper-and-pencil personality questionnaires. Behavior Research Methods, Instruments, & Computers, 34(1), 50–54. doi:10.3758/BF03195423.CrossRef

Pontes, H. M. (2016). Current practices in the clinical and psychometric assessment of internet gaming disorder in the era of the DSM-5: A mini review of existing assessment tools. Mental Health and Addiction Research, 1(1), 18–19. doi:10.15761/MHAR.1000105.

Pontes, H. M., & Griffiths, M. D. (2014). Assessment of internet gaming disorder in clinical research: Past and present perspectives. Clinical Research and Regulatory Affairs, 31(2-4), 35–48. doi:10.3109/10601333.2014.962748.

Pontes, H. M., Király, O., Demetrovics, Z., & Griffiths, M. D. (2014). The conceptualisation and measurement of DSM-5 internet gaming disorder: The development of the IGD-20 test. PLoS ONE, 9(10), e110137. doi:10.1371/journal.pone.0110137.

Pontes, H. M., & Griffiths, M. D. (2015). Measuring DSM-5 internet gaming disorder: Development and validation of a short psychometric scale. Computers in Human Behavior, 45, 137–143. doi:10.1016/j.chb.2014.12.006.

Pontes, H. M., & Griffiths, M. D. (2016). Portuguese validation of the internet gaming disorder scale–short-form. Cyberpsychology, Behavior, and Social Networking, 19(4), 288–293. doi:10.1089/cyber.2015.0605.

Pontes, H. M., Macur, M., & Griffiths, M. D. (2016a). OR-85: construct validity and preliminary psychometric properties of the internet gaming disorder scale short-form (IGDS9-SF) among Slovenian youth: A nationally representative study. Journal of Behavioral Addictions, 5(S1), 35–36. doi:10.1556/2006.5.2016.042.

Pontes, H. M., Macur, M., & Griffiths, M. D. (2016b). Internet gaming disorder among Slovenian primary schoolchildren: Findings from a nationally representative sample of adolescents. Journal of Behavioral Addictions, 5(2), 304-310. doi:10.1556/2006.5.2016.042.

Raykov, T., Marcoulides, G. A., & Millsap, R. E. (2013). Factorial invariance in multiple populations: a multiple testing procedure. Educational and Psychological Measurement, 73(4), 713–727.CrossRef

Rehbein, F., Kliem, S., Baier, D., Mößle, T., & Petry, N. M. (2015). Prevalence of internet gaming disorder in German adolescents: diagnostic contribution of the nine DSM-5 criteria in a state-wide representative sample. Addiction, 110(5), 842–851. doi:10.1111/add.12849.CrossRefPubMed

Salguero, R. A. T., & Moran, R. B. M. (2002). Measuring problem video game playing in adolescents. Addiction, 97(12), 1601–1160.CrossRef

Satorra, A., & Bentler, P. M. (2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75, 243–248. doi:10.1007/s11336-009-9135-y.CrossRefPubMedPubMedCentral

Schlotz, W., Yim, I. S., Zoccola, P. M., Jansen, L., & Schulz, P. (2011). The perceived stress reactivity Scale: measurement invariance, stability, and validity in three countries. Psychological Assessment, 23(1), 80. doi:10.1037/a0021148.

Singelis, T. M., Triandis, H. C., Bhawuk, D. P., & Gelfand, M. J. (1995). Horizontal and vertical dimensions of individualism and collectivism: a theoretical and measurement refinement. Cross-Cultural Research, 29(3), 240–275.CrossRef

Stavropoulos, V., Alexandraki, K., & Motti-Stefanidi, F. (2013). Recognizing internet addiction: Prevalence and relationship to academic achievement in adolescents enrolled in urban and rural Greek high schools. Journal of Adolescence, 36(3), 565–576. doi:10.1016/j.adolescence.2013.03.008.

Stavropoulos, V., Kuss, D. J., Griffiths, M. D., Wilson, P., & Motti-Stefanidi, F. (2017). MMORPG gaming and hostility predict Internet addiction symptoms in adolescents: An empirical multilevel longitudinal study. Addictive Behaviors, 64, 294–300. doi:10.1016/j.addbeh.2015.09.001.

Stetina, B. U., Kothgassner, O. D., Lehenbauer, M., & Kryspin-Exner, I. (2011). Beyond the fascination of online-games: probing addictive behavior and depression in the world of online-gaming. Computers in Human Behavior, 27, 473–479. doi:10.1016/j.chb.2010.09.015.CrossRef

Tao, R., Huang, X., Wang, J., Zhang, H., Zhang, Y., & Li, M. (2010). Proposed diagnostic criteria for Internet addiction. Addiction, 105(3), 556–564. doi:10.1111/j.1360-0443.2009.02828.x.CrossRefPubMed

Van Rooij, A. J., Van Looy, J., & Billieux, J. (2016). Internet gaming disorder as a formative construct: implications for conceptualization and measurement. Psychiatry and Clinical Neurosciences. doi:10.1111/pcn.12404.

Weigold, A., Weigold, I. K., & Russell, E. J. (2013). Examination of the equivalence of self-report survey-based paper-and-pencil and Internet data collection methods. Psychological Methods, 18(1), 53–70. doi:10.1037/a0031607.CrossRefPubMed

Westwood, D., & Griffiths, M. D. (2010). The role of structural characteristics in video-game play motivation: A Q-methodology study. Cyberpsychology, Behavior, and Social Networking, 13(5), 581–585. doi:10.1089/cyber.2009.0361.

Wu, T. Y., Lin, C. Y., Årestedt, K., Griffiths, M. D., Broström, A., & Pakpour, A. H. (2017). Psychometric validation of the Persian internet gaming disorder scale-short form: Does gender and hours spent gaming online affect the interpretations of item descriptions? Journal of Behavioral Addictions. doi:10.1556/2006.6.2017.025.

Title: Measurement Invariance of the Internet Gaming Disorder Scale–Short-Form (IGDS9-SF) Between Australia, the USA, and the UK
Authors: Vasileios Stavropoulos
Charlotte Beard
Mark D. Griffiths
Tyrone Buleigh
Rapson Gomez
Halley M. Pontes
Publication date: 01-04-2018
Publisher: Springer US
Published in: International Journal of Mental Health and Addiction / Issue 2/2018
Print ISSN: 1557-1874
Electronic ISSN: 1557-1882
DOI: https://doi.org/10.1007/s11469-017-9786-3

At a glance: The STEP trials

Springer Medicine

Measurement Invariance of the Internet Gaming Disorder Scale–Short-Form (IGDS9-SF) Between Australia, the USA, and the UK

Abstract

At a glance: The STEP trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 2/2018

Dialectical Behavior Therapy for Multiple Treatment Targets: A Case Study of a Male with Comorbid Personality and Substance Use Disorders

Patterns and Motives for Electronic Cigarette Use in a Sample of Community-Recruited Gamblers

Modulation of Physiological Responses as Indices of Attentional Bias in Dysphoria

Sex Differences in the Factors Influencing Korean College Students’ Addictive Tendency Toward Social Networking Sites

Relapse Risk Factors in Heroin Addicts Treated with Naltrexone and Naltrexone-Behavioural Psychotherapy

The Psychometric Properties of the Smartphone Application-Based Addiction Scale (SABAS)