Top

International Journal of Mental Health and Addiction

Published in:

01-04-2022 | Original Article

Developing the Cyberostracism Scale and Examining its Psychometric Characteristics

Authors: Osman Hatun, İbrahim Demirci

Published in: International Journal of Mental Health and Addiction | Issue 2/2022

Abstract

This study aims to develop the Cyberostracism Scale (CS) to assess university students’ perceptions of virtual social exclusion. Validity and reliability studies were carried out with 3 different groups (N = 692; %69 women). In the developing process of the scale, EFA, CFA, Item Response Theory (IRT), and criterion-related validity and reliability (Cronbach’s α, McDonald’s ω, and test-retest) analyses were used. EFA results indicated that the CS has a 3-dimensional structure (Direct Excluded, Indirect Excluded, Ignored) which explains 55.74% of the total variance. The CFA results showed that the 3-factor structure of the scale had an acceptable level of fit indices and had a measurement invariance across gender. IRT analysis showed that all items of the scale were coherent and fit with the model. The results indicated that the scale had satisfactory reliability coefficients. The cyberostracism was found to be associated with the ostracism. Results of the study show that the CS is a valid and reliable measurement tool.

Available only for authorised users

Abrams, D., Weick, M., Thomas, D., Colbe, H., & Franklin, K. M. (2011). On-line ostracism affects children differently from adolescents and adults. British Journal of Developmental Psychology, 29(1), 110–123. https://doi.org/10.1348/026151010X494089.CrossRef

Aiken, L., & Groth-Marnat, G. (2006). Psychological testing and assessment. Boston: Allyn and Bacon.

Akın, A., Uysal, R., & Akın, Ü. (2016). Ergenler için ostrasizm (sosyal dışlanma) ölçeğinin Türkçe’ye uyarlanması. Kastamonu Eğitim Dergisi, 24(2), 895–904 https://toad.halileksi.net/sites/default/files/pdf/.

Allen, K. A., Ryan, T., Gray, D. L., McInerney, D. M., & Waters, L. (2014). Social media use and social connectedness in adolescents: the positives and the potential pitfalls. Australian Educational and Developmental Psychologist, 31(1), 18–31. https://doi.org/10.1017/edp.2014.2.CrossRef

Bahk, C. M., Sheil, A., Rohm, C. E. T., & ve Lin, F. (2010). Digital media dependency, relational orientation and social networking among college students. Communications of the IIMA, 10(3), 69–78 http://iima.org/wp/wp-content/uploads/2017/04/Digital-Media-Dependency-Relational-Orientation-and-Social-Networking_Bahk-etal.pdf.

Baker, F. B. (2001). The basics of item response theory. https://eric.ed.gov/?id=ED458219

Bauman, S., & Pero, H. (2011). Bullying and cyberbullying among deaf students and their hearing peers: an exploratory study. Journal of Deaf Studies and Deaf Education, 16(2), 236–253. https://doi.org/10.1093/deafed/enq043.CrossRefPubMed

Blanchard, A. L., & Markus, M. L. (2004). The experienced “sense” of a virtual community: characteristics and processes. ACM Sigmis Database: The Database for Advances in İnformation Systems, 35(1), 64–79. https://doi.org/10.1145/968464.968470.CrossRef

Bonetti, L., Campbell, M. A., & Gilmore, L. (2010). The relationship of loneliness and social anxiety with children’s and adolescents’ online communication. Cyberpsychology, Behavior and Social Networking, 13(3), 279–285. https://doi.org/10.1089/cyber.2009.0215.CrossRefPubMed

Buchanan, E. M. (2020). Structural equation modeling. https://doi.org/10.17605/OSF.IO/2Y67F.

Byrne, B. M., & Stewart, S. M. (2006). Teacher’s corner: the MACS approach to testing for multigroup invariance of a second-order structure: a walk through the process. Structural Equation Modeling, 13(2), 287–321. https://doi.org/10.1207/s15328007sem1302_7.CrossRef

Cain, J., & Chretien, C. (2013). Exploring social media’s potential in interprofessional education. Journal of Research in Interprofessional Practice and Education, 2(3), 1–7. https://doi.org/10.22230/jripe.2013v3n2a110.CrossRef

Casas, J. A., Del Rey, R., & Ortega-Ruiz, R. (2013). Bullying and cyberbullying: convergent and divergent predictor variables. Computers in Human Behavior, 29(3), 580–587. https://doi.org/10.1016/j.chb.2012.11.015.CrossRef

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834.CrossRef

Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5.CrossRef

Clement, J. (2020). Global social media ranking 2020. https://www.statista.com/statistics/272014/global-social-networks-ranked-by-number-of-users/

Çokluk, Ö., Şekercioğlu, G., & Büyüköztürk, Ş. (2012). Sosyal bilimler için çok değişkenli istatistik: SPSS ve LISREL uygulamaları (2. Basım). Pegem Akademi.

Davis, K. (2012). Friendship 2.0: Adolescents' experiences of belonging and self-disclosure online. Journal of Adolescence, 35(6), 1527–1536. https://doi.org/10.1016/j.adolescence.2012.02.013.

Demirci, İ. (2019). The adaptation of the Bergen Social Media Addiction Scale to Turkish and the evaluation its relationships with depression and anxiety symptoms. Anatolian Journal of Psychiatry, (SI 1), 15–23. https://doi.org/10.5455/apd.41585.

Eisenberger, N. I., Lieberman, M. D., & Williams, K. D. (2003). Does rejection hurt? An fMRI study of social exclusion. Science, 302(5643), 290–292. https://doi.org/10.1126/science.1089134.

Erdur-Baker, Ö. (2010). Cyberbullying and its correlation to traditional bullying, gender and frequent and risky usage of İnternet-mediated communication tools. New Media ve Society, 12(1), 109–125. 10.1177%2F1461444809341260.

Gilman, R., Carter-Sowell, A., DeWall, C. N., Adams, R. E., & Carboni, I. (2013). Validation of the ostracism experience scale for adolescents. Psychological Assessment, 25(2), 319–330 https://psycnet.apa.org/doi/10.1037/a0030913.CrossRef

Görzig, A., & Frumkin, L. A. (2013). Cyberbullying experiences on-the-go: when social media can become distressing. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 7(1), Article 4. https://doi.org/10.5817/CP2013-1-4.CrossRef

Greitemeyer, T., Mügge, D. O., & Bollermann, I. (2014). Having responsive Facebook friends affects the satisfaction ofpsychological needs more than having many Facebook friends. Basic and Applied Social Psychology, 36, 252e258–252e258. https://doi.org/10.1080/01973533.2014.900619.CrossRef

Hadjipanayis, A., Efstathiou, E., Altorjai, P., Stiris, T., Valiulis, A., Koletzko, B., & Fonseca, H. (2019). Social media and children: what is the paediatrician’s role? European Journal of Pediatrics, 178(10), 1605–1612. https://doi.org/10.1007/s00431-019-03458-w.CrossRefPubMed

Hartgerink, C. H. J., van Beest, I., Wicherts, J. M., & Williams, K. D. (2015). The ordinal effects of ostracism: A meta-analysis of 120 cyberball studies. PLoS ONE, 10(5), e0127002. 10.1371%2Fjournal.pone.0127002.

Hayes, R. A., Wesselmann, E. D., & Carr, C. T. (2018). When nobody “likes” you: perceived ostracism through paralinguistic digital affordances within social media. Social Media + Society, 4(3), 205630511880030. https://doi.org/10.1177/2056305118800309.CrossRef

Heeren, A., Peschard, V., & Philippot, P. (2012). The causal role of attentional bias for threat cues in social anxiety: a test on a cyber-ostracism task. Cognitive Therapy and Research, 36(5), 512–521. https://doi.org/10.1007/s10608-011-9394-7.CrossRef

Ho, S. S., Chen, L., & Ng, A. P. (2017). Comparing cyberbullying perpetration on social media between primary and secondary school students. Computers & Education, 109, 74–84. https://doi.org/10.1016/j.compedu.2017.02.004.CrossRef

Hu, L. T., & Bentler, P. M. (1999). Cut off criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.CrossRef

Karlen, C. E., & Daniels, J. R. (2011). Cyberostracism and social monitoring: Social anxiety’s effects on reactions to exclusion and inclusion online. Honors Projects, 147. http://digitalcommons.iwu.edu/cgi/viewcontent.cgi?article=1146&context=psych_honproj

Kemp, S. (2020). Digital 2020: Global Overivew Report. Retrieved from https://wearesocial.com/blog/2020/01/digital-2020-3-8-billion-people-use-social-media

Kline, R. B. (2015). Principles and practice of structural equation modeling (4th ed.). Guilford Publications.

Koh, J., & Kim, Y.-G. (2003). Sense of virtual community: a conceptual framework and empirical validation. International Journal of Electronic Commerce, 8(2), 75–94. https://doi.org/10.1080/10864415.2003.11044295.CrossRef

Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x.CrossRef

Lechner, U., & Hummel, J. (2002). Business models and system architectures of virtual communities: from a sociological phenomenon to peer-to-peer architectures. International Journal of Electronic Commerce, 6(3), 41–53. https://doi.org/10.1080/10864415.2002.11044242.CrossRef

Lei, Y., Zhang, C., Niu, G., Tong, Y., Tian, Y., & Zhou, Z. (2018). The association between cyber-ostracism and depression: a moderated mediation model. Journal of Psychological Science, 41(1), 98–104. https://doi.org/10.16719/j.cnki.1671-6981.20180115.CrossRef

Liu, J., Huo, Y., Chen, Y., & Song, P. (2018). Dispositional and experimentally primed attachment security reduced cyber aggression after cyber ostracism. Computers in Human Behavior, 84, 334–341. https://doi.org/10.1016/j.chb.2018.02.040.CrossRef

Lu, H. Y. (2008). Sensation-seeking, İnternet dependency, and online interpersonal deception. Cyber Psychology ve Behavior, 11(2), 227–231. https://doi.org/10.1089/cpb.2007.0053.CrossRef

Menesini, E., Nocentini, A., & Camodeca, M. (2013). Morality, values, traditional bullying, and cyberbullying in adolescence. British Journal of Developmental Psychology, 31(1), 1–14. https://doi.org/10.1111/j.2044-835X.2011.02066.x.CrossRef

Mıhçı, P., & Kılıç Çakmak, E. (2017). Öğrenci siber sağlık ölçekleri geliştirme çalışması. Gazi Eğitim Fakültesi Dergisi, 37(2), 457–491 http://static.dergipark.org.tr/article-download/f4a5/939a/1708/5998229696503.pdf.

Nezlek, J. B., Wesselmann, E. D., Wheeler, L., & Williams, K. D. (2012). Ostracism in everyday life. Group Dynamics: Theory, Research, and Practice, 16(2), 91–104 https://psycnet.apa.org/doi/10.1037/a0028029.CrossRef

Niu, G.-F., Sun, X.-j., Tian, Y., Fan, C.-Y., & Zhou, Z.-K. (2016). Resilience moderates the relationship between ostracism and depression among Chinese adolescents. Personality and Individual Differences, 99, 77–80. https://doi.org/10.1016/j.paid.2016.04.059.CrossRef

Niu, G. F., Zhou, Z. K., Sun, X. J., Yu, F., Xie, X. C., Liu, Q. Q., & Lian, S. L. (2018). Cyber-ostracism and its relation to depression among Chinese adolescents: the moderating role of optimism. Personality and Individual Differences, 123, 105–109. https://doi.org/10.1016/j.paid.2017.10.032.CrossRef

Obar, J. A., & Wildman, S. (2015). Social media definition and the governance challenge: an introduction to the special issue. Telecommunications Policy, 39(9), 745–750 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2663153.CrossRef

O'Keeffe, G. S., & Clarke-Pearson, K. (2011). The impact of social media on children, adolescents, and families. Pediatrics, 127(4), 800–804. https://doi.org/10.1542/peds.2011-0054.CrossRefPubMed

Peker, A. (2015). Ergenlerin saldirganlik ve siber zorbalik davranişlari arasindaki ilişkilerin incelenmesi. Ekev Akademi Dergisi, 61(61), 323–336 https://d1wqtxts1xzle7.cloudfront.net/49909641/.

Poon, K. T. (2019). Do you reap what you sow? The effect of cyberostracism on moral ımpurity. Basic and Applied Social Psychology, 41(2), 132–146. https://doi.org/10.1080/01973533.2019.1585353.CrossRef

Poon, K. T., & Chen, Z. (2016). Assuring a sense of growth: a cognitive strategy to weaken the effect of cyber-ostracism on aggression. Computers in Human Behavior, 57, 31–37. https://doi.org/10.1016/j.chb.2015.12.032.CrossRef

Reich, S., Schneider, F. M., & Heling, L. (2018). Zero likes – Symbolic interactions and need satisfaction online. Computers in Human Behavior, 80, 97–102. https://doi.org/10.1016/j.chb.2017.10.043.CrossRef

Pullant, J. (2001). SPSS survival manual: a step by step guide to data analysis using SPSS for Windows. Philadelphia, PA Open University Pres.

Schneider, S. K., O'donnell, L., Stueve, A., & Coulter, R. W. (2012). Cyberbullying, school bullying, and psychological distress: a regional census of high school students. American Journal of Public Health, 102(1), 171–177. 10.2105%2FAJPH.2011.300308.

Schneider, F. M., Zwillich, B., Bindl, M. J., Hopp, F. R., Reich, S., & Vorderer, P. (2017). Social media ostracism: the effects of being excluded online. Computers in Human Behavior, 73, 385–393. https://doi.org/10.1016/j.chb.2017.03.052.CrossRef

Smock, A. D., Ellison, N. B., Lampe, C., & Wohn, D. Y. (2011). Facebook as a toolkit: a uses and gratification approach to unbundling feature use. Computers in Human Behavior, 27, 322e2329–322e2329. https://doi.org/10.1016/j.chb.2011.07.011.CrossRef

Stark, S., Chernyshenko, O. S., & Drasgow, F. (2006). Detecting differential item functioning with confirmatory factor analysis and item response theory: toward a unified strategy. Journal of Applied Psychology, 91(6), 1292. https://psycnet.apa.org/doi/10.1037/0021-9010.91.6.1292–1306.CrossRef

Sun, S., Rubin, A. M., & Haridakis, P. M. (2008). The role of motivation and media involvement in explaining İnternet dependency. Journal of Broadcasting ve Electronic Media, 52(3), 408–431. https://doi.org/10.1080/08838150802205595.CrossRef

Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston: Pearson Education.

Tobin, S. J., Vanman, E. J., Verreynne, M., & Saeri, A. K. (2015). Threats to belonging on Facebook: lurking and ostracism. Social Influence, 10(1), 31–42. https://doi.org/10.1080/15534510.2014.893924.CrossRef

Turkish Statistical Institute (TÜİK) (2019). Türkiye İstatistik Kurumu, Hanehalkı Bilişim Teknolojileri (BT) Kullanım Araştırması, 2019. http://www.tuik.gov.tr/PreHaberBultenleri.do?id=30574

Van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. https://doi.org/10.1080/17405629.2012.686740.CrossRef

Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002.

Vorderer, P., & Schneider, F. M. (2017). Social media and ostracism. In K. D. Williams & S. A. Nida (Eds.), Ostracism, exclusion, and rejection (pp. 240–257). New York: Psychology Press https://www.researchgate.net/profile/Frank_Schneider/publication/280305731_Social_media_and_ostracism/links/57f7b92c08ae8da3ce590d9a/Social-media-and-ostracism.pdf.

Williams, K. D. (2007). Ostracism. Annual Review of Psychology, 58, 425–452. https://doi.org/10.1146/annurev.psych.58.110405.085641.CrossRefPubMed

Williams, K. D. (2011). The pain of exclusion. Scientific American Mind, 23(6), 30–38 https://www.jstor.org/stable/10.2307/24943221.CrossRef

Williams, K. D., Cheung, C. K. T., & Choi, W. (2000). Cyberostracism: effects of being ignored over the İnternet. Journal of Personality and Social Psychology, 79(5), 748–762. https://doi.org/10.1037//0022-3514.79.5.748.CrossRefPubMed

Williams, K. D., & Zadro, L. (2001). Ostracism: On being ignored, excluded and rejected. In M. R. Leary (Ed.), Interpersonal Rejection (pp. 21–53). New York: Oxford University Press.

Williams, K. D., Govan, C. L., Croker, V., Tynan, D., Cruickshank, M., & Lam, A. (2002). Investigations into differences between social- and cyberostracism. Group Dynamics: Theory, Research, and Practice, 6(1), 65–77. https://doi.org/10.1037/1089-2699.6.1.65.CrossRef

Wolf, W., Levordashka, A., Ruff, J. R., Kraaijeveld, S., Lueckmann, J.-M., & Williams, K. D. (2015). Ostracism Online: a social media ostracism paradigm. Behavior Research Methods, 47(2), 361–373. https://doi.org/10.3758/s13428-014-0475-x.CrossRefPubMed

Wood, M., Bukowski, W., & Lis, E. (2016). The digital self: how social media serves as a setting that shapes youth’s emotional experiences. Adolescent Research Review, 1(2), 163–173. https://doi.org/10.1007/s40894-015-0014-8.CrossRef

Wu, A. D., Zhen, L., & Zumbo, B. D. (2007). Decoding the meaning of factorial invariance and updating the practice of multi-group confirmatory factor analysis: A demonstration with TIMSS data. Practical Assessment, Research, and Evaluation, 12(1), 3. https://scholarworks.umass.edu/cgi/viewcontent.cgi?article=1170&context=pare

Yang, L., Ha, L., Wang, F., & Abuljadail, M. (2015). Who pays for online content? A media dependency perspective comparing young and older people. International Journal on Media Management, 17(4), 277–294. https://doi.org/10.1080/14241277.2015.1107567.CrossRef

Zadro, L., Williams, K. D., & Richardson, R. (2004). How low can you go? Ostracism by a computer is sufficient to lower self-reported levels of belonging, control, self-esteem, and meaningful existence. Journal of Experimental Social Psychology, 40(4), 560–567. https://doi.org/10.1016/j.jesp.2003.11.006.CrossRef

Title: Developing the Cyberostracism Scale and Examining its Psychometric Characteristics
Authors: Osman Hatun
İbrahim Demirci
Publication date: 01-04-2022
Publisher: Springer US
Published in: International Journal of Mental Health and Addiction / Issue 2/2022
Print ISSN: 1557-1874
Electronic ISSN: 1557-1882
DOI: https://doi.org/10.1007/s11469-020-00426-6

At a glance: The STEP trials

Springer Medicine

Developing the Cyberostracism Scale and Examining its Psychometric Characteristics

Abstract

At a glance: The STEP trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 2/2022

Fantasy Football (Soccer) Playing and Internet Addiction Among Online Fantasy Football Participants: A Descriptive Survey Study

The Effectiveness of Emotional Intelligence in the Face of Terrorism Fear and Employees’ Mental Health Strain

Assessing Risk for Smartphone Addiction: Validation of an Arabic Version of the Smartphone Application-Based Addiction Scale

Predicting Limit-Setting Behavior of Gamblers Using Machine Learning Algorithms: A Real-World Study of Norwegian Gamblers Using Account Data

Adaptation and Validation of the Brazilian Version of the Fear of COVID-19 Scale

Predictors of Dropout from an Outpatient Treatment Program for Substance Use Disorders in India: a Retrospective Cohort Study of Patients Registered over a 10-Year Period (2009–2018)