Skip to main content
Top
Published in: Annals of Dyslexia 1/2021

01-04-2021 | Dyslexia

The influence of the multimedia and modality principles on the learning outcomes, satisfaction, and mental effort of college students with and without dyslexia

Authors: Kara Dawson, Jiawen Zhu, Albert D. Ritzhaupt, Pavlo Antonenko, Kendra Saunders, Jiahui Wang, Linda Lombardino

Published in: Annals of Dyslexia | Issue 1/2021

Login to get access

Abstract

The purpose of this study was to examine the application of the multimedia and modality principles on cued-recall, recognition, and mental effort of college students with and without dyslexia. The study used a Multimedia (Image Present vs. Image Absent) × Modality (Narration vs. Onscreen Text) × Dyslexia (Dyslexia vs. Non-Dyslexia) 3-way factorial design with each independent variable serving as a between-subject condition. A total of N = 148 participants (73 with dyslexia and 75 without dyslexia) were recruited from five different institutions of higher education in the Southeastern United States and systematically assigned to one of four multimedia learning conditions. After assessing our data for statistical assumptions, we employed factorial Analysis of Variance (ANOVA) models on each dependent measure. Our findings show a reverse modality effect for students with dyslexia who performed better than their peers without dyslexia in Onscreen Text conditions. Although performance was better across groups and conditions when images were present, there were no significant interactions related to the multimedia condition. Similarly, there were no significant interactions related to mental effort even though learners with dyslexia exhibited high instructional efficiency in the Onscreen Text-Image Present condition while learners without dyslexia exhibited low task involvement in the Onscreen Text-Image Absent condition. Our results provide theoretical implications and important avenues for future research and practice as related to how multimedia learning influences students with dyslexia. We also suggest studies that could inform the eventual design of adaptive and personalized multimedia learning solutions for learners with dyslexia.
Literature
go back to reference Aleven, V., McLaughlin, E. A., Glenn, R. A., & Koedinger, K. R. (2017). Instruction based on adaptive learning technologies. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of Research on Learning and Instruction (2nd ed., pp. 522–560). New York, NY: Routledge. Aleven, V., McLaughlin, E. A., Glenn, R. A., & Koedinger, K. R. (2017). Instruction based on adaptive learning technologies. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of Research on Learning and Instruction (2nd ed., pp. 522–560). New York, NY: Routledge.
go back to reference Baddeley, A. D. (1998). Human memory: Theory and practice. Boston, MA: Allyn and Bacon. Baddeley, A. D. (1998). Human memory: Theory and practice. Boston, MA: Allyn and Bacon.
go back to reference Baddeley, A. D., & Hitch, G. (1974). Working memory. Psychology of Learning and Motivation, 8, 47–89.CrossRef Baddeley, A. D., & Hitch, G. (1974). Working memory. Psychology of Learning and Motivation, 8, 47–89.CrossRef
go back to reference Barron, A. E. (2004). Auditory instruction. In D. H. Jonassen (Ed.), Handbook of Research on Educational Communications and Technology (pp. 949–978). Lawrence Erlbaum. Barron, A. E. (2004). Auditory instruction. In D. H. Jonassen (Ed.), Handbook of Research on Educational Communications and Technology (pp. 949–978). Lawrence Erlbaum.
go back to reference Brante, E. W., & Holmqvist, M. (2017). Reading from multimedia materials: Benefits of non-congruent pictures on reading comprehension for dyslexia readers. The Turkish Online Journal of Educational Technology, 1, 16. Brante, E. W., & Holmqvist, M. (2017). Reading from multimedia materials: Benefits of non-congruent pictures on reading comprehension for dyslexia readers. The Turkish Online Journal of Educational Technology, 1, 16.
go back to reference Butcher, K. R. (2014). The multimedia principle. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning, 2nd Edition (pp.174-205). Cambridge University Press. Butcher, K. R. (2014). The multimedia principle. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning, 2nd Edition (pp.174-205). Cambridge University Press.
go back to reference Cowan, N. (2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and brain sciences, 24(1), 87–114.CrossRef Cowan, N. (2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and brain sciences, 24(1), 87–114.CrossRef
go back to reference Flesch, R. (1949). The art of readable writing. New York: Harper. Flesch, R. (1949). The art of readable writing. New York: Harper.
go back to reference Gillingham, A., & Stillman, B. (1956). Remedial training for children with specific disability in reading, spelling and penmanship (5th ed.). Cambridge: Educators Publishing Service. Gillingham, A., & Stillman, B. (1956). Remedial training for children with specific disability in reading, spelling and penmanship (5th ed.). Cambridge: Educators Publishing Service.
go back to reference Grigorenko, E. L., Compton, D. L., Fuchs, L. S., Wagner, R. K., Willcutt, E. G., & Fletcher, J. M. (2020). Understanding, educating, and supporting children with specific learning disabilities: 50 years of science and practice. American Psychologist, 75(1), 37–51. https://doi.org/10.1037/amp0000452.CrossRef Grigorenko, E. L., Compton, D. L., Fuchs, L. S., Wagner, R. K., Willcutt, E. G., & Fletcher, J. M. (2020). Understanding, educating, and supporting children with specific learning disabilities: 50 years of science and practice. American Psychologist, 75(1), 37–51. https://​doi.​org/​10.​1037/​amp0000452.CrossRef
go back to reference Hinshelwood, J. (1909). Four cases of congenital word-blindness occurring in the same family. British Medical Journal, 2, 1229–1232. Hinshelwood, J. (1909). Four cases of congenital word-blindness occurring in the same family. British Medical Journal, 2, 1229–1232.
go back to reference Houbart, J. C., Quiniou, S., Berthaut, M., Daille, B., & Salomé, C. (2019). Automatic segmentation of texts into units of meaning for reading assistance. arXiv preprint arXiv, 1910.05014. Houbart, J. C., Quiniou, S., Berthaut, M., Daille, B., & Salomé, C. (2019). Automatic segmentation of texts into units of meaning for reading assistance. arXiv preprint arXiv, 1910.05014.
go back to reference Jordan, A. (2019). How technology supports empowerment, equality, and efficiency: Voices of students with dyslexia. Unpublished doctoral dissertation. University of Florida. Jordan, A. (2019). How technology supports empowerment, equality, and efficiency: Voices of students with dyslexia. Unpublished doctoral dissertation. University of Florida.
go back to reference Kennedy, M. J., & Boyle, J. R. (2017). The promise and problem with technology in special education: Implications for academic learning. In J. M. Kauffman, D. P. Hallahan, & P. C. Pullen (Eds.), The handbook of special education (pp. 606–614). New York, NY: Routledge.CrossRef Kennedy, M. J., & Boyle, J. R. (2017). The promise and problem with technology in special education: Implications for academic learning. In J. M. Kauffman, D. P. Hallahan, & P. C. Pullen (Eds.), The handbook of special education (pp. 606–614). New York, NY: Routledge.CrossRef
go back to reference Kim, S., Wiseheart, R., & Walden, P. (2018). Do multimedia instructional designs enhance learning in college students with dyslexia? Journal of Postsecondary Education and Disability, 31(4), 351–365. Kim, S., Wiseheart, R., & Walden, P. (2018). Do multimedia instructional designs enhance learning in college students with dyslexia? Journal of Postsecondary Education and Disability, 31(4), 351–365.
go back to reference Lombardino, L. (2012). Assessing and differentiating reading and writing disorders: multidimensional model. New York, NY: Delmar/Cengage Learning. Lombardino, L. (2012). Assessing and differentiating reading and writing disorders: multidimensional model. New York, NY: Delmar/Cengage Learning.
go back to reference Low, R., & Sweller, J. (2014). The modality principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning, 2nd Edition (pp.227-246). Cambridge University Press. Low, R., & Sweller, J. (2014). The modality principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning, 2nd Edition (pp.227-246). Cambridge University Press.
go back to reference Mayer, R. E. (2009). Multimedia learning (2nd ed.). New York, NY: Cambridge University Press.CrossRef Mayer, R. E. (2009). Multimedia learning (2nd ed.). New York, NY: Cambridge University Press.CrossRef
go back to reference Mayer, R. E. (2014). Cognitive theory of multimedia learning. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (pp. 43–71). Cambridge, MA: Cambridge University Press.CrossRef Mayer, R. E. (2014). Cognitive theory of multimedia learning. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (pp. 43–71). Cambridge, MA: Cambridge University Press.CrossRef
go back to reference Mayer, R. E., & Moreno, R. (1998). A cognitive theory of multimedia learning: Implications for design principles. Journal of educational psychology, 91(2), 358–368. Mayer, R. E., & Moreno, R. (1998). A cognitive theory of multimedia learning: Implications for design principles. Journal of educational psychology, 91(2), 358–368.
go back to reference Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52.CrossRef Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52.CrossRef
go back to reference Orton, S. T. (1925). “Word blindness” in school children. Archives of Neurology and Psychiatry, 14, 581–613.CrossRef Orton, S. T. (1925). “Word blindness” in school children. Archives of Neurology and Psychiatry, 14, 581–613.CrossRef
go back to reference Paas, F., Tuovinen, J. E., Van Merrienboer, J. J., & Darabi, A. A. (2005). A motivational perspective on the relation between mental effort and performance: Optimizing learner involvement in instruction. Educational Technology Research and Development, 53(3), 25–34. https://doi.org/10.1007/BF02504795.CrossRef Paas, F., Tuovinen, J. E., Van Merrienboer, J. J., & Darabi, A. A. (2005). A motivational perspective on the relation between mental effort and performance: Optimizing learner involvement in instruction. Educational Technology Research and Development, 53(3), 25–34. https://​doi.​org/​10.​1007/​BF02504795.CrossRef
go back to reference Paivio, A. (1986). Mental representation: A dual coding approach. New York, NY: Oxford University Press. Paivio, A. (1986). Mental representation: A dual coding approach. New York, NY: Oxford University Press.
go back to reference Paivio, A. (1991). Images in mind: the evolution of a theory. Harvester Wheatsheaf. Paivio, A. (1991). Images in mind: the evolution of a theory. Harvester Wheatsheaf.
go back to reference Ritzhaupt, A. D., Gomes, N. D., & Barron, A. E. (2008). The effects of time-compressed audio and verbal redundancy on learner performance and satisfaction. Computers in Human Behavior, 24(5), 2434–2445.CrossRef Ritzhaupt, A. D., Gomes, N. D., & Barron, A. E. (2008). The effects of time-compressed audio and verbal redundancy on learner performance and satisfaction. Computers in Human Behavior, 24(5), 2434–2445.CrossRef
go back to reference Ritzhaupt, A. D., Barron, A. E., & Kealy, W. A. (2011). Conjoint processing of time-compressed narration in multimedia instruction: The effects on recall, but not recognition. Journal of Educational Computing Research, 44(2), 203–221.CrossRef Ritzhaupt, A. D., Barron, A. E., & Kealy, W. A. (2011). Conjoint processing of time-compressed narration in multimedia instruction: The effects on recall, but not recognition. Journal of Educational Computing Research, 44(2), 203–221.CrossRef
go back to reference Rodriguez, M., & Albano, A. (2017). The College Instructor’s Guide to Writing Test Items: Measuring Student Learning. Taylor & Francis. Rodriguez, M., & Albano, A. (2017). The College Instructor’s Guide to Writing Test Items: Measuring Student Learning. Taylor & Francis.
go back to reference Rose, D. H., Johnston, S. C., & Vanden Boogart, A. E. (2013). Theme editors’ introduction. Perspectives on Language and Literacy, 39(4), 7–10. Rose, D. H., Johnston, S. C., & Vanden Boogart, A. E. (2013). Theme editors’ introduction. Perspectives on Language and Literacy, 39(4), 7–10.
go back to reference Scheiter, K., Schubert, C., & Schüler, A. (2018). Self-regulated learning from illustrated text: Eye movement modeling to support use and regulation of cognitive processes during learning from multimedia. British Journal of Educational Psychology, 88, 80–94. https://doi.org/10.1111/bjep.12175.CrossRef Scheiter, K., Schubert, C., & Schüler, A. (2018). Self-regulated learning from illustrated text: Eye movement modeling to support use and regulation of cognitive processes during learning from multimedia. British Journal of Educational Psychology, 88, 80–94. https://​doi.​org/​10.​1111/​bjep.​12175.CrossRef
go back to reference Schrank, F. A., McGrew, K. S., Mather, N., Wendling, B. J., & LaForte, E. M. (2014). Woodcock-Johnson IV tests of cognitive abilities. Riverside. Schrank, F. A., McGrew, K. S., Mather, N., Wendling, B. J., & LaForte, E. M. (2014). Woodcock-Johnson IV tests of cognitive abilities. Riverside.
go back to reference Shaywitz, S. (2008). Overcoming dyslexia: A new and complete science-based program for reading problems at any level. New York, NY: Random House. Shaywitz, S. (2008). Overcoming dyslexia: A new and complete science-based program for reading problems at any level. New York, NY: Random House.
go back to reference Torgesen, J. K., Wagner, R., & Rashotte, C. (2012). Test of Word Reading Efficiency:(TOWRE-2). Pearson Clinical Assessment. Torgesen, J. K., Wagner, R., & Rashotte, C. (2012). Test of Word Reading Efficiency:(TOWRE-2). Pearson Clinical Assessment.
go back to reference Van Gog, T., & Paas, F. (2008). Instructional efficiency: Revisiting the original construct in educational research. Educational psychologist, 43(1), 16–26.CrossRef Van Gog, T., & Paas, F. (2008). Instructional efficiency: Revisiting the original construct in educational research. Educational psychologist, 43(1), 16–26.CrossRef
go back to reference Wagner, R. K., Torgesen, J. K., Rashotte, C. A., & Pearson, N. A. (1999). Comprehensive test of phonological processing: CTOPP. Austin, TX: Pro-ed. Wagner, R. K., Torgesen, J. K., Rashotte, C. A., & Pearson, N. A. (1999). Comprehensive test of phonological processing: CTOPP. Austin, TX: Pro-ed.
go back to reference Wang, J., Dawson, K., Saunders, K., Ritzhaupt, A. D., Antonenko, P. P., Lombardino, L., et al. (2018). Investigating the effects of modality and multimedia on the learning performance of college students with dyslexia. Journal of Special Education Technology, 33(3), 182–193.CrossRef Wang, J., Dawson, K., Saunders, K., Ritzhaupt, A. D., Antonenko, P. P., Lombardino, L., et al. (2018). Investigating the effects of modality and multimedia on the learning performance of college students with dyslexia. Journal of Special Education Technology, 33(3), 182–193.CrossRef
go back to reference Wiley, J., Sanchez, C. A., & Jaeger, A. J. (2014). The individual differences in working memory capacity principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (pp. 615–636). Cambridge, UK: Cambridge University Press. Wiley, J., Sanchez, C. A., & Jaeger, A. J. (2014). The individual differences in working memory capacity principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (pp. 615–636). Cambridge, UK: Cambridge University Press.
go back to reference Wilson, B. A., & Oxford, M. A. (2015). Testimony before the U.S. House of Representatives Committee on Science, Space, and Technology. Wilson, B. A., & Oxford, M. A. (2015). Testimony before the U.S. House of Representatives Committee on Science, Space, and Technology.
go back to reference Youman, M., & Mather, N. (2013). Dyslexia laws in the USA. Annals of Dyslexia, 63(2), 133–153.CrossRef Youman, M., & Mather, N. (2013). Dyslexia laws in the USA. Annals of Dyslexia, 63(2), 133–153.CrossRef
go back to reference Zhu, J., Dawson, K., Ritzhaupt, A. D., & Antonenko, P. (2020). Investigating how multimedia and modality design principles influence student learning performance, satisfaction, mental effort, and visual attention. Journal of Educational Multimedia and Hypermedia, 29(3), 265–284. Zhu, J., Dawson, K., Ritzhaupt, A. D., & Antonenko, P. (2020). Investigating how multimedia and modality design principles influence student learning performance, satisfaction, mental effort, and visual attention. Journal of Educational Multimedia and Hypermedia, 29(3), 265–284.
Metadata
Title
The influence of the multimedia and modality principles on the learning outcomes, satisfaction, and mental effort of college students with and without dyslexia
Authors
Kara Dawson
Jiawen Zhu
Albert D. Ritzhaupt
Pavlo Antonenko
Kendra Saunders
Jiahui Wang
Linda Lombardino
Publication date
01-04-2021
Publisher
Springer US
Keyword
Dyslexia
Published in
Annals of Dyslexia / Issue 1/2021
Print ISSN: 0736-9387
Electronic ISSN: 1934-7243
DOI
https://doi.org/10.1007/s11881-021-00219-z

Other articles of this Issue 1/2021

Annals of Dyslexia 1/2021 Go to the issue