International Journal of Academic Research in Business and Social Sciences

search-icon

Multimodal Digital Classroom Assessments for ESL Learners and Teachers

Open access
The pandemic has brought a different setting for teaching and learning, especially in the higher education context. Although multimodal and digital modes of representation are frequently used beyond the educational context, assessments for learners focus on traditional print media and less on digital technology. If teachers aim to use digital technologies in the classroom effectively, a stronger nexus is needed between the use of information communication technology in universities, contextual aspects, and theoretical approaches. This study examined multimodal digital classroom assessments (MDCAs) as a subset of classroom assessments. This study also investigated three examples of MDCAs created in conjunction with learners as a part of a formative experiment by combining multimodal perspectives with performance assessment theory and considering their affordances and possible usefulness for practice. The MDCAs might provide learners and teachers with various teaching modes. Nevertheless, implementing MDCAs needs ongoing consideration of validity, literacy demands, and longitudinal character management of some MDCAs. Therefore, teachers should consider how evidence from MDCAs complements traditional assessment approaches in designing meaningful learning processes for learners.
Acquah, E. O., & Katz, S. (2020). Digital games in L2 teaching and learning: An empirical review of research trends between 2005 and 2018. Language Teaching Research, 24(3), 316-340. doi:10.1177/1362168819884123
Alvermann, D. E., Hagood, M. C., & Lam, W. S. E. (2005). Critical media literacy: research, theory, and pedagogy in "new times". The Journal of Educational Research, 98(1), 67-79.
Andrade, H., Du, Y., & Wang, X. (2009). Putting rubrics to the test: The effect of a model, criteria generation, and rubric-referenced self-assessment on elementary school students’ writing. Educational Measurement: Issues and Practice, 28(2), 3-13.
Andrews, J., Henderson, M., Sheridan, A., & Bickmore, K. (2020). Social justice and English language arts teacher education: Navigating the terrain. Journal of Language and Literacy Education, 16(2), 1-17.
Aschbacher, P. R. (1991). Performance assessment: A challenge for the 1990s. Educational Researcher, 20(8), 15-22.
Beach, R., & O'Brien, D. G. (2018). Multimodal composition and the common core state standards. Routledge.
Bezemer, J., & Kress, G. (2016). Multimodality, learning and communication: A social semiotic frame. Routledge.
Black, P., Harrison, C., Lee, C., Marshall, B., & Wiliam, D. (2010). Working inside the black box: Assessment for learning in the classroom. Phi Delta Kappan, 92(1), 81-90.
Borko, H., Liston, D., & Whitcomb, J. (1997). Genres of research in teacher education: A review of the past decade. Review of Educational Research, 67(2), 129-169.
Bradley, B. A., & Reinking, D. (2011). Literacy assessment in the digital age. Reading Research Quarterly, 46(4), 339-345.
Brown, G. T. (2017). Assessment literacy: The foundation for improving student learning. Oxford Research Encyclopedia of Education.
https://doi.org/10.1093/acrefore/9780190264093.013.81
Burke, A., & Hammett, R. (2009). Multimodal literacy: A challenge for English language arts teachers. Journal of Adolescent & Adult Literacy, 52(2), 96-107.
Chandler-Olcott, K., & Mahar, D. (2004). Adolescents' online literacy practices: A first look. Journal of Adolescent & Adult Literacy, 48(2), 86-93.
Cope, B., & Kalantzis, M. (2009). "Multiliteracies": New literacies, new learning. Pedagogies: An International Journal, 4(3), 164-195. doi:10.1080/15544800903076044
Cope, B., & Kalantzis, M. (2021). Multimodal teaching and learning: The changing landscape of education. Routledge.
Crooks, T. J. (2011). The validity of formative assessments. Practical Assessment, Research & Evaluation, 16(1), 1-9.
Crooks, T., Kane, M., & Cohen, A. (1996). Validity. In N. Frederiksen, R. J. Mislevy, & I. I. Bejar (Eds.), Test theory for a new generation of tests (pp. 13-29). Lawrence Erlbaum Associates.
Davis, K. A., & Yancey, K. B. (2014). Assessing multimodal texts: Continuing challenges and new directions. College Composition and Communication, 65(2), 243-265.
de Souza, L. M. (2017). Multimodal discourse analysis in literacy studies: What, why, and how? Literacy Research: Theory, Method, and Practice, 66(1), 63-78.
de Souza, L. M. (2019). Language, literacy, and social justice: A Brazilian perspective. Routledge.
Douka, S., Pange, J., & Karalis, T. (2017). Multimodal analysis of fake news: From linguistic to semiotic representation. Journal of Language Aggression and Conflict, 5(1), 22-48.
Fifitnova, G., Liao, X., & Yan, C. (2022). Designing multimodal learning for teaching and learning: A case study of a Chinese as a second language course. Australasian Journal of Educational Technology, 38(1), 1-14. doi:10.14742/ajet.7329
Gamlem, S. M., & Smith, M. C. (2013). Student feedback in formative assessment: What do students say? Educational Assessment, Evaluation and Accountability, 25(3), 209-223.
George, R. (2002). Multimodality in practice: Investigating theory-in-use in a primary school classroom. Australian Journal of Language and Literacy, 25(3), 24-42.
Greenhow, C., Robelia, B., & Hughes, J. E. (2009). Learning, teaching, and scholarship in a digital age: Web 2.0 and classroom research: What path should we take now? Educational Researcher, 38(4), 246-259. doi:10.3102/0013189x09336671
Haßler, B., Major, L., & Hennessy, S. (2016). Tablet use in schools: A critical review of the evidence for learning outcomes. Journal of Computer Assisted Learning, 32(2), 139-156. doi:10.1111/jcal.12123
Hennessy, S. (2016). Information and communication technology in primary schools. Oxford Research Encyclopedia of Education.
doi:10.1093/acrefore/9780190264093.013.99
Hughes, J. E. (2009). The role of teacher knowledge and learning experiences in forming technology-integrated pedagogy. Journal of Technology and Teacher Education, 17(4), 479-503.
Hundley, M., & Holbrook, T. (2013). Digital texts and the future of education. Educational Researcher, 42(2), 95-98.
Jewitt, C. (2003). An introduction to multimodality. In C. Jewitt (Ed.), The Routledge Handbook of Multimodal Analysis (pp. 1-14). Routledge.
Jewitt, C. (2014). An Introduction to Multimodality: Social Semiotics, Routledge.
Jewitt, C., Bezemer, J., & O'Halloran, K. (Eds.). (2016). Introducing multimodality. Routledge.
Johnson, E., & Kress, G. (2003). Introduction. In E. Johnson & G. Kress (Eds.), Reading images: Meaning and mind (pp. 1–14). Routledge.
Johnson, E., & Kress, G. (2010). Multimodal literacy. New York: Peter Lang.
Johnson, K. E. (2003). Designing language teaching tasks. Palgrave Macmillan.
Johnson, K., & Kress, G. (2003). Introduction. In K. Johnson & G. Kress (Eds.), Teachers' Handbook of Multimodal Grammar: Teaching Grammar with Audiovisual Technology (pp. 1-4). Continuum.
Johnson, K., & Kress, G. (2003). Persuasive designs for learning: The semiotics of desire. Educational Review, 55(1), 47-64.
Kalantzis, M., & Cope, B. (2010). Multiliteracies: New literacies, new learning. Pedagogies: An International Journal, 5(3), 164-195. doi:10.1080/15544801003702572
Kalantzis, M., Cope, B., Chan, E., & Dalley-Trim, L. (2003). Literacies as multimodal design. In G. Bull & M. Anstey (Eds.), The Literacy Lexicon (2nd ed., pp. 61-82). Australian Literacy Educators' Association.
Kelchtermans, G. (2015). Professional development and policy: A need for conceptual clarity. Educational Policy, 29(5), 682-697.
Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Routledge.
Kress, G., & Selander, S. (2012). Multimodal design, learning and cultures of recognition. Springer.
Kress, G., & Van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. Arnold.
Leu, D. J. (2002). The new literacies: Research on reading instruction with the Internet and other digital technologies. In S.
Leu, D. J., Forzani, E., Rhoads, C., Maykel, C., Kennedy, C., & Timbrell, N. (2016). The new literacies of online research and comprehension: Rethinking the reading achievement gap. Reading Research Quarterly, 51(4), 339-356.
Leu, D. J., Forzani, E., Timbrell, N., & Maykel, C. (2016). Seeing the forest, not just the trees: Essential practices for effective literacy coaching. The Reading Teacher, 70(2), 189-193.
Lim, F. V., Genc, B., & Lotherington, H. (2021). Multimodal Pedagogies in Higher Education: Teaching and Learning in Multimodal Environments. Routledge.
Messick, S. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher, 23(2), 13-23.
Mizusawa, H., & Kiss, T. (2020). Multicultural education in Japan: A transformative approach. Journal of Education and Practice, 11(20), 1-11.
Morita-Mullaney, T. (2021). Developing multimodal literacy through online media: A case study of a Japanese high school. In D. M. Kellner & J. D. G. Wiebe (Eds.), Multimodal approaches to literacy research and pedagogy: A critical perspective (pp. 41-60). Routledge.
Moss, P. A. (2013). Reconceptualizing validity for classroom assessment. Educational Measurement: Issues and Practice, 32(4), 13-25.
Moss, P. A. (2013). The uses of evidence in testing policy. In T. K. Fung & R. K. Wagner (Eds.), Educational measurement (pp. 19-47). Springer.
New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 60-92.
Norris, S. P. (2011). Multimodal Learning and Education. In The SAGE Handbook of Multimodal Discourse Analysis (pp. 313-326). SAGE Publications Ltd.
O’Brien, D., & Bauer, M. (2005). Digital divides and the ‘disappearing’ computer in language learning. Language Learning & Technology, 9(3), 3-16.
Palm, T. (2008). The logic of assessment discourse. Assessment & Evaluation in Higher Education, 33(6), 669-680.
Palsa, J., & Mertala, P. (2019). Transcultural competence in foreign language teaching: Definitions and approaches. Journal of Language Teaching and Research, 10(6), 1201-1208.
Parkes, J. (2013). Professional judgement and the assessment of learning. Assessment in Education: Principles, Policy & Practice, 20(2), 123-141.
Silseth, K., & Gilje, Ø. (2017). Digital literacy as a tool for active citizenship in a globalised world: The challenges of unequal access to technology. European Journal of Teacher Education, 40(4), 408-423.
Silseth, K., & Gilje, Ø. (2017). Multimodality, learning and communication. Routledge.
Smith, J. (2016). Backward design for forward action. The Reading Teacher, 70(3), 267-271.
Stam, G., & McCafferty, S. G. (2008). Deictic Gestures and Discourse Pragmatic Functions. Journal of Pragmatics, 40(1), 3-24. doi: 10.1016/j.pragma.2007.10.001
Stobart, G. (2008). Testing times: The uses and abuses of assessment. Routledge.
Twining, P., Raffaghelli, J., Albion, P., & Knezek, G. (2017). Moving education into the digital age: The contribution of teachers' professional development. Journal of Computer Assisted Learning, 33(5), 466-476.
van Leeuwen, T. (2017). Multimodal critical discourse studies. In R. Wodak & M. Meyer (Eds.), Methods of critical discourse studies (3rd ed., pp. 141-159). Sage.
Weninger, C. (2019). Multimodal text analysis in the study of fake news. In C. Wijesinghe & V. Ciccone (Eds.), Understanding language and literacy education: Diversity, equity and power (pp. 119-137). Routledge.
Wiggins, G. (1998). Educative assessment: Designing assessments to inform and improve student performance. Jossey-Bass.
Willam, D. (2011). Embedded formative assessment. Solution Tree.
Xu, X., & Brown, G. T. L. (2016). A systematic review of student self-assessment in teacher education. Assessment & Evaluation in Higher Education, 41(5), 737-777.