Language in Digital Motion: From ABCs to Intermediality and Why This Matters for Language Learning

Abstract

Linguistic communication has moved beyond simple alphabetic encoding to multimedia design, challenging the fit of structural theories of language to digital communication. This transition is barely evident in mobile language learning contexts where top-selling apps present language as a linguistic structure to be drilled, ironically bypassing the complex communicative potential of smart devices. This chapter overviews changing language norms from language as structure to language within multimodality and comparatively discusses multimodality from a social semiotics paradigm nested in linguistic theory and from Elleström’s intermediality paradigm. To illustrate how one could conceptualize multimodality from a perspective decentred from linguistics and leveraged to explain language use in multimedia contexts, the author examines two novel features of digital communication: emoji and conversational digital agents.