ATS3325 Multimodal communication and cognition

Do we gesture differently when we are speaking with friends than with our boss or clients in a professional situation? Do speakers of different languages and with different cultural backgrounds gesture differently? How is gesturing distinct from signed languages? Why do some webpages seem all clear and other utterly confusing? In this unit we investigate the multimodal nature of language and its implication for cognition. Multimodality characterizes any kind of communicative practice that draws on linguistic, aural, textual, spatial and visual resources to compose messages. We consider the interaction of spoken language and speech-accompanying gesture, digital multimodality, the nature of signed languages multimodality in Aboriginal Australia, and the role of gesture and joint attention in child language acquisition, among other topics. We investigate cultural and linguistic differences in the domain of multimodality and the methodologies which are employed to study multimodal communication.

You will use this knowledge to design a research proposal for analysing multimodal data and to describe the role and nature of multimodality in communication.