Key themes include embodied cognition, gesture and sign in language development, cross-cultural variation in communication, and the analysis and annotation of multimodal corpora. The course also addresses how AI-systems process multimodal input (speech, sign, gesture), alongside critical discussions of accessibility, bias, and ethical challenges.

Drawing on linguistics, psychology, cognitive science, and AI, the course positions multimodal communication at the intersection of human language and emerging technologies. Students will engage with real-world case studies, including everyday interaction, sign recognition technologies, and inclusive design practices. Through individual and group work, students will analyze multimodal data, critically evaluate current technologies, and reflect on their societal impact. The course culminates in the development of a concept for an inclusive multimodal communication tool.

Coordinator

Dr. Beyza Sümer

Timetable

All lectures will take place on-campus and we assume you can be physically present during the scheduled hours. You can find the timetable on Datanose.

Course registration

Registration is possible for students participating in an Honours program. The registration period for the Honours courses will be from Thursday, June 4, 10:00 am to Tuesday, June 9, 11:59 pm. You can register through the online registration form that will appear on Honoursmodules IIS. (registration is NOT through SIS)

Please note: Placement is not guaranteed if you register after June 9, so make sure you register on time. You will hear which course(s) you are registered for before the end of June 

For questions about registration, please contact us at: Honours-iis@uva.nl.