Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Indian Institute of Technology Madras

Multimodal Interaction

Indian Institute of Technology Madras and NPTEL via Swayam

This course may be unavailable.

Overview

In this course we will set the basics for an understanding of multimodal communication between humans and multimodal interaction between humans and machines. We will start with clarifying the basic principles of human-human communication and human-machine interaction. We will then describe the processes taking place in humans when perceiving auditory, visual and tactile signals, as well as how these perceptions are integrated in order to form a multimodal perception. The signals can be generated and received by machines which are able to interact with humans in limited domains. The set-up of such machines will be discussed, and limitations as well as potential solutions to overcome these limitations will be explained.

Syllabus

Week 1  :  Multimedia and Multimodality; Hearing and Speech; Vision
Week 2  :   Other Senses, Integration and Cognition; Multimodal Perception; Human Multimodal Interaction
Week 3  : Multimodal Input and Output Systems 
Week 4  :  Multimodal Interactive Systems, Virtual Environments

Taught by

Prof. Dr.-Ing.Sebastian Moller & Dr.-Ing. Stefan Hillmann

Reviews

Start your review of Multimodal Interaction

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.