"Multimodal interaction in virtual environments", 4ECTS course. http://multimodalinteraction.wordpress.com/
This 4-ECTS course provides an overview of multimodal interaction techniques for virtual environments. We start with an overview of multimodal perception to explain how humans behave in virtual environments where incomplete and impoverished sensory cues are reproduced. We then present an overview of technologies for visual-haptic-audio feedback in virtual environments, together with sensing technologies based on capacitive sensing and optical motion capture. We discuss issues of integration of technologies, and we describe algorithms for recognizing input data as well as simulating feedback based on physics modelling. We then introduce evaluation techniques for multimodal environments. The course extends for 4 ECTS, divided into 2 ECTS of lectures and 2 ECTS of mini-project. Content: Introduction to multimodal interaction in virtual environments: perceptual illusions, sensory substitution, and multimodal enhancement. -Visual feedback: screen, projectors, head-mounted display -Auditory feedback: surround sound, headphones -Technologies for haptic feedback -Physics based algorithms for audio-haptic feedback -Sensing and tracking technologies (capacitive sensors, optical motion capture) -Integration of technologies .Evaluation of multimodal interfaces
For more information please contact : Associate professor Stefania Serafin,
Aalborg University Copenhagen, sts (at) media.aau.dk
