Multimodal Interaction
Multimodal has become commonplace. A "modality" of interaction can best be described as a type of input or output for a system such a speech, touch, gestural, haptic or many more. I designed my first multimodal system in 6.835 and enjoyed the class so much that I am doing course development part time throughout the semester and will be a TA for the course in Spring 2018.
Experience
6.835 Intelligent Mulitmodal User Interfaces
Student and Teaching
Assistant
mug.csail.mit.edu
Projects
AffectAware: Emotion Recognition for Desktop Computer Users
A Firebase powered, Web and iOS based multimodal affect
recognition system for desktop experiments.
ActiveScribe: Affectivley Aware Video Chatting
A multiomodal iPad video chatting app that records conversation,
affective cues and contextual information.
Scribble
An iPad application that let's your record and export raw biometric data from the UITouch class
.
Marriott Hotel Smart Lamp
An interactive concept lamp that would sit in a Marriott Hotel Lobby.