ActiveScribe: Intelligent Multimodal Video Chatting

William Caruso | 6.835 Final Project

Spring 2017


  • Affectiva Affdex
  • Twilio
  • Firebase


ActiveScribe is an intelligent multimodal video chatting application for iOS that transcribes a conversation into a message-like format, keeping track of what user say, records emotional ques, and lets users share sketches in real time. In addition, ActiveScribe records meta information about the call, including the location of each user, weather conditions, datetime, etc. During the call, all of the information is available in a detailed message-like dialogue of the conversation which persists for retrieval and analysis later. ActiveScribe works best on iPad but is compatible with iPhone and iPod Touch.

System Diagram


Please contact me for a demo.