Multimodal Tools
Multisense is a perception framework that enables multiple sensing and understanding modules to inter-operate simultaneously, broadcasting data through the Perception Markup Language. MultiSense currently contains GAVAM, CLM FaceTracker and FAAST which can be used with a webcam or Kinect. The Toolkit provides an example of how to use the MultiSense framework (also known as multimodal framework, developed by Multicomp Lab).MultiSense uses these technologies:
- CLM (developed by Jason Saragih et .al)
- Gavam face-tracker (developed by Louis-Philippe Morency‘s Multicomp Lab)
- Kinect
- FAAST (developed by Mixed Reality Group)
- ssi Library (developed by Johannes Wagner, University of Augsburg).