MetaFrame

MetaFrame is a high-level, component-based interaction system in game engines that establishes innovative embodied interaction modalities with the virtual environment. This includes features like distance grab, eye gaze, and gesture pointing, as well as tracked hand gestures with their physics-based interface with virtual objects. Future development includes measurement of user’s behavior pattern during interaction and detection/evaluation of consciousness, subconsciousness, emotions, memory, and behavior predictability.