Market Intelligence: -VR/AR Suppliers

Vrgineers and ManoMotion are set to unveil an innovative breakthrough in pilot training at the AWE USA 2023 event in Santa Clara, CA. This groundbreaking development introduces an AI hand-tracking algorithm designed to enhance the immersive experience of pilot training scenarios in virtual and mixed reality environments. The remarkable feature, exclusive to XTAL Mixed Reality headsets, enables real-time hand-tracking functionality specifically optimized for cockpit settings.

The key differentiator of this solution lies in its integration of pass-through RGB cameras and an advanced AI algorithm. By harnessing this unique combination, the new hand visualization algorithm effectively eliminates the background and allows for a focused display of the hands within virtual environments. Using the RGB camera stream, ManoMotion leverages this data to visualize the hands in both virtual reality (VR) and mixed reality (MR) simulations. It is important to note that this development was directly tailored to meet the specific requirements of Vrgineers’ pilot cockpit tracking needs.

The overarching goal of the mixed reality cockpit hand tracking project is to create a proof-of-concept, AI-driven hand visualization functionality for pilot cockpit training. By utilizing the real-time RGB camera stream, the system detects and isolates the pilot’s hands, seamlessly overlaying them onto the virtual reality scene. The development process involved the collaboration of Vrgineers and ManoMotion, who worked together to gather training data in the form of video feeds capturing users interacting with aircraft cockpit instrument panels. Subsequently, the real-time data stream undergoes processing, leveraging a pre-trained hand-tracking model to separate the hands from the live video stream and render them in a visual representation.

“We are thrilled about our cooperation with Vrgineers,” says Lars Österberg, CEO of ManoMotion, and adds: “Enabling pilots to see and interact with their real hands in VR helps make the cockpit pilot training solution even more immersive.”

This pioneering integration of AI hand-tracking technology and the cockpit environment marks a significant advancement in the field of pilot training. The resulting immersive experience offers enhanced realism and interactivity, further bridging the gap between virtual simulations and real-world applications. Vrgineers and ManoMotion’s collaboration exemplifies their dedication to pushing the boundaries of technological innovation and their commitment to meeting the specific needs of pilot training in today’s rapidly evolving landscape.

“As a virtual and mixed reality simulation specialist, we always try to find new innovative ways to increase the immersion of our solutions. Vrgineers was the first company to fully integrate infrared hand-tracking into a virtual reality headset. And now, together with ManoMotion AI recognition using visible light, we are doing the same for the mixed reality,” says Marek Polcak, CEO of Vrgineers, and adds: “By supporting both technologies, we can combine their strengths to deliver the very best existing hand-tracking available in any headset on the market.”

About Vrgineers

Vrgineers is a leader in developing immersive technologies and offers the highest-quality and most effective training for military pilots with the most advanced XTAL VR and MR headsets and aviation simulators, that form the basis of a modern synthetic training platform. Thanks to the possibility of interconnection, it is possible to train not only pilots but also the cooperation of a pilot with a co-pilot, a gunner with a pilot, JTAC instructors, and the coordination of entire squadrons. Vrgineers simulators support both Western and Eastern aviation platforms, from propeller-driven to subsonic to supersonic aircraft and helicopters. The XTAL headset is developed based on the priorities of professional pilots and instructors from the international aviation community to meet the most demanding requirements for realistic simulation.  

About ManoMotion

ManoMotion is the leading company in hand tracking and gesture analysis in 3D-space. Its proprietary, AI-based software uses only a standard RGB camera or other sensors and runs on any smart device. ManoMotion brings unparalleled intuition in human-computer interactions (HCI), refined through 10 years of research and development in gesture technology. ManoMotion’s accurate and intuitive 3D gesture control enables the advanced user interaction needed for innovative and user friendly AR applications in advanced headset and smart glasses systems.  ManoMotion is the leading company in hand tracking and gesture analysis in 3D-space. Its proprietary, AI-based software uses only a standard RGB camera or other sensors and runs on any smart device. ManoMotion brings unparalleled intuition in human-computer interactions (HCI), refined through 10 years of research and development in gesture technology. ManoMotion’s accurate and intuitive 3D gesture control enables the advanced user interaction needed for innovative and user friendly AR applications in advanced headset and smart glasses systems. 

Source: Vrgineers Press Release
Photo Credit: Vrgineers

You may also check our Terms and Conditions for our Content Policy.