The device has been designed specifically for enterprise use and it is claimed to be among the most immersive enterprise AR headsets in the market. With industry-leading optics and powerful computing in an ergonomic design, Magic Leap 2 will enable operators to work more efficiently, help companies optimise complex processes, and allow staff to collaborate more easily.
One of its key features is the 3D indirect-Time-of-Flight (iToF) depth sensing technology that was co-developed by Infineon Technologies and pmdtechnologies.
Magic Leap 2 is using the REAL3 3D Image Sensor, a new and improved IRS2877C Time-of-Flight imager, that can capture the physical environment around the user and helps the device to understand and finally interact with it. Thanks to the 3D imager’s VGA resolution, many different objects can be detected in detail.
The Time-of-Flight technology developed by Infineon and pmd creates an accurate 3D mapping of the environment as well as 3D image of faces, hand details, or objects in real-time. This advancement will help to enable accurate environmental interaction with the Magic Leap 2. In addition, the sensor enables enhanced gesture controls on Magic Leap 2.
Infineon and pmd optimised the 3D sensor to bring the power consumption down to a minimum, reducing heat and increasing battery life of Magic Leap 2.
“Sensing the environment precisely and in real-time is key for augmented reality applications,” explained Magic Leap CTO, Julie Green. “Magic Leap 2 will provide an even more immersive user experience. These superior functionalities will help to connect the physical and digital world even more seamlessly.”
“We have introduced our 3D imager technology in a professional environment, where precision and reliability are life-saving features,” said Andreas Urschitz, Division President Power & Sensor Systems and designated CMO at Infineon. “The latest 3D time-of-flight technology is going to enable new augmented and mixed reality applications for healthcare and industry. It’s about to change the way we live and work fundamentally.”
“Our technology helps Magic Leap 2 to detect precisely to the millimetre the location of objects in a physical environment. Virtual objects can be placed in the real world and stay in place when the user walks around a room and would be obscured, as other real objects appear in front of them,” added Bernd Buxbaum, CEO of pmd. “It also works reliably in bright sunlight or complete darkness, where other depth-sensing solutions quickly reach their limits.”
More AR is being applied in industrial and medical environments that make use of these technological advancements. For example, Brainlab, a Munich based digital medical technology company, combines their patient-specific, AI-driven anatomical segmentation visualization software with spatial computing from Magic Leap, to provide surgeons an increased understanding of the patient’s anatomy.