Combining hand-tracking technology with vision sensing and expertise in AR hardware and software development, the collaboration between Ultraleap, Prophesee and TCL RayNeo respectively aims to address the major challenges in developing AR wearables.
A new partnership between Prophesee – experts in neuromorphic vision systems, TCL RayNeo – developers of AR (augmented reality) hardware and software applications – and Ultraleap, owners of cutting-edge hand-tracking technology, is aiming to push the boundaries of AR within wearable products.
With advanced computer vision and machine learning models of its own, Ultraleap brought Prophesee – with its event-based Metavision® sensors – and TCL RayNeo – with state-of-the-art image quality and AI+AR features – onboard to develop AR glasses that feature industry-leading interactivity and immersion.
Suitable technologies ensure the future is near
Any future commercial product needs to deliver a seamless user experience first and foremost, but for those based on newly developed technologies, new ground constantly needs to be broken, often forcing user experience out of the manufacturer’s focus.
Using both Ultraleap’s precise hand-tracking technology together with Prophesee’s event-based Metavision, the partnering developers can create AR glasses with extremely low power consumption and high speed, while ensuring accurate tracking and using natural interactions to replace buttons and capacitors.
Instead of having to constantly touch the glasses to interact with them, users engage hand-tracking software to operate the device with more natural interactions, in a similar way to how phones and smartwatches can be operated already.
TCL RayNeo’s role in the development partnership, meanwhile, is to make sure the glasses include crystal-clear image quality, navigation, AI-powered smart assistant features and real-time multi-lingual dialogue translation. The merger of all these technologies will provide end users with an outstanding AR product experience.
Excitement surrounding the new partnership
“We’re excited to work with TCL RayNeo and Prophesee to bring a new level of interactivity to AR glasses,” said Tom Carter, CEO and co-founder of Ultraleap. “Our goal is to make AR glasses that are as intuitive and immersive as possible. By combining our hand-tracking technology with TCL RayNeo’s AR expertise and Prophesee’s event sensors, we will be creating products that not only enhance user experience but also set a new standard for the industry.”
Meanwhile, CEO and co-founder of Prophesee, Luca Verre, said: “Our established relationship with Ultraleap in integrating Prophesee’s GenX320 event-based vision sensors with Ultraleap’s advanced computer vision and machine learning tracking models has demonstrated benefits for more intuitive, immersive and user-friendly XR devices. By combining this with TCL RayNeo’s expertise, we can together unlock significant performance and usability improvements to the current state of AR systems which will expand the market potential and capabilities of these applications.”
And the “partnership with Ultraleap and Prophesee is an exciting step forward in the AR space,” said Howie Li, founder and CEO at RayNeo. “Ultraleap’s hand-tracking technology complements our glasses design, enabling us to develop AR glasses that are not only functional but also transformative. We believe this collaboration will drive the future of AR, offering users an unparalleled blend of the virtual and physical worlds.”
