Hand tracking is an important part of creating natural interactions with augmented reality content, and one of the leading technology makers in this discipline has just improved its tracking engine.
Ultraleap, the company resulting from Ultrahaptics’ acquisition of Leap Motion, has released a developer preview of the fifth version of its hand-tracking software that offers even more accurate two-handed tracking for AR interfaces.
Building on the constellation themed naming conventions for the software, the new version is called Gemini, which will succeed Orion.
“Our tracking engine is the part of our software that converts images into digital models of your hands. For Gemini, we̵
Ultrahaptics notes that Gemini’s hand-tracking performance has been improved for two-handed interactions with improved ‘pose fidelity and robustness’. In addition, Gemini brings better initial hand recognition and new screen-based modes, which allow tracking sensors to be mounted above a screen instead of a headset or desktop.
Gemini will be integrated into the Varjo XR-3 and VR-3 headsets, as well as the reference design for Qualcomm Snapdragon XR-2 5G.
The developer preview is now available for download. Minimum requirements include an Ultraleap Leap Motion Controller or Stereo IR 170 camera module, a Windows 10 64-bit PC with Intel Core i3, i5 or i7 processors, 2 GB RAM, a USB 2.0 port, and the module package v4. 7.1 for Unity 2019 and above.
In addition to Leap Motion’s own AR experiments for its Project North Star DIY kit, we’ve seen how revolutionary hand-tracking can be through the interfaces of devices like the Microsoft HoloLens 2 and the Magic Leap 1. Continuous improvements in all aspects of AR wearables will ultimately result in a smoother experience for consumer-grade wearables from the likes of Apple when they finally hit the shelves.