XR Tools for Hand-Animations and Poke/Piclup

Help XR
,
1

Godot Version

4.6

Question

Hi All,

Basically, I would like to use Godot 4.6, with XR Tools and XR Vendors, to have a Passthrough application for the Quest 3, where I can use hand-tracking, with Pickable and Poke interactions.

I come from Unity, and want to try swapping over to Godot for simple AR/VR HMD projects (Quest 3). I tried out the XR Tools, and while they are quite complete for VR, I do miss proper hand-tracking support for MR projects.

I tried the Hand Pose Detector plugin. And while it does a great job tracking and animating the hands, and allows for smooth grabbing using Pickable, I cannot seem to enable the Poke interaction.

I then tried using the XR Tools setup, however that one seems to animate hands based on controller input rather than actual hand/finger pose.

So big question: Is there a way to use the XR Tools to accurately track and animate the fingers (like Hand Pose Detector does), while also allowing me to use the poke interaction?

Thank you very much for any help anyone can give.

2

Sadly XR Tools development mostly predates us having reliable hand tracking so the entire solution is geared to build in posing and infering finger positions from controller input.

I am working on a successor that does work with hand tracking first, but I am still working on the pose system and it is still missing many features that XR Tools v1 has.

You can also have a look at this sample project that uses hand tracking but it only has very basic pickup logic: godot-demo-projects/xr/openxr_hand_tracking_demo at master · godotengine/godot-demo-projects · GitHub

1 Like