Guides How to use Hand Tracking in VAM | 2.0 (Quest)

[lhd9795]

Dear author, I followed your tutorial, but I can't find your preset. If you have a solution, could you tell me? Thank you very much.

 

[thinoreos]

Dear author, I followed your tutorial, but I can't find your preset. If you have a solution, could you tell me? Thank you very much.View attachment 530957

Is this SteamLink or Virtual Desktop?

 

[Vrkorn21]

Hey I really appreciate the guide, but when using Virtual Desktop and Hand Tracking with my Quest 3 I do not see the option for "Hand Tracking Controller" when I go to custom bindings and change the controller. The older version of emulating the Index Controllers works just fine, but obviously isn't ideal with how sensitive it is to moving the model on accident.

Inserting a screenshot of my available controllers. I'm using the SteamVR Beta branch as was suggested in the guide, but I also tried non-beta as well to the same end result. I've made sure to restart my pc, headset, and Virtual Desktop. I also make sure to launch SteamVR through Virtual Desktop using only hand tracking and then pulling up the controller bindings all while only using hand tracking, but I still don't get the "Hand Tracking Controller" as an option when I choose custom bindings and to change the controller.

 

[Sarah Lacroix]

Is there a way to use it with ALVR? I am a vision pro user and I would love to just use my hands

 

[Battletoad08]

Is this only steamlink now? I only use VD becuase it seems faster and steamlink always glitches out. I mean how do you use passthrough of VD and steamlink at the same time?
I use VAM and VD with the vive emulation in VD. How come when im doing hand tracking in just passthrough on meta and not vam my hands track awesome all my fingers and everything copy exactly. Pinching, squeezing motions. But when I load VAM and get in it and put my controllers down the fingers and hands barely move and are stiff. The fingers track a little but not like in regular meta passthrough games. If they moved like in meta passthrough it would be way better, maybe im doing something wrong?

 

[thinoreos]

Hey I really appreciate the guide, but when using Virtual Desktop and Hand Tracking with my Quest 3 I do not see the option for "Hand Tracking Controller" when I go to custom bindings and change the controller. The older version of emulating the Index Controllers works just fine, but obviously isn't ideal with how sensitive it is to moving the model on accident.

Inserting a screenshot of my available controllers. I'm using the SteamVR Beta branch as was suggested in the guide, but I also tried non-beta as well to the same end result. I've made sure to restart my pc, headset, and Virtual Desktop. I also make sure to launch SteamVR through Virtual Desktop using only hand tracking and then pulling up the controller bindings all while only using hand tracking, but I still don't get the "Hand Tracking Controller" as an option when I choose custom bindings and to change the controller.

That's weird, if you're using hand tracking to pull all that up and it's not showing up must be an error on SteamVR side. Try reinstalling SteamVR? If not you have to submit a bug to SteamVR

Is there a way to use it with ALVR? I am a vision pro user and I would love to just use my hands

It's possible, but I haven't tested it myself: https://github.com/alvr-org/ALVR/wiki/Hand-tracking-controller-bindings

Is this only steamlink now? I only use VD becuase it seems faster and steamlink always glitches out. I mean how do you use passthrough of VD and steamlink at the same time?
I use VAM and VD with the vive emulation in VD. How come when im doing hand tracking in just passthrough on meta and not vam my hands track awesome all my fingers and everything copy exactly. Pinching, squeezing motions. But when I load VAM and get in it and put my controllers down the fingers and hands barely move and are stiff. The fingers track a little but not like in regular meta passthrough games. If they moved like in meta passthrough it would be way better, maybe im doing something wrong?

It sounds like you didn't read the guide.

 

[thinoreos]

thinoreos updated How to use Hand Tracking in VAM | 2.0 (Quest) with a new update entry:

2.2

No longer need to be in Beta, now live version

Read the rest of this update entry...

 

[Makimax]

I've read the entire guide, but I don't quite understand. Do I still need Steam? It says SteamLink OR Virtual Desktop, but then I see that you have to use Steam.
I haven't used SteamVR/SteamLink for a long time because it crashes a lot and consumes too many resources. Just using Virtual Desktop doesn't work?

 

[Vrkorn21]

That's weird, if you're using hand tracking to pull all that up and it's not showing up must be an error on SteamVR side. Try reinstalling SteamVR? If not you have to submit a bug to SteamVR


It's possible, but I haven't tested it myself: https://github.com/alvr-org/ALVR/wiki/Hand-tracking-controller-bindings


It sounds like you didn't read the guide.

Ok thanks I'll try re-installing SteamVR and see if that helps!

 

[thinoreos]

I've read the entire guide, but I don't quite understand. Do I still need Steam? It says SteamLink OR Virtual Desktop, but then I see that you have to use Steam.
I haven't used SteamVR/SteamLink for a long time because it crashes a lot and consumes too many resources. Just using Virtual Desktop doesn't work?

 

[bruce]

View attachment 536588

I have the same confusion. Do you mean that hand tracking must be realized by launch vam through steamvr? So how does steamvr support passthrough?
There is no description of steamvr in the passthrough article.

 

[thinoreos]

I have the same confusion. Do you mean that hand tracking must be realized by launch vam through steamvr? So how does steamvr support passthrough?
There is no description of steamvr in the passthrough article.

View attachment 536814

I already mentioned a few times in this guide that you NEED SteamVR for hand tracking.

Passthrough can be used with SteamVR or without SteamVR, it doesn't matter.

Full Hand Tracking NEEDS SteamVR

 

[Makimax]

View attachment 536588

I knew that, but I thought it had changed with the "VR with Steam Link & Virtual Desktop" update. You need both; it's an AND, not an OR. Sorry for the inconvenience. Thanks for the work; I would have liked to use it, but Steam and I are on bad terms. So many bugs, crashes, and poor performance.

 

[bruce]

I already mentioned a few times in this guide that you NEED SteamVR for hand tracking.

Passthrough can be used with SteamVR or without SteamVR, it doesn't matter.

Full Hand Tracking NEEDS SteamVR

Thank you for your reply. I tried this step to solve this problem: I first opened virtual desktop, turned on passthrough to set the color value, then clicked to start steamvr in virtual desktop, and then started vam in steamvr, so that the finger bending could be recognized and the hand controller could be modified.

I always thought that virtual desktop and steamvr were mutually exclusive, but it turns out that they can be used superimposed in this way. It seems that steamvr does not support passthrough. Maybe the tutorial can make it clearer. If you need to use complete steamvr hand tracking while passthrough, first run the virtual desktop streaming screen, and then start steamvr and open vam in it, so that it will be clearer.

Sorry I was a little confused about the concepts of steamvr, virtualdesktop, steamlink, meta link, openvr, and openxr runtime.

 

[thinoreos]

I knew that, but I thought it had changed with the "VR with Steam Link & Virtual Desktop" update. You need both; it's an AND, not an OR. Sorry for the inconvenience. Thanks for the work; I would have liked to use it, but Steam and I are on bad terms. So many bugs, crashes, and poor performance.

You are confusing Steam Link and SteamVR. They are not the same thing. It's not AND, it's OR because you can use either:
1) Steam Link+SteamVR,
2) OR Virtual Desktop+SteamVR

Thank you for your reply. I tried this step to solve this problem: I first opened virtual desktop, turned on passthrough to set the color value, then clicked to start steamvr in virtual desktop, and then started vam in steamvr, so that the finger bending could be recognized and the hand controller could be modified.

I always thought that virtual desktop and steamvr were mutually exclusive, but it turns out that they can be used superimposed in this way. It seems that steamvr does not support passthrough. Maybe the tutorial can make it clearer. If you need to use complete steamvr hand tracking while passthrough, first run the virtual desktop streaming screen, and then start steamvr and open vam in it, so that it will be clearer.

Sorry I was a little confused about the concepts of steamvr, virtualdesktop, steamlink, meta link, openvr, and openxr runtime.

SteamVR with Virtual Desktop/ALXR does support passthrough.

SteamVR with Steam Link does not support passthrough.

In fact in Virtual Desktop, any game, method, runtime whatever will support passthrough as passthrough is just picking a color and making it passthrough.
I didn't specify using SteamVR in my passthrough tutorial because it doesn't matter, passthrough works with EVERYTHING (including SteamVR)

But yeah I get you that it can be confusing with all these terms, I'm glad you got it working

Now that I'm thinking, maybe I should put this at the start of all my guides: STEAM LINK AND STEAMVR ARE DIFFERENT THINGS