How to use Hand Tracking in VAM (Quest)

Guides How to use Hand Tracking in VAM (Quest)

Download [0 MB]
Overview Updates (3) Reviews (13) History Discussion
thinoreos

thinoreos

Well-known member
Messages
195
Reactions
335
Points
63
thinoreos submitted a new resource:

How to use Hand Tracking in VAM (Quest) - A guide on how to use Hand Tracking in VAM with Virtual Desktop

Guide last updated: March 2024
How to use Hand Tracking in VAM in VR with Virtual Desktop!
*Difficulty level: 3/5*

What is this?
Imagine using your hands in VAM without any LeapMotion or external sensors, purely just the Quest. Now you can!
View attachment 340228View attachment 340229View attachment 340243[ATTACH type="full"...
Click to expand...

Read more about this resource...
 
@VRCube I also have the Leap Motion 2 controller and tested the VD solution just out of curiousity.
It's a great solution for users w/o additional HW like Ultraleap or expensive gloves and such.

But: I won't throw away my Leap2, because it's way more accurate and faster, the VD solution is nice but also somehow laggy and limited compared to Leap.
Anyway, that's a good addition from the VD guys, I won't complain.

They also emulate body tracking, but thats not really useable in it's current first beta stage and prolly would never reach anything near to real trackers.
 
I have a Quest 3... Does this mean I would be able to do finger motion capture in recording animations?
 
while hand tracking could you use the controllers to track other parts of the body simultaneously? Using embody in the tracker settings perhaps?
 
Bob Nothing said:
I have a Quest 3... Does this mean I would be able to do finger motion capture in recording animations?
Click to expand...
Yes you can, there are some people online who use Quest to record mocap for hand tracking since a while ago. I personally haven't tested it but you can search around online!
 
Trogdor69 said:
while hand tracking could you use the controllers to track other parts of the body simultaneously? Using embody in the tracker settings perhaps?
Click to expand...
Yes, the other trackers show up (eg legs) but anything below lower body kinda sucks at tracking
 
Bob Nothing said:
I have a Quest 3... Does this mean I would be able to do finger motion capture in recording animations?
Click to expand...
Yes, just tried with Embody and Timeline.
I recorded finger motion into an existing animation which had no animated fingers.
Worked out great.

I used a QPro, but that doesn’t make a difference
 
Does anyone know how can we used Quest 3 controllers for the foot tracking and our hands for the hand tracking using this beta? Is it possible?
 
Wxy_332 said:
Does anyone know how can we used Quest 3 controllers for the foot tracking and our hands for the hand tracking using this beta? Is it possible?
Click to expand...
Quest controllers for foot is a bit complicated, but if you use external trackers it will work together with this beta. (eg vive trackers, slime, etc)
 
Hi i have a question. what is cowgirl scene in your guide?
I can't find on hub :(
If you have any information , please tell me.
Thank you!
 
pineappleman said:
Dont have a good connection to streamvr, is there a way to work with quest link?
Click to expand...
that's an issue on VAM's side. rn the only hand tracking supported is steamvr or leapmotion. it would be possible to recreate the same feature as VD but in a windows app but it will still suffer from added latency and is generally a lot of work. If we weren't on a 6 year old version of unity it would be feasible to add openxr support but with current version no. vam2 supports openxr/oculus xr natively so this should just be a feature, but realistically it may have to be added by plugin authors

as for leg tracking its just not at the level meta promised yet so no surprise VD hasnt done anything with it. I know meta also promised some estimation for quest 2 that I think just doesnt exist yet lol. But both quest 2 and quest 3 can use decent waist tracking which VD 100% should've implemented as that makes enough difference that you dont even really need leg tracking unless you're trying to kick people or something hadnt seen the update lol. vive trackers do actually work on quest 2 which is surprising
 
Last edited:
thinoreos said:
Quest controllers for foot is a bit complicated, but if you use external trackers it will work together with this beta. (eg vive trackers, slime, etc)
Click to expand...
I haven't been able to make this(Simultaneous Handtracking/ Body tracking w/ controller as tracker) work yet. Seems the controllers can not be used to track something other than your hands, while you're using handtracking for your hands. In embody, the controllers are listed as Left Hand/Right Hand then a few other vive tracker options for the hips/legs.. If there was an option or a toggle to force the controllers to look like vive trackers instead of controllers i think we'd be good to go. Otherwise as soon as you touch the controller the hand tracking just goes back to controller and doesn't stay on hand tracking.
 
Trogdor69 said:
I haven't been able to make this(Simultaneous Handtracking/ Body tracking w/ controller as tracker) work yet. Seems the controllers can not be used to track something other than your hands, while you're using handtracking for your hands. In embody, the controllers are listed as Left Hand/Right Hand then a few other vive tracker options for the hips/legs.. If there was an option or a toggle to force the controllers to look like vive trackers instead of controllers i think we'd be good to go. Otherwise as soon as you touch the controller the hand tracking just goes back to controller and doesn't stay on hand tracking.
Click to expand...
Sorry not entirely sure what you mean, but you can only either do:
- Hand tracking with IOBT
- Controllers with IOBT
but not both 1 controller and 1 hand tracking

If I get what you're trying to do, you want to enable body tracking with hand tracking in Embody, correct? In that case don't touch the controllers at all, just use hand tracking to select everything. You can use my steamvr bindings for selecting stuff
 
animetiddyenthusiast said:
that's an issue on VAM's side. rn the only hand tracking supported is steamvr or leapmotion. it would be possible to recreate the same feature as VD but in a windows app but it will still suffer from added latency and is generally a lot of work. If we weren't on a 6 year old version of unity it would be feasible to add openxr support but with current version no. vam2 supports openxr/oculus xr natively so this should just be a feature, but realistically it may have to be added by plugin authors

as for leg tracking its just not at the level meta promised yet so no surprise VD hasnt done anything with it. I know meta also promised some estimation for quest 2 that I think just doesnt exist yet lol. But both quest 2 and quest 3 can use decent waist tracking which VD 100% should've implemented as that makes enough difference that you dont even really need leg tracking unless you're trying to kick people or something hadnt seen the update lol. vive trackers do actually work on quest 2 which is surprising
Click to expand...
To be fair, VAM VR is already quite ahead compared to a lot of VR games (despite being on a super old engine) with leap motion, tracking, etc. But yes you're right hopefully VAM2 does everything it needs to
 
thinoreos said:
Sorry not entirely sure what you mean, but you can only either do:
- Hand tracking with IOBT
- Controllers with IOBT
but not both 1 controller and 1 hand tracking

If I get what you're trying to do, you want to enable body tracking with hand tracking in Embody, correct? In that case don't touch the controllers at all, just use hand tracking to select everything. You can use my steamvr bindings for selecting stuff
Click to expand...

I want to use hand tracking while simultaneously using the controllers to track hip or leg or something else. Doesn’t seem to be possible at the moment unless you can make the controllers show up as vive trackers instead of controllers.
 
Trogdor69 said:
I want to use hand tracking while simultaneously using the controllers to track hip or leg or something else. Doesn’t seem to be possible at the moment unless you can make the controllers show up as vive trackers instead of controllers.
Click to expand...
As far as I know, using Quest controllers to track other body parts is very hard to do already, and this is an additional layer of things you want to do... I think your best bet is to buy real trackers
 
You must log in or register to reply here.

Similar threads

thinoreos
Guides How to use Passthrough in VAM (VR/AR)
4 5 6
Replies
138
Views
12K
thinoreos
thinoreos
Ghostwalden
Guides How to use Hairstyles
Replies
4
Views
115
Ghostwalden
Ghostwalden
ZRSX
Guides How to use subscenes
Replies
19
Views
5K
uttermost
U
hazmhox
Guides How to use foto2vam
2 3
Replies
51
Views
17K
Clem_Fandango
C
Shadow Venom
Guides How to convert and optimize MMD motion for use in VAM
Replies
6
Views
740
MarsStaedler
M
Back
Top Bottom