Resource icon

Plugins HeadTracker

Download [0.01 MB]
Support me at...
Overview Updates (3) Reviews (4) History Discussion
Latest Most helpful Rating
J
This is definitely a step in the right direction. Using SmoothTrack on my iPhone and OpenTrack on the PC it works a charm. Would be nice to zoom in and out. Maybe it can just I haven't sorted it yet. Nice job.
Upvote 0
V
Thank you for another nice plugin for people who use VaM in desktop mode. VR is more immersive but I would not want to use it for too long.

My vision of a perfect use in desktop mode is something like:

I'm sitting in front of a monitor using my head to track an atom in 6DoF. My hands are also tracked using Leap Motion. All of this is happening in perfect sync with no lag. It would be like sitting in front of a real mini 3d world and not a flat monitor, and my hands are moving inside it...

Well, I can dream, can't I? Haha.

Btw, how do I move the Z-axis with this plugin? (as in, moving my head closer and further from the camera should make the screen zoom in and out)
Eugene-E0a80fd8080ff8e
Eugene-E0a80fd8080ff8e
Do you mean something like this : https://www.youtube.com/watch?v=91tYEgpmN4M ?
I have tried to do similar in VaM and it does not look any immersive without that mesh forming a well. You need a specially designed scene to have that effect :(

As of now, Z-axis detection is very imprecise. Relying on it causes very unpleasant in-and-out shaking. In my experiments I had to override with z=0.8 meters.
The HeadTracking6DoF.exe sensor actually detects and transmits both head rotation and position relative to camera.
Upvote 0
ARKTIK
great！
Upvote 0
Case
Don't get me wrong - I really dig your work, and I'm beyond happy someone in the VaM community is paving the way in terms of DIY-(body)tracking, but ... I really liked your PhoneController app, and I was hoping you'd further explore the possible improvements you mentioned when you published it? (IIRC, you pondered using some custom libraries (SENSORS_6DOF?) to help with drift correction).

For background: I'd wager many people in the community can manage to save up the dough for a Quest or similar at some point, but there's only very, very few peeps that can afford dedicated commercial fullbody-tracking solutions. Afaik, it's rare even amongst the semi-professional scene creators.

Granted, there's Driver4VR, which offers various DIY-solutions for lowerbody-tracking - but my impression is that they're more focussed on precise foot-tracking for action games & VRchat? (I haven't tried it yet, but I would wager that, say, a kinnect would have trouble correctly tracking at least one coordinate of the hip, since the sensors all face in one direction)

TL;DR - I think there'd be a lot of demand in the VaM community for a good, reasonably accurate DIY-hiptracking solution. Full lowerbody-tracking would be more awesome yet, but I think the hiptracking is going to be most critical, since so much of animation & posture is influenced by that atom/controller.
Eugene-E0a80fd8080ff8e
Eugene-E0a80fd8080ff8e
Although this might seems like a step towards body tracking, it is not (yet).
This plugin only manages camera: you turn your head to the left, VaM's camera turns to the left and image on your display runs to the right (so you see what was behind the left side of your monitor). You have to keep your eyes on the monitor. Eyes are not tracked, just head.

This is similar to what MS Flight Simulator's people use. Search youtube for "FaceTrackNOIR" -- there a lot of videos for this application of headtrackng.

For hiptracking :) , this seems to be easy task -- just slap an ArUco marker on your butt, and you good to go. Probably copying an example snippet from OpenCV docs would be enough for PoC.
Upvote 0
Back
Top Bottom