Plugins + Scripts PICO Facetracking

[mrmr32]

mrmr32 submitted a new resource:

PICO Facetracking - Imports PICO 4 PRO/Enterprise facetracking and eyetracking into VAM

Adaptation of the original Vive Facial Tracker Plugin for PICO 4 PRO/Enterprise headsets.

I recommend using both the application and plugin provided here. However, the application provided here (for the PICO) is compatible with the original Vive Facial Tracker plugin, and the original application (for Vive facetracking) is compatible with this plugin, so you can exchange them.

How to use
1...

Read more about this resource...

 

[mrmr32]

mrmr32 updated PICO Facetracking with a new update entry:

Added eyetracking

Now you can use PICO's eyetracking sensors to move the eyebrows, blink and look

Read the rest of this update entry...

 

[mrmr32]

mrmr32 updated PICO Facetracking with a new update entry:

Resource management fix

Function Dispose() didn't work properly.

Read the rest of this update entry...

 

[Nawen]

Has anyone tried this? Does it work?

 

[mrmr32]

Has anyone tried this? Does it work?

You have a demo video in the overview page. If you're concerned about security, you can review the code yourself either by decompiling the executables, or by looking at the code in my GitHub: PICOFacialTrackerVamLink, and vam-facetracking.

 

[Nawen]

didnt say anything about security, just curious if it works, the video is 12 seconds and not much of the setup is shown or the software or settings in vam .... but turns out I dont have the right hardware to test it, need the pro or enterprise headsets specifically which I cant seem to find where II live.... nevermind..

 

[Saint66]

Wow, just came across this, great work!
Would it be possible for Quest Pro's facetracking as well?
VD already can forward the tracking data and ppl are using in in VRChat:

🛠️ Getting Started | VRCFaceTracking

Follow this guide to setup your face-tracking hardware and start sending face tracking data to VRChat.

docs.vrcft.io

 

[YouWillNeverknow]

Any chance you could do this with Project Babble?
Would be very cost effective since the vive face tracker is now discontinued

 

[mrmr32]

Any chance you could do this with Project Babble?
Would be very cost effective since the vive face tracker is now discontinued

The plugin was made following VRChat FaceTracking PICO module... If I could somehow implement the same thing VRChat uses inside VAM it should be compatible with any VRCFT module, and that would be the best. However I tried that but there's currently a bug that didn't let me do it, maybe in the future I try again.

 

[AshArm]

Great work, but it would be even better if it were compatible with Pico Connect. The Pico Motion Tracker 2.0 is not supported on the Streaming Assistant.

 

[1943439974]

I'm sorry that this plug-in seems to have stopped updating. Although I would like to use it, the performance of the old version of the streaming assistant is too poor and cannot support hand tracking within vam.

 

[VAMbaichi]

您好，作者。我最近买了个 PICO4pro，安装了你的插件，在使用中遇到了一些问题。例如，打开 deformation 菜单调整面部参数会导致游戏闪回。例如，全身跟踪器将保持在原位，手柄将无法对准菜单栏，因为它保持在原位。

 

[VAMbaichi]

pico 助手和 pico connect 同时在电脑上启动，并成功完成跟踪。但有时全身跟踪器加上手柄和资产会像视频一样卡住