Plugins + Scripts Dollars Motion & Facial Capture

[dollarsmocap]

Thanks for the response. You can get a quick example with the default model by setting it's scale to 0.7.
Using the pose preset did not help in this case.

Thank you for the reply, it's very helpful. We will try to fix this issue.

 

[Electric E-Boy]

Thanks, I'm actually looking for a solution for creating mocap files. Since they are easy to load.
Would you have any tips on how to do that?

A little bit late, but i found a solution for using the bvh mocap files if anyone is still interested. I compared a working bvh file and the export: the nodes are named differently, so just rename them accordingly to VAM (rCollar for rShoulder for example) and they work.

 

[dollarsmocap]

A little bit late, but i found a solution for using the bvh mocap files if anyone is still interested. I compared a working bvh file and the export: the nodes are named differently, so just rename them accordingly to VAM (rCollar for rShoulder for example) and they work.

Thank you for your solution. Better VAM support is always on our roadmap but we have not yet been able to prioritize it due to other ongoing projects. We will revisit it as soon as possible, thank you.

 

[hentailondon]

Please have a look at the performance of the Mono software. Since the 60hz update, performance hit has doubled and it's like 50% GPU utilization from the software alone.
This forced me to use a much older version. Maybe you can put a toggle between 30 and 60hz?

 

[dollarsmocap]

Please have a look at the performance of the Mono software. Since the 60hz update, performance hit has doubled and it's like 50% GPU utilization from the software alone.
This forced me to use a much older version. Maybe you can put a toggle between 30 and 60hz?

Hi, Enhanced Mode is turned on by default in recent versions. That should be the reason for the performance issue you encountered. You can turn it off in the settings.

 

[hentailondon]

Hi, Enhanced Mode is turned on by default in recent versions. That should be the reason for the performance issue you encountered. You can turn it off in the settings.

Thanks for replying. Enhanced mode is not the reason (for me it only has a minor performance impact).

Comparison (with same settings, RTX 4090):

Dollars_MONO_241115: CPU: ~16% GPU: ~16%
Dollars_MONO_250330: CPU: ~16% GPU: ~36%

 

[dollarsmocap]

Thanks for replying. Enhanced mode is not the reason (for me it only has a minor performance impact).

Hi, thank you for the information. This seems a bit strange, because when in full-body mode, Enhanced Mode should have a significant impact on GPU usage.

Comparison (with same settings, RTX 4090):

Dollars_MONO_241115: CPU: ~16% GPU: ~16%
Dollars_MONO_250330: CPU: ~16% GPU: ~36%

In our tests, these two versions don’t seem to show a big performance difference (unless the latter has NVIS facecap enabled). We will continue to monitor this issue and keep you updated if we find anything.

 

[hentailondon]

Hi, thank you for the information. This seems a bit strange, because when in full-body mode, Enhanced Mode should have a significant impact on GPU usage.


In our tests, these two versions don’t seem to show a big performance difference (unless the latter has NVIS facecap enabled). We will continue to monitor this issue and keep you updated if we find anything.

From further testing: on my side the newer versions use more headroom if its available, but go back to lower power draw when other applications are in use too. Which is fine, I use the latest version now.

 

[hentailondon]

Can you update the plugin so settings get saved? They always get reset in the atom menu, for example smoothing, which body parts to track etc. Would be nice to have the settings saved when loading the scene.
Also it would be nice to include the Live link functionality from your other plugin in this one, so you would only need one plugin in use for both facial and body motion capture.

 

[dollarsmocap]

Thank you for the update.

> Can you update the plugin so settings get saved?
Thank you for the advice. We will put it on our roadmap.

> Also it would be nice to include the Live link functionality from your other plugin in this one
Sorry, since this plugin is intended as a bridge between our own products and VAM, we likely won’t include Live Link Face functionality directly in it.
Using both plugins at the same time should be possible. If you encounter any technical difficulties, please let us know.

 

[hentailondon]

Is there a way to use new Dollars SAYA with Virtamate? (since its also based on unity...)

 

[dollarsmocap]

Is there a way to use new Dollars SAYA with Virtamate? (since its also based on unity...)

Thank you for your interest. Probably not.

The main feature of SAYA is its use of full ARKit facial capture combined with upper-body motion capture.

Since VAM models currently don’t fully support ARKit blendshapes (you can see a comparison between VAM models and several others here),

the final result with SAYA would likely be similar to MONO. Therefore, we don’t plan to add VAM support to SAYA for the time being.

 

[hentailondon]

Thank you for your interest. Probably not.

The main feature of SAYA is its use of full ARKit facial capture combined with upper-body motion capture.

Since VAM models currently don’t fully support ARKit blendshapes (you can see a comparison between VAM models and several others here),

the final result with SAYA would likely be similar to MONO. Therefore, we don’t plan to add VAM support to SAYA for the time being.

Thank you for your reply.

Facelink is already working well with Virtamate, that uses ARkit? Here's a video . I've used it before with Iphone camera and got significantly better face tracking results than with EGAO(Using NVIS on pc was comparable but it takes more ressources).
So I combined it, livelink face tracking from Iphone and upper body tracking with MONO.
With SAYA it would be great cause you get to have it all from the Iphone ,so the PC does not use so much ressources. Is there a way i can implement it myself (vam plugin) while SAYA app? Because it should work in theory....

 

[dollarsmocap]

Thank you for your reply.

Facelink is already working well with Virtamate, that uses ARkit? Here's a video . I've used it before with Iphone camera and got significantly better face tracking results than with EGAO(Using NVIS on pc was comparable but it takes more ressources).
So I combined it, livelink face tracking from Iphone and upper body tracking with MONO.
With SAYA it would be great cause you get to have it all from the Iphone ,so the PC does not use so much ressources. Is there a way i can implement it myself (vam plugin) while SAYA app? Because it should work in theory....

Thank you for your detailed explanation. We’ll take this into consideration.

One point we care about in particular is that the true advantage of ARKit facial capture lies in the 20+ mouth-related blendshapes, which VAM models currently support only weakly. This can be seen from the thumbnail of our demonstration video above, the mouth shape of the VAM model differ quite significantly from the others.

That said, we truly appreciate your feedback, and we’ll keep your suggestion in mind.