Question Lip synch help

[garibaldi18]

Hi,

Could someone direct me to the best plugin on lip synching, or perhaps a guide for how to make the lips and speech look as natural as possible?

I’m trying to add voxta to a scene but when the character talks it looks really weird. I know there are lots of options like which type of jaw morphs to use etc but I don’t really understand how to best set it up.

Thanks for any help you can offer.

 

[garibaldi18]

Hi,

Could someone direct me to the best plugin on lip synching, or perhaps a guide for how to make the lips and speech look as natural as possible?

I’m trying to add voxta to a scene but when the character talks it looks really weird. I know there are lots of options like which type of jaw morphs to use etc but I don’t really understand how to best set it up.

Thanks for any help you can offer.

Ps: weird as in robotic or not lifelike, I mean

 

[murn]

https://hub.virtamate.com/resources/realtime-lipsync.1286/ Pretty sure this is what is used and I'm not sure there's any better. Also I think you will need to tweak some settings in both the plugin and character auto behavior concerning that ( morph speed, jaw movement, lip movement etc. ).

 

[garibaldi18]

https://hub.virtamate.com/resources/realtime-lipsync.1286/ Pretty sure this is what is used and I'm not sure there's any better. Also I think you will need to tweak some settings in both the plugin and character auto behavior concerning that ( morph speed, jaw movement, lip movement etc. ).

Thank you!

 

[murn]

Thank you!

Lip sync is built into vam also so it could just be the in game version. You can make adjustments in that also and it seems better than the plugin.

 

[rayrex]

I know this is old, but here's the magic. I copied it from the voxta scenes.
Looks fucking great now. I didnt have to use lipsync plugin.

 

[rayrex]

I know this is old, but here's the magic. I copied it from the voxta scenes.
Looks fucking great now. I didnt have to use lipsync plugin.

I got a 1-to-1 perfect result with those parameters from the voxta demo scene with one of my models, however I noticed a few still literally have their mouths open during speech (as in, no shutting in between words). Maybe theres another setting in play, but I found adjusting the audio max drive (default is -35 which literally leaves the mouth wide open during dialogue) to somewhere between -6 to 0 gives way better results*.

adjusting the audio drive max angle - which looking at the name, suggests how far the mouth opens at the "loudest" - should help fix things.

*edit to say that my happy place is:
Audio drive max @ -3 = closes the mouth when shes in between words
volume multiplier @ 2.5000 = gives a realistic satisfying "mouth open" visual feedback (imo 1.5 might look good, but wasnt as visually pleasing to me)

also I thought the settings were per model, its per scene.
YMMV of course, but between those three settings you should be able to get a good immersive lip sync.

 

[FreeMaster69]

I got a 1-to-1 perfect result with those parameters from the voxta demo scene with one of my models, however I noticed a few still literally have their mouths open during speech (as in, no shutting in between words). Maybe theres another setting in play, but I found adjusting the audio max drive (default is -35 which literally leaves the mouth wide open during dialogue) to somewhere between -6 to 0 gives way better results*.

adjusting the audio drive max angle - which looking at the name, suggests how far the mouth opens at the "loudest" - should help fix things.

*edit to say that my happy place is:
Audio drive max @ -3 = closes the mouth when shes in between words
volume multiplier @ 2.5000 = gives a realistic satisfying "mouth open" visual feedback (imo 1.5 might look good, but wasnt as visually pleasing to me)

also I thought the settings were per model, its per scene, if not per session.
YMMV of course, but between those three settings you should be able to get a good immersive lip sync.

This is very helpful. I will try this and give some feedback.

 

[atani]

I've barely tested the results but they seem to be better than what I had, so am now using these values.
Thank you for sharing them @rayrex

 

[rayrex]

I've barely tested the results but they seem to be better than what I had, so am now using these values.
Thank you for sharing them @rayrex

no problem! I was looking for help too and remembered the voxta videos seemed to have good lipsync so thought I'd see how they did it and huzzah. I'm glad it helped you. This did wonders for MY immersion, so figured I'd help anyone else out here too

Theres something tricky about it being per scene though, so keep in mind you'll have to revisit old scenes with these settings