Lip Sync Tab
“Lip Sync” Tab added in V1.22.0.0 Is a new high-performance (threaded) and high-quality lip-sync system. Be aware that this tab works in conjunction with the audio settings in the “
Jaw_Physics_&_Triggers” Tab.
“Enabled” Off by default. Toggling this "On" will enable the new built-in lip syncing system. It is "Off" by default so that it does not conflict with any third party plugin present inside any preexisting scenes. Be aware that this does not toggle off the Audio drive system in the “
Jaw_Physics_&_Triggers” Tab.
”Volume” This bar gives you feedback of the audio levels as you adjust volume settings during playback. Here is an example of the volume bar in action during audio playback in game.
”Time Between Sampling” From 0-0.150 tenths of a second this sets the time between audio samples that the lip sync attempts to solve for a Viseme morph. Depending on how fast or slow you set this can affect how rapidly the morphs change. Ideally you want a higher sample rate the slower the audio line is spoken. If set too high, fast speech changes won’t be registered. If set too low, lips could move unnaturally fast.
| | | | |
| Time Between Sampling 0.0 | Time Between Sampling 0.050 | Time Between Sampling 0.150 | |
”Volume Multiplier” Multiples the volume of the original audio clip being played. This setting also affects the ”Volume Threshold” setting below.
”Sample Time Adjust” From -0.2 to 0.2 tenths of a second. This sets the amount of time the lip sync will sample in relation to the playback of the audio clip. This allows you to adjust the lip sync to line up better with your audio clip.
| | | | |
| Sample Time Adjust -0.200 | Sample Time Adjust 0.000 | Sample Time Adjust +0.200 | |
”Volume Threshold” Adjusts the threshold at which the lip sync will activate. The higher the number the higher the amplitude the audio clip’s signal needs to be.. This is also influenced by the ”Volume Multiplier” setting above.
”Mouth Open Factor” Adjusts the amount the mouth will open and close during lip syncing.
”Volume Clamp” Clamps the high’s of the audio clip
”Mouth Open Rate” Changes the speed that the mouth will open and close during lip syncing.
”Voice Type” Gives you two options to choose from "Female" and "Male". Female detects visemes from audio better for higher pitched audio, and male works better for lower pitched audio.
”Morph Set” Gives you three option: "Normal" , "Physics" and "Custom". Normal uses morphs that don't move the jaw joint. Physics uses morphs that move the joints. Physics can therefore give more accurate collision with the jaw and also can allow the head to move a bit when the jaw moves. Physics morphs are slower to react and can therefore result in some lag in response. This can be somewhat compensated for by using the Sample Time Adjust parameter.
Using physics morph set will move the jaw bone when the lip sync morphs change. With this set, collision and jaw physics will be accurate. Adjust jaw physics as needed for faster response. For custom set click Advanced...to set morph names to use.
”Viseme Detection Factor” This is for fine tuning and is probably best left at default values. It is a multiplier to the viseme detection engine that sets the viseme output value. This can be used in combination with Viseme Threshold and Viseme Value Clamp to allow making the system more or less likely to detect visemes from the audio. Use of this parameter would require a lot of experimentation.
”Viseme Threshold” Allows tuning the Viseme engine to ignore visemes that are less confidently detected. Use in combination with Viseme Detection Factor and Viseme Value Clamp.
”Viseme Change Rate” This controls how fast the morphs themselves can change. It allows for some smoothing of the output. If set too low you will get a slow response. If set too high you will get unnatural jitter.
”Viseme Value Clamp” This controls the maximum value of the output morphs. Setting to 1 could result in unnatural morphs depending on the morph set used.
”Advanced” In this section you can fine tune the detection of specific visemes. Some visemes can be over-detected and this can allow tuning that to allow other visemes to become the dominant ones. Setting to 0 essentially turns off that specific viseme. Clicking on this opens the "Advanced Lip Sync Settings" as shown below.
“Advanced Lip Sync Settings”
