Plugins Soundtrack audio sync

[lfe]

lfe submitted a new resource:

Soundtrack audio sync - keep animations from desyncing with music because of cpu lag

Ever had a scene that has music with some dancing scene animation or motion capture that is supposed to sync with it?

Those scenes with dancing and the creators that make then are badass. But my computer is not badass. So dancing stops going with the music and I get sad.

This plugin fixes that. Place this plugin on the AudioSource or RhythmAudioSource atom in the scene that is supposed to play the background music.

Make adjustments and hopefully it is better for you.

Read more about this resource...

 

[TheWizardOfWoo]

Wonderful thank you. This will be really useful for alot of people


Can I ask: Do you think it would be theoretically possible to do something like this with Acidbubbles timeline plugin?

I ask because being able to sync audio with animations as I build them that way would be a game changer for a number of things I have been struggling to pull off recently. (scrubbing back and forth with the timeline would be incredible)

e.g. playing an instrument, high tempo head banging or simply responding to a vocal track. (I can Use RTlipsync for the lips, but It would be amazing to be able to have all the body stuff just sync up together naturally.)

Maybe a little ambitious, but figured I would ask anyway.

All the best.

 

[lfe]

Wonderful thank you. This will be really useful for alot of people


Can I ask: Do you think it would be theoretically possible to do something like this with Acidbubbles timeline plugin?

I ask because being able to sync audio with animations as I build them that way would be a game changer for a number of things I have been struggling to pull off recently. (scrubbing back and forth with the timeline would be incredible)

e.g. playing an instrument, high tempo head banging or simply responding to a vocal track. (I can Use RTlipsync for the lips, but It would be amazing to be able to have all the body stuff just sync up together naturally.)

Maybe a little ambitious, but figured I would ask anyway.

All the best.

Short answer: yes.
Long answer: I would like to hear more about your use case. There are so many things that can be improved in VaM when it comes to synchronized audio and motion. This plugin has the modest and simple goal of trying to fix audio/animation drift when your framerates drop to a point where the audio is now out of sync - outside of that it does not improve the quality of life for creators much.

Message me on discord and if we happen to find some overlapping free time to talk live I would like to better understand your ideas.

 

[Nameless Vagabond]

This plugin is great! Being able to experience IsaacNewton's lapdance scenes with softbody physics on really makes them that much better.
Thanks so much for sharing!

 

[lfe]

lfe updated Soundtrack audio sync with a new update entry:

support music that loops plus ease of use changes

new: support music that loops in animations that are longer than the song
new: you can add this to any atom in the scene now
new: automatically find the music offset when first adding the plugin to the scene
new: automatically find the audio source when first adding the plugin to the scene

Read the rest of this update entry...

 

[DTH]

I'm looking for a very simple plugin that I can add to a scene for back round music. Like a song on a radio or the TV is left on. Needs to loop. Will this work?

 

[lfe]

I'm looking for a very simple plugin that I can add to a scene for back round music. Like a song on a radio or the TV is left on. Needs to loop. Will this work?

This plugin will not add sound for you. It assumes you have done the work to add a sound and will make recorded animations stay in sync with that sound if your framerate drops.

Adding sound is pretty hard I agree. There is a video by JustLookingForNothin on youtube that walks through the basics but the VaM version and UI in the video is really old and outdated.

After watching that video and understanding the ideas of triggers, adding scene audio, using an audio source post in the forums here or in discord. There are probably people that know how to make scenes much better than me.

 

[lfe]

lfe updated Soundtrack audio sync with a new update entry:

bug fix

There is a feature that was broken that is useful for creators.

If you click "stop" on scene animation, this plugin will try and start the audio back up at the right time if you click "start" again. This has been broken since 1.20 and is now fixed.

Thank you @VamTimbo for reporting

Read the rest of this update entry...

 

[lfe]

lfe updated Soundtrack audio sync with a new update entry:

Can set target timescale to replace song in scene

Now you can modify someone elses scene by putting your own song instead of theirs. By experimenting with "Target Timescale" slider you can get motion capture to match a different song a little better.

Small bug fix too. No red error messages if you add this plugin before audio exists in the scene.

Read the rest of this update entry...

 

[KAI]

First of all, thank you so much for this wonderful add-on, LFE!
I’m wondering if this plug-in can be updated to support audio source in subscenes?
I use subscene to swap environment, and audio source needs to be within the subscene so each environment can have sound coming from the correct position within the environment.

 

[pepewigs]

I have a similar question too: can this be made to work with subscene animations?

 

[lfe]

I have a similar question too: can this be made to work with subscene animations?

I bet I can figure out something. I do not know anything about subscenes really. Would you mind describing how I can set up a scene with subscene to cause the plugin to break? Sorry for my ignorance.

 

[pepewigs]

I bet I can figure out something. I do not know anything about subscenes really. Would you mind describing how I can set up a scene with subscene to cause the plugin to break? Sorry for my ignorance.

I'm certain there are more use cases when it comes to combining animations across different scenes, but for me, I add entire animations into a subscene which I can then modify as a whole, like rotating it. For example, Vamtimbo's mocaps can be added into a subscene and the subscene can then be rotated on its axis. The problem with doing this is that the main animation has to copied to the subscene animation, which then breaks functionality with the audio sync plugin since it only looks at the main animation currently.