um, have you seen voxta? and the ALM plugin? I don't get any credit for plugging this, but it' so awesome, and yes, with my setup, i comfortably run the LLM, VAM and TTS/STT just fine.
Processor 12th Gen Intel(R) Core(TM) i9-12900K 3.20 GHz OC @ 4.99GHz
Installed RAM 64.0 GB (63.7 GB usable)
[USER]@Acid-bubbles[/USER]
and
hub.virtamate.com
@vaan20
running koboldcpp, piper (TTS) and vosk (STT) locally
I run a 13B model and she stays pretty on track, if you crank up the token size and add to the memory as needed
Processor 12th Gen Intel(R) Core(TM) i9-12900K 3.20 GHz OC @ 4.99GHz
Installed RAM 64.0 GB (63.7 GB usable)

and

Action List Manager (ALM) - Plugins + Scripts -
Tired of static scenes? Ready to bring your characters to life? Introducing ActionListManager (ALM), a powerful plugin designed to be the central brain for your VaM characters. ALM transforms your creations from digital puppets into dynamic...

running koboldcpp, piper (TTS) and vosk (STT) locally
I run a 13B model and she stays pretty on track, if you crank up the token size and add to the memory as needed