Plugins + Scripts koboldlink

[DEADMAN2000]

any tips on better settings , got sillero api working for tts but it refuses to launch with cuda gpu only cpu and is slow , and koboldcpp is also slow , after a couple of responces the character starts to jitter and vam ui becomes really messud up like its moving away very weird

using this in a .bat for tts :
python server.py --cuda --enable-modules=silero-tts,summarize
, using --cuda device to force gpu crashes it

 

[DEADMAN2000]

also keep getting this

<Truncated>

!> Kobold result upload error_: The remote server returned an error: (500) Internal Server Error.

 

[bot1789]

any tips on better settings , got sillero api working for tts but it refuses to launch with cuda gpu only cpu and is slow , and koboldcpp is also slow , after a couple of responces the character starts to jitter and vam ui becomes really messud up like its moving away very weird

using this in a .bat for tts :
python server.py --cuda --enable-modules=silero-tts,summarize
, using --cuda device to force gpu crashes it

Thank you for feedback.
"character starts to jitter and vam ui becomes really messud"
I know about this problem. I sometimes have this glitch too. It's due to an error in processing the output TTS audio file by my plugin. This glitch is more likely to occur when the PC is under heavy load. I will try to fix it.
For now you can try the following:
- Run VaM and Koboldcpp on different computers (see “LAN connection” and “cloudflare tunnel” sections in the plugin overview); this helps, as the probability of crashing seems to depend on the PC load;
- Increase the "Audio playback delay, s" (bigger delay may help);
- Turn off the "SpeechOn" toggle. Then TTS will not work, but this glitch will not occur;
- If your TTS server supports audio playback (SillyTavern Extras unfortunately does not), you can send its audio output to VaM Person Head Audio source using a virtual cable software (it is for a case when "SpeechOn" is off).

I haven't had any problems with Silero yet.
I just use the following instruction:

call python server.py --enable-modules=classify,silero-tts

What is your gpu model?

 

[bot1789]

also keep getting this

<Truncated>

!> Kobold result upload error_: The remote server returned an error: (500) Internal Server Error.

There are probably prohibited characters in the prompt or TTS output. Can you share your prompt (including memory and author's note) that is sent to Kobold?

 

[DEADMAN2000]

used basic questions no nsfw , with wizaed 3gb model , with Kobold ui it works great no issues or that error and tts also works well , in vam after a couple of responces i get the error and have to close and restart Kobold after a couple more error , playing with 4080 rtx 16 gb vram

 

[bot1789]

used basic questions no nsfw , with wizaed 3gb model , with Kobold ui it works great no issues or that error and tts also works well , in vam after a couple of responces i get the error and have to close and restart Kobold after a couple more error , playing with 4080 rtx 16 gb vram

Oh course there is no nswf filter in my plugin : )
I meant that kobolcpp server cannot accept some special characters (for example, certain types of brackets). The Kobold Lite browser app replaces them with acceptable characters. My plugin also replaces them, but maybe I just have not included the full list of the problematic characters yet.

I also use NVIDIA (GeForce GT 730).

About SillyTavern Extras failing to launch with a CUDA GPU, google says that it maybe because of an issue with the CUDA installation or configuration. Maybe not all modules installed correctly or something like this. I also recently had troubles during installing SillyTavern Extras as this software has been discontinued and its module requirements are not up-to-date.

 

[DEADMAN2000]

after more testing the error happens only with SillyTavern Extras , with spqrs tool no errors it works correctly

 

[bot1789]

after more testing the error happens only with SillyTavern Extras , with spqrs tool no errors it works correctly

Can you please clarify which error occurs only with SillyTavern Extras? The character jitter and messy ui, or another one?

 

[DEADMAN2000]

sorry meant this , with spqr it dosent happen , might be fixed if you add support for the Kobold built in tts
<Truncated>

!> Kobold result upload error_: The remote server returned an error: (500) Internal Server Error.

 

[DEADMAN2000]

a good addition for a future update is presets for different characters built in the ui like 5 slots customizable each with a different tts voice