Log in
Register
  • Hi Guest!

    We are extremely excited to announce the release of our first Beta1.1 and the first release of our Public AddonKit!
    To participate in the Beta, a subscription to the Entertainer or Creator Tier is required. For access to the Public AddonKit you must be a Creator tier member. Once subscribed, download instructions can be found here.

    Click here for information and guides regarding the VaM2 beta. Join our Discord server for more announcements and community discussion about VaM2.
  • Hi Guest!

    VaM2 Resource Categories have now been added to the Hub! For information on posting VaM2 resources and details about VaM2 related changes to our Community Forums, please see our official announcement here.
koboldlink

Plugins + Scripts koboldlink

Download [<1 MB]
Overview Updates (19) Reviews (5) History Discussion
bot1789 said:
Hello!
I think I finally fixed this issue in the latest version (v18). At least, I tested it for a while, but this issue didn't reoccur. It seems the problem was that I was trying to play audio in an async request handler, which is not a good idea in Unity (nor is invoking atom triggers in those handlers). This could lead to errors such as "mono.dll caused an Access Violation" and "Read from location XXX caused an access violation". Now I moved the audio playback to the Update() function and that helped.
...I'm not sure how optimal this solution is, although. If anyone knows how to threat it in a correct way, I'd be happy to receive advice 😄
Click to expand...
dunno why but with this update the ui dosent show up and i get this error
!> Exception during plugin script Init: System.InvalidCastException: Cannot cast from source type to destination type.
at KoboldLink.KoboldLink.AtomNameReplace1 (SimpleJSON.JSONClass json_proc) [0x00000] in <filename unknown>:0
at KoboldLink.KoboldLink.Init () [0x00000] in <filename unknown>:0
at MVRPluginManager.CreateScriptController (.MVRPlugin mvrp, DynamicCSharp.ScriptType type) [0x00000] in <filename unknown>:0
!> Exception during LateRestore of plugin#12_KoboldLink.KoboldLink: System.NullReferenceException: Object reference not set to an instance of an object
at KoboldLink.KoboldLink.LateRestoreFromJSON (SimpleJSON.JSONClass jc, Boolean restorePhysical, Boolean restoreAppearance, Boolean setMissingToDefault) [0x00000] in <filename unknown>:0
at Atom.LateRestore (SimpleJSON.JSONClass jc, Boolean restorePhysical, Boolean restoreAppearance, Boolean restoreCore, Boolean isSubSceneRestore, Boolean setMissingToDefault, Boolean isTheSubSceneAtom) [0x00000] in <filename unknown>:0
!> Error during attempt to load assetbundle vecterror.ColorCorrect.1:/Custom/Assets/colorcorrect.assetbundle. Not valid
!> Exception during plugin script Init: System.InvalidCastException: Cannot cast from source type to destination type.
at KoboldLink.KoboldLink.AtomNameReplace1 (SimpleJSON.JSONClass json_proc) [0x00000] in <filename unknown>:0
at KoboldLink.KoboldLink.Init () [0x00000] in <filename unknown>:0
at MVRPluginManager.CreateScriptController (.MVRPlugin mvrp, DynamicCSharp.ScriptType type) [0x00000] in <filename unknown>:0
!> Exception during plugin script Init: System.InvalidCastException: Cannot cast from source type to destination type.
at KoboldLink.KoboldLink.AtomNameReplace1 (SimpleJSON.JSONClass json_proc) [0x00000] in <filename unknown>:0
at KoboldLink.KoboldLink.Init () [0x00000] in <filename unknown>:0
at MVRPluginManager.CreateScriptController (.MVRPlugin mvrp, DynamicCSharp.ScriptType type) [0x00000] in <filename unknown>:0
 
DEADMAN2000 said:
dunno why but with this update the ui dosent show up and i get this error
!> Exception during plugin script Init: System.InvalidCastException: Cannot cast from source type to destination type.
at KoboldLink.KoboldLink.AtomNameReplace1 (SimpleJSON.JSONClass json_proc) [0x00000] in <filename unknown>:0
at KoboldLink.KoboldLink.Init () [0x00000] in <filename unknown>:0
at MVRPluginManager.CreateScriptController (.MVRPlugin mvrp, DynamicCSharp.ScriptType type) [0x00000] in <filename unknown>:0
!> Exception during LateRestore of plugin#12_KoboldLink.KoboldLink: System.NullReferenceException: Object reference not set to an instance of an object
at KoboldLink.KoboldLink.LateRestoreFromJSON (SimpleJSON.JSONClass jc, Boolean restorePhysical, Boolean restoreAppearance, Boolean setMissingToDefault) [0x00000] in <filename unknown>:0
at Atom.LateRestore (SimpleJSON.JSONClass jc, Boolean restorePhysical, Boolean restoreAppearance, Boolean restoreCore, Boolean isSubSceneRestore, Boolean setMissingToDefault, Boolean isTheSubSceneAtom) [0x00000] in <filename unknown>:0
!> Error during attempt to load assetbundle vecterror.ColorCorrect.1:/Custom/Assets/colorcorrect.assetbundle. Not valid
!> Exception during plugin script Init: System.InvalidCastException: Cannot cast from source type to destination type.
at KoboldLink.KoboldLink.AtomNameReplace1 (SimpleJSON.JSONClass json_proc) [0x00000] in <filename unknown>:0
at KoboldLink.KoboldLink.Init () [0x00000] in <filename unknown>:0
at MVRPluginManager.CreateScriptController (.MVRPlugin mvrp, DynamicCSharp.ScriptType type) [0x00000] in <filename unknown>:0
!> Exception during plugin script Init: System.InvalidCastException: Cannot cast from source type to destination type.
at KoboldLink.KoboldLink.AtomNameReplace1 (SimpleJSON.JSONClass json_proc) [0x00000] in <filename unknown>:0
at KoboldLink.KoboldLink.Init () [0x00000] in <filename unknown>:0
at MVRPluginManager.CreateScriptController (.MVRPlugin mvrp, DynamicCSharp.ScriptType type) [0x00000] in <filename unknown>:0
Click to expand...
Thank you for testing it.
This initialization error may be due to the plugin attempting to use configuration files remaining from older versions of the plugin, or because other information from older versions of the plugin remains in the scene.
Can you, please, try deleting all files from the [VaM location]/Custom/PluginData/koboldlink folder and restarting the plugin?
You can also try running the plugin in a new scene that did not use previous versions of the plugin.
 
Last edited:
bot1789 said:
Thank you for testing it.
This initialization error may be due to the plugin attempting to use configuration files remaining from older versions of the plugin, or because other information from older versions of the plugin remains in the scene.
Can you, please, try deleting all files from the [VaM location]/Custom/PluginData/koboldlink folder and restarting the plugin?
You can also try running the plugin in a new scene that did not use previous versions of the plugin.
Click to expand...
thank you its working now no problems
 
Hi. Great asset! But I have a question. Is it possible to use STT with Koboldcpp TTS? I see that Koboldcpp has STT using whisper. But the record mic in VAM plugin UI gives me an error.
 
Battou said:
Hi. Great asset! But I have a question. Is it possible to use STT with Koboldcpp TTS? I see that Koboldcpp has STT using whisper. But the record mic in VAM plugin UI gives me an error.
Click to expand...
Hello!
Thank you for trying it!
Unfortunately, in the current version (v18), STT (speech-to-text) only works with TextAudioTool (which also uses Whisper):
github.com

GitHub - Musa-step/koboldlink-tools: KoboldLinkTools project repository.

KoboldLinkTools project repository. Contribute to Musa-step/koboldlink-tools development by creating an account on GitHub.
github.com github.com
But thanks for your suggestion, I will try to add Koboldcpp STT support in the next version.
 
Function calling is not working for me for some reason.
First I get an error in Koboldcpp:
Code: 
Body Err: b'{"max_context_length": 4096, "max_length": 18,"memory":"", "prompt":"\\n### Instruction:\\nGiven the dialog between Master and Lizi, determine the best available function from the list that Lizi should execute.If none of the available functions match, choose \'fn.noop()\'. Your response should only contain the name of the function and nothing else.\n\nBased on the following, determine which function to call from the list:\n\nMaster:\nPlease sit on your knees\nLizi:\nI like that Master it feels so nic\n\nThe list of functions available to Lizi:\n- \'fn.noop()\': None of the other functions matching the reply\n- \'fn.sitdown1()\': when Master asks Lizi to sit on her knees\n\n\nPlease do not introduce your own new functions. Select only functions from the list above.\n\n\\n### Response:\\n", "quiet":"true", "stop_sequence":["### Instruction:", "### Response:"], "rep_pen": 1.1, "rep_pen_range": 256, "rep_pen_slope": 1, "temperature": 0.5, "tfs": 1, "top_a": 0, "top_k": 100, "top_p": 0.9, "typical": 1, "function_calling":"true"}'

Second according to this output in Kobold it see my button fn.sitdown1() with a condition "when Master asks Lizi to sit on her knees", and I have input exactly that "Please sit on your knees", but it says that this function is not matching the reply.

How am I supposed to use this to activate actions with prompts?
 
Battou said:
Function calling is not working for me for some reason.
First I get an error in Koboldcpp:
Code: 
Body Err: b'{"max_context_length": 4096, "max_length": 18,"memory":"", "prompt":"\\n### Instruction:\\nGiven the dialog between Master and Lizi, determine the best available function from the list that Lizi should execute.If none of the available functions match, choose \'fn.noop()\'. Your response should only contain the name of the function and nothing else.\n\nBased on the following, determine which function to call from the list:\n\nMaster:\nPlease sit on your knees\nLizi:\nI like that Master it feels so nic\n\nThe list of functions available to Lizi:\n- \'fn.noop()\': None of the other functions matching the reply\n- \'fn.sitdown1()\': when Master asks Lizi to sit on her knees\n\n\nPlease do not introduce your own new functions. Select only functions from the list above.\n\n\\n### Response:\\n", "quiet":"true", "stop_sequence":["### Instruction:", "### Response:"], "rep_pen": 1.1, "rep_pen_range": 256, "rep_pen_slope": 1, "temperature": 0.5, "tfs": 1, "top_a": 0, "top_k": 100, "top_p": 0.9, "typical": 1, "function_calling":"true"}'

Second according to this output in Kobold it see my button fn.sitdown1() with a condition "when Master asks Lizi to sit on her knees", and I have input exactly that "Please sit on your knees", but it says that this function is not matching the reply.

How am I supposed to use this to activate actions with prompts?
Click to expand...
Thank you for testing it and reporting the error.
It looks like it is my mistake. I only tested this part with the horde. It seems the local koboldcpp does not accept the single quote character ( ' ) in the prompt, while the horde is okay with this prompt.
I think I should test any new functionality with both the local kobold and the horde.
I will fix it soon.
 
bot1789 updated koboldlink with a new update entry:

version 19

Fixes:
- Fixed an initialization error that occurred when using an incomplete preferences file (for example, one created by an older version of the plugin). If the pref.json file is incomplete, preferences that are not defined in it will be set to default values, and messages about it will appear in the log;
- Fixed inability to use function calling with a local koboldcpp;
- Other stability and text processing fixes.
Click to expand...

Read the rest of this update entry...
 
Battou said:
Function calling is not working for me for some reason.
First I get an error in Koboldcpp:
Code: 
Body Err: b'{"max_context_length": 4096, "max_length": 18,"memory":"", "prompt":"\\n### Instruction:\\nGiven the dialog between Master and Lizi, determine the best available function from the list that Lizi should execute.If none of the available functions match, choose \'fn.noop()\'. Your response should only contain the name of the function and nothing else.\n\nBased on the following, determine which function to call from the list:\n\nMaster:\nPlease sit on your knees\nLizi:\nI like that Master it feels so nic\n\nThe list of functions available to Lizi:\n- \'fn.noop()\': None of the other functions matching the reply\n- \'fn.sitdown1()\': when Master asks Lizi to sit on her knees\n\n\nPlease do not introduce your own new functions. Select only functions from the list above.\n\n\\n### Response:\\n", "quiet":"true", "stop_sequence":["### Instruction:", "### Response:"], "rep_pen": 1.1, "rep_pen_range": 256, "rep_pen_slope": 1, "temperature": 0.5, "tfs": 1, "top_a": 0, "top_k": 100, "top_p": 0.9, "typical": 1, "function_calling":"true"}'

Second according to this output in Kobold it see my button fn.sitdown1() with a condition "when Master asks Lizi to sit on her knees", and I have input exactly that "Please sit on your knees", but it says that this function is not matching the reply.

How am I supposed to use this to activate actions with prompts?
Click to expand...
I think I have managed to fix this bug in the latest version. Although the problem was not with single quote symbols (koboldcpp seems to have no problem with those), but some variants of line breaks. I just forgot to replace them with acceptable symbols in some cases.
 
bot1789 said:
I think I have managed to fix this bug in the latest version. Although the problem was not with single quote symbols (koboldcpp seems to have no problem with those), but some variants of line breaks. I just forgot to replace them with acceptable symbols in some cases.
Click to expand...
Great! Thank you! Will go and try it out.) And thanks for a great asset for VaM!
 
Battou said:
Great! Thank you! Will go and try it out.) And thanks for a great asset for VaM!
Click to expand...
Thank you for using the plugin. If the error is not fixed or if you find any other errors, please let me know.
 
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
) . What do I do? How do I fix this?
 
Tohnbon said:
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
) . What do I do? How do I fix this?
Click to expand...
Some problem with the Koboldcpp server.
This error typically occurs when Koboldcpp is not running at the specified URL. Ensure the KoboldCpp with an LLM is running.
Are you using a local KoboldCPP server (you need to use the URL http://localhost:5001/api/v1/generate to connect to it)?
 
bot1789 said:
Some problem with the Koboldcpp server.
This error typically occurs when Koboldcpp is not running at the specified URL. Ensure the KoboldCpp with an LLM is running.
Are you using a local KoboldCPP server (you need to use the URL http://localhost:5001/api/v1/generate to connect to it)?
Click to expand...

!> No entry AudiofilePath_ST in pref.json; setting default value: SillyTavernExtras/
!> No entry max_context_length in pref.json; setting default value: 2048
!> No entry max_length in pref.json; setting default value: 100
!> No entry FunctionCalling_max_length in pref.json; setting default value: 18
!> No entry KoboldURL2 in pref.json; setting default value: http://127.0.0.1:7069/horde_generate
!> No entry AILaunchTriggersOn in pref.json; setting default value: true
!> No entry EventPromptOn in pref.json; setting default value: false
!> No entry SearchWord_send in pref.json; setting default value: $AI_send
!> No entry SearchWord_uitext in pref.json; setting default value: AI_text
!> No entry SearchWord_uitext2 in pref.json; setting default value: AI_resp
!> No entry SearchWord_sent_uitext in pref.json; setting default value: $AI_senti
!> No entry SearchWord_STT_result in pref.json; setting default value: $AI_STT
!> No entry VoiceName_SAPI in pref.json; setting default value: Microsoft Zira Desktop - English (United States)
!> No entry VoiceName_ST_Silero in pref.json; setting default value: en_12
!> No entry VoiceName_Koboldcpp in pref.json; setting default value: cheery
!> No entry SpeechOn in pref.json; setting default value: true
!> No entry SpeechBubbleOn in pref.json; setting default value: true
!> No entry RemoveIncompleteSentenceOn in pref.json; setting default value: true
!> No entry CustomTriggerOn in pref.json; setting default value: false
!> No entry SentimentHandlingOn in pref.json; setting default value: false
!> No entry SpeechBubbleDuration, s in pref.json; setting default value: 30
!> No entry LipSynchOn in pref.json; setting default value: true
!> No entry LipSynchVolMultiplier in pref.json; setting default value: 3
!> No entry TextAudioToolSTT_URL in pref.json; setting default value: http://127.0.0.1:7069/listen-whisper
!> No entry KoboldSTT_URL in pref.json; setting default value: http://localhost:5001/api/extra/transcribe
!> No entry default_STT_provider in pref.json; setting default value: TextAudioTool
!> No entry default_TTS_provider in pref.json; setting default value: TextAudioTool
!> No entry TextAudioTool_URL in pref.json; setting default value: http://127.0.0.1:7069/speak
!> No entry SillyTavernExtras_URL in pref.json; setting default value: http://localhost:5100/api/tts/generate
!> No entry KoboldTTS_URL in pref.json; setting default value: http://localhost:5001/api/extra/tts
!> No entry Classify_URL in pref.json; setting default value: http://127.0.0.1:7069/classify
!> No entry Classify_URL_ST in pref.json; setting default value: http://localhost:5100/api/classify
!> No entry default_Classify_provider in pref.json; setting default value: TextAudioTool
!> No entry Classify_URL in pref.json; setting default value: http://127.0.0.1:7069/classify
!> No entry FunctionCallingOn in pref.json; setting default value: false
!> No entry Function calling chatdepth in pref.json; setting default value: 1
!> No entry Function calling delay in pref.json; setting default value: 0
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
)
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
)
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
)
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
)
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
)
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
)
!> Kobold result upload error_: Error: ConnectFailure (A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
)
!> Kobold result upload error_: Error: ConnectFailure (A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
)
!> Kobold result upload error_: Error: ConnectFailure (A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
)
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
)
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
)
!> Kobold result upload error_: Error: ConnectFailure (No connection could be made because the target machine actively refused it.
) I tried what you said, plus I played around with with the other connection options like horde. With same results. I also doubled checked my firewall, but there's no record in the logs that it blocked anything. I'd love to try this out anything else I can do to get it work Ty for your time.
 
Tohnbon said:
I tried what you said, plus I played around with with the other connection options like horde. With same results. I also doubled checked my firewall, but there's no record in the logs that it blocked anything. I'd love to try this out anything else I can do to get it work Ty for your time.
Click to expand...

I'm feel sad that the plugin isn't working for you, although I still cannot figure out the reason.
"No entry..." errors are usually caused by an old pref.json file (from a previous version of the plugin) in the [VAM Root Directory]\Custom\PluginData\koboldlink\files folder. Try deleting this file, and the plugin will write a new, compatible file when you reload it.
Please note that the Horde option will only work when using the koboldlink-tools proxy (please read the plugin description).

By the way, what version of koboldcpp and which LLM are you using? Are you running it on the same PC as VaM? Does it respond to requests from the Kobold Lite browser app?
 
You must log in or register to reply here.
Back
Top Bottom