Plugins + Scripts VAMCompanion

Actually, I made it work a while ago, just read u post, I will study the instructions,a lot of new things to learn, it actually listens very very well, takes a lil bit of time for the replies which is fine, for now, hehe, now VAM and the rocket scientist replies don’t match very much….idso there anyway to change that ? The way it replies ? But so far it is amazing what you have done…wish you continue developing it….Thank you very much..!!

delid42 said:

Actually, I made it work a while ago, just read u post, I will study the instructions,a lot of new things to learn, it actually listens very very well, takes a lil bit of time for the replies which is fine, for now, hehe, now VAM and the rocket scientist replies don’t match very much….idso there anyway to change that ? The way it replies ? But so far it is amazing what you have done…wish you continue developing it….Thank you very much..!!

Click to expand...

I think so, yes. In the System Prompt, describe how you want the model to behave in the scene.
Unfortunately, it is difficult to evaluate what may be causing this without knowing what your System Prompt and Role Prompt are. It may also be caused either by the specific LLM model you are using, or by the way the role or System Prompt is written.
I would recommend writing clear behavior rules in the System Prompt and checking how the model’s behavior changes. If possible, please let me know whether this helped and which model you used.
Also, to better understand your problem, you can send me your Role Prompt, System Prompt, and the model you are using in a private message, along with a more detailed description of the issue, so I can try to reproduce it.

Hey, thanks so much for your advice and tips! I'm currently learning about harnesses and have realized that, without even knowing it, I've already put together a very simple one. The AI can already trigger certain actions, but I first have to define them in the plugin and set a trigger word. When the AI types that word in *...*, the trigger is automatically activated the moment the last sentence before the trigger word is spoken. But your approach goes much further—if I understand correctly, the AI can decide for itself what to trigger without any actions being defined in advance. For example, it could automatically. trigger a timeline animation if it feels like the timing is right!? Am I understanding this correctly? Can you tell me what in-game data you send to the AI so it knows what’s happening in the game right now? Or do you do this using images?

Bplus said:

Hey, thanks so much for your advice and tips! I'm currently learning about harnesses and have realized that, without even knowing it, I've already put together a very simple one. The AI can already trigger certain actions, but I first have to define them in the plugin and set a trigger word. When the AI types that word in *...*, the trigger is automatically activated the moment the last sentence before the trigger word is spoken. But your approach goes much further—if I understand correctly, the AI can decide for itself what to trigger without any actions being defined in advance. For example, it could automatically. trigger a timeline animation if it feels like the timing is right!? Am I understanding this correctly? Can you tell me what in-game data you send to the AI so it knows what’s happening in the game right now? Or do you do this using images?

Click to expand...

I think so, yes. In the System Prompt, describe how you want the model to behave in the scene.
Unfortunately, it is difficult to evaluate what may be causing this without knowing what your System Prompt and Role Prompt are. It may also be caused either by the specific LLM model you are using, or by how the role or System Prompt is written.
I would recommend writing clear behavior rules in the System Prompt and checking how the model’s behavior changes. If possible, please let me know whether this helped and which model you used.
Also, to better understand your problem, you can send me your Role Prompt, System Prompt, and the model you are using in a private message, along with a more detailed description of the issue, so I can try to reproduce it.
And to answer your question: yes, my server provides the AI with information about what it can do in the scene on every request. Each time, new screenshots, the full dialogue, and the full available toolset are sent to LM Studio. This includes triggers and my scripts with controls that the AI can use.
The AI itself does not have memory. On every request, you need to show it what it can do and return information about what it has already done. Otherwise, it will forget. An LLM does not have its own memory. It is just a text generator, good or bad. That is why the full context, screenshots, tools, and in-game scripts it can use have to be sent again every time.

Dlesser said:

I think so, yes. In the System Prompt, describe how you want the model to behave in the scene.
Unfortunately, it is difficult to evaluate what may be causing this without knowing what your System Prompt and Role Prompt are. It may also be caused either by the specific LLM model you are using, or by the way the role or System Prompt is written.
I would recommend writing clear behavior rules in the System Prompt and checking how the model’s behavior changes. If possible, please let me know whether this helped and which model you used.
Also, to better understand your problem, you can send me your Role Prompt, System Prompt, and the model you are using in a private message, along with a more detailed description of the issue, so I can try to reproduce it.

Click to expand...

Message Sent / Thank you..!!

check this out a online model with a test interface will that work to the project ?



Voice test interface

MrVR said:

check this out a online model with a test interface will that work to the project ?

View attachment 605430

Voice test interface

HF Realtime Voice - a Hugging Face Space by smolagents

Voice chat over WebSocket against a HF speech-to-speech

huggingface.co

Click to expand...

I’m pretty sure this is not what you need at all. If you can choose a voice from a list, then it looks like the voices are predefined. My setup works differently: the voice is built from a reference WAV file that you provide yourself, and then the model speaks using that sample as the voice reference. Please read the instructions on my page, especially the part explaining where to download the XTTS model.

Error when launching VAMCompanion.2

donkilluminatti said:

View attachment 605708

Error when launching VAMCompanion.2

Click to expand...

Hi! This error happens because the program was not extracted correctly. VAMCompanion1.zip and VAMCompanion2.zip are two parts of the same program.

Please:

1. Download both ZIP files.
2. Extract both ZIP files to the same location so that they merge into one VAMCompanion folder.
3. Do not run the program directly from the ZIP file, and do not extract the two ZIP files into separate folders.
4. Run VAMCompanion.exe from the merged folder.

The folder should look approximately like this:

VAMCompanion\
----VAMCompanion.exe
----_internal\
--------select.pyd
If the error still appears, please check your antivirus or Windows Security quarantine. It may have removed the select.pyd file. You do not need to install Python or the select module separately.

Hi,
it works generally well for me on a lot of differents scenes. I only have an issue where VAM companion always use the same role prompt even with a different one in place and save restart server...something to do with the cache ? where does the role prompt are stocked ? does copy pasting in the role prompt window does that ? should i write directly in it ?

thx for this well done work nonetheless.

captainkatsura said:

Hi,
it works generally well for me on a lot of differents scenes. I only have an issue where VAM companion always use the same role prompt even with a different one in place and save restart server...something to do with the cache ? where does the role prompt are stocked ? does copy pasting in the role prompt window does that ? should i write directly in it ?

thx for this well done work nonetheless.

Click to expand...

If you want to create your own role, you need to enter it in this field. Naturally, you should first delete the existing text, and then you can decide for yourself who the neural network should role-play. It could be a forest fairy, a courtesan, or anyone else you want to interact with. It all depends on your imagination.


But I believe I already explained all of this in the instructions.