Plugins + Scripts HotMic + Moanitor + ChatterBoxes

HotMic + Moanitor + ChatterBoxes​

Voice Analysis & Speech Recognition Suite​

HotMic and Moanitor work together to bring voice interaction into VaM.

Instead of relying on simple keyword matching, the system analyzes what you said, how you said it, and how intensely you said it, allowing scenes and plugins to respond in more natural and dynamic ways. HotMic handles microphone analysis and audio streaming. Moanitor handles speech recognition, phrase matching, synonyms, and trigger execution. Together, they create a flexible foundation for voice-controlled experiences!

I aimed to bring something different and specifically for MY SCENE'S NEEDS! So, give all of them a try-- Maybe HotMic+Moanitor is best for you, or maybe it's not! Huzzah!

MOANITOR NEEDS A BACKGROUND PYTHON WINDOW RUNNING LOCALLY IN ORDER TO WORK PROPER.
THIS ALSO WILL NEED AN INTERNET CONNECTION TO DOWNLOAD VOSK AND THE APPOPRIATE HELPER LIBRARIES THE FIRST TIME YOU RUN IT.
SUBSEQUENT USE OF THE PLUGIN CAN BE OFFLINE.

PLEASE READ THE "README.TXT" FILE INSIDE OF THE "EXTERNAL" FOLDER PACKAGED INSIDE OF THIS VAR.

These videos are Old, but still stand to show you the SIMPLE ways to use the plugins-- scroll down to the ChatterBoxes segment to REALLY see what they can do!

---

HotMic​

HotMic listens to your microphone and transforms raw audio into useful information regarding input levels. Rather than simply checking if your microphone is loud enough, it categorizes speech into configurable intensity levels that can be used throughout VaM.

What It Does​

• Detects microphone activity in real time
• Converts loudness into named intensity levels
• Streams audio to compatible plugins (Moanitor)
• Fires triggers based on speaking intensity
• Supports calibration for different microphones
• Provides in-world monitoring and controls

Intensity Levels​

HotMic converts your voice into configurable levels:

• Silence
• Whisper
• Talk
• Loud
• Max
• (Or make your own!)

Each threshold can be calibrated using your own voice, allowing the system to adapt to different microphones and speaking styles.

Audio Analysis​

• Volume-based detection
• Optional frequency-spectrum analysis with Bass / Mid / Treble awareness and Improved whisper detection
• Smarter speech vs ambient-noise discrimination
• Faster speech and silence detection

Trigger System​

Each intensity level can trigger independent actions.

VR-Friendly Controls​

• In-world status panel
• Live audio meter
• Compact tray-button mode
• Reduced need to open plugin UI (once you're all set up, mainly-- there's a few things you can't do on 3D panel)

Configuration​

• Save and load settings
• Portable JSON configuration files
• Calibration profiles
• Threshold presets

---

Moanitor​

Moanitor provides local speech recognition and phrase-based scene control. Built around a local Vosk server, Moanitor focuses on reliability, speed, and flexibility without requiring cloud services or API keys. It directly links with HotMic to take in to account audio levels as well as phrasing.

What It Does​

• Recognizes spoken phrases offline
• Fires VaM triggers from speech
• Supports synonyms and alternate wording
• Uses loudness-aware phrase matching via HotMic
• Organizes large phrase libraries through groups and filtering and handy UI

Semantic-Inspired Phrase Matching​

While Moanitor no longer relies on a language model, it still supports flexible speech recognition through:

• Global synonym dictionaries
• Per-phrase synonym lists
• Multiple phrases per "Phrase"
• Word boosting
• Match-any-word-order options

This all allows commands to feel more natural without requiring exact wording, and without needing a laggy and big LLM.

Phrase × Loudness Matrix​

One phrase can perform different actions depending on how it is spoken via HotMic's inclusion.


Example: "Go Faster"

• Whisper → Small speed increase
• Talk → Moderate speed increase
• Shout → Maximum speed increase

The same words can produce entirely different results based on delivery.

Matrix Groups​

Large projects can quickly become difficult to manage. Matrix Groups allow:

• Phrase organization
• Filtering
• Reordering
• Faster navigation
• Direct jumping to triggers and phrases

Useful for projects containing trillions of phrases.

Reliability Systems​

• Automatic Vosk reconnection
• Connection status monitoring
• In-world status indicators
• Streaming mode verification
• Improved error handling

Configuration​

• Save/load phrase libraries
• Save/load synonym dictionaries
• Save/load word boosts
• Portable JSON configuration files

Requirements​

HotMic​

• Functional microphone / Windows audio input device

Moanitor

• HotMic
• Local Vosk server (installer included!)

Recommended​

• A willingness to read the included README.txt in the "External" folder. Please.

---

ChatterBoxes​

ChatterBoxes is a semi-smart, locally-run dialogue and conversation system built on top of HotMic + Moanitor, with optional integration with Weaver. It lets you create sprawling, branching conversations for one, two, or more speakers—complete with voice interaction (from Moanitor), interruptions, audio, triggers, variables, and conditional responses. Instead of manually wiring together dozens of triggers and hoping everything lines up, you build your conversation as a visual node-based dialogue tree.

Dialogue Trees​

• Create branching conversations with multiple inputs and outputs
• Define dialogue and responses per node and pipe
• Connect nodes into complex conversation paths
• Use Moanitor's speech recognition to determine which path the conversation takes
• Check and set Weaver variables from within dialogue
• Trigger VaM actions and scene logic directly from conversation nodes

This means conversations can actually change the state of your scene based on what the user says or does.

Audio & Dialogue​

Import dialogue audio and assign it directly to conversation nodes.

• Fuzzy-search imported audio
• Preview audio directly from the editor

• Trim dead air from the beginning and end
• Define dialogue Markers for natural resuming
• Define Jump Zones to skip sections when interrupted
• Easily preview individual Zones and Markers

This allows a character to be interrupted naturally without simply restarting their entire line. If someone interrupts during an important part of a sentence, ChatterBoxes can resume from the nearest appropriate marker. If they're interrupted during a section you've marked as skippable, it can jump past it entirely.

Interruption System​

Define exactly how each conversation node behaves when interrupted.


You can control:

• What constitutes an interruption
• Specific phrases that cause an interruption
• Microphone intensity requirements via HotMic
• How long the speaker pauses before continuing
• Vocal ticks / stims when interrupted or resuming
• Whether a particular node can be interrupted at all

Audio Groups​

Create reusable groups of sounds with their own behavior.

• Assign different audio output sources
• Configure group cooldowns
• Override cooldown behavior per individual sound
• Random or Round Robin playback
• Allow groups to loop continuously
• Trigger groups from ChatterBoxes
• Trigger groups externally from other VaM systems

This can be used for small vocal reactions, stims, ambient sounds, or basically any collection of audio you want to manage together.

Weaver Integration​

ChatterBoxes can communicate directly with Weaver. (And this will be built out more!)

• Check Weaver variables before continuing
• Set Weaver variables from dialogue
• Build conversations that influence your state machine

This allows dialogue to become part of the scene's actual logic rather than simply being something that plays on top of it.

HotMic + Moanitor Integration​

ChatterBoxes is designed to work alongside the voice systems. HotMic provides microphone intensity and audio streaming, Moanitor provides local speech recognition and phrase matching. ChatterBoxes uses both to determine what you said and how you said it, allowing conversations to react differently to whispers, normal speech, shouting, interruptions, and specific phrases.

What It Can Do​

• Branching voice conversations
• Multiple speakers
• Conditional dialogue
• Player responses
• Interruptible dialogue
• Audio-driven conversations
• Weaver state integration
• Voice-controlled scene progression
• Trigger-based responses
• Reusable sound groups
• Natural dialogue resuming

ChatterBoxes is intended to be a building block for interactive scenes, rather than simply another dialogue box. You build the conversation. ChatterBoxes handles the messy bits.

---

One Last Thing​

Technically these plugins are designed to work together, but HotMic can also be used independently.
Use HotMic if you simply need microphone analysis and intensity-based triggers.
Use both together if you want scenes that can listen, interpret, and react to your voice.

Feedback & Iteration
This system is actively evolving. If something breaks, feels unclear, or could be better– say it! The goal is to refine this into something the community can rely on. I know the plugin is a bit... ugly... but the point is usability and to work in the background. Always open to suggestions on improvements!

---

Credits:
If I am ever missing or mis-crediting someone or something please let me know so that I may correct it.

Special thanks to 14mhz, Skynet, MacGruber, and the entire VaM community

---

A little help​

If you want to support what I’m building, even a one-time tip goes a long way and directly helps me keep improving these systems and releasing more scenes. Please see my Patreon for such a display of gratitude.

---

This software and all this technology gives us a space to explore many kinds of fantasies, from simple to surreal, from vanilla to kinky. But it’s essential to remember that what happens here isn’t real, and it isn’t meant to replace the real world. People– no matter who– aren’t objects, and nothing in a digital scene should shape how you talk to, treat, or think about others. This is entertainment, not a model for real relationships.

Enjoy the experience for what it is, but keep your expectations grounded and your connections to real people healthy. Just like with any fantasy media, don’t let it distort what you seek in your actual life or how you understand intimacy, respect, or partnership. Real communication, real care, and real relationships are always worth pursuing– and they exist far beyond the screen.

Talk to someone if you want a bit of guidance. We’re all in this together, mates.