VaM_Physical_AI_from_Mimickit

Plugins + Scripts VaM_Physical_AI_from_Mimickit

Download [<1 MB]
You can now run Physical AI directly in your browser without installing Python, PyTorch, or complex environments!

Launch MimicKit VaM Web

Key Features & Updates:

• In-Browser Execution: Client-side processing using MuJoCo WASM and ONNX Runtime Web.
• Lightweight Windows Bridge: Seamless VaM connection via VaM_Web_Bridge.exe over WebSocket/UDP.
• Full VR Support: Complete HMD and controller tracking with interaction and collision features.

Note: No changes to the existing VaM plugins (.cs) are required.
  • Fixed the "Double Trigger" buttons in the VRhand_mimickit_public.cs UI.
  • Furniture Sync:
Added a feature to synchronize furniture collider shapes, positions, and rotations between VaM and Newton.

  • Updated Pre-trained Model:
Updated the separate pre-trained AI model so that AI characters can track and follow the player. Overall behavior has also been improved.

  • Follow / Stay Toggle:
Added modes to either follow the player or stay at a fixed target position. In Player Follow mode, simple pathfinding is implemented upstream of the policy, allowing the character to avoid furniture while following the player.

  • Agent Orientation Control:
Added a feature to hold the AI character's orientation, allowing it to either face the player or maintain a direction specified by the VR controller.

  • Updated Resource Description:
Updated the resource description and setup instructions to reflect the latest version.
- AI agent now follows the player slowly.

Please note that this update only affects the .py script and model.pt.There are no changes to the VaM plugin (.cs).
The latest files are available on my GitHub repository.

You can see the new following behavior at the end of my latest YouTube Short.
- Added collision to the player's body
- Fixed the rotation of the pelvis control point
Back
Top Bottom