Excellent work! This is prototype is really promising for bringing an extra level of immersion to VaM.
Do you envision using this framework as a way "bootstrap" a new environment to bring it to life with 2 partners and provide a way to position your mocaps around the room?
Eventually, it would be awesome if there were something like category-specific anchor points in your framework that could be moved around so we could move mocaps from your various categories to where they fit in our own environments.
For example, I'd love to be able to load up some new room and immediately be able to bootstrap it with all of your mocaps in a way that fits the room. Say the new room has 1) a bed somewhere, 2) a chair somewhere, 3) an open floorspace somewhere, and 4) a place for a pole. Then if I upload your framework, I could just say "Meet me at the bed" and when I see that the models are floating in some imaginary bed that doesn't match with my environment, all I'd need to do is drag the "bed mocaps anchor point" over until the actors are comfortably centered on the bed. Same workflow could work to get them to move to the right places on the chairs, the ho tub, floors, (table?), and wherever else.
Again, great work and thanks for being a pioneer!