What Quest 3 can do for VAM VR

[Saint66]

I did a mini guide yesterday, check it out:

Guides - Quest 3 Passthrough Recording

Ok, since I shared some Passthrough videos of VAM and Virtual Desktop with the new Meta Quest 3, many people are asking me to write a little guide how to do this. I am bad at explaining and English, but it’s not that difficult so I try 😉 Here’s...

hub.virtamate.com

 

[vamnewbiexx]

Sweet mother of jesus. I preordered quest3 before I even thought about VaM with passthrough. Today was my first serious attempt to have fun and gotta say it was much better than regular VaM VR experience. For anyone interested I was playing this scene (it has "passthrough" UI button and the description how to make it work with VD is in the description of the scene)

Scenes - TryOnMaster

A One Stop Template Showcase that makes use of several fantastic tools, assets, animations and plugins from the VAM community. With this scene, you have the freedom to randomly mix and match your own collection of clothing/hair/pose/appearance...

hub.virtamate.com

Her dancing in my room was more than enough to enjoy it. I took that idea even further and played other scenes with this technique and gotta say I am satified with the results. Sky is the limit.

Now I am thinking about making plugins for myself: quickly disabling/hiding everything what isn't Person or UI to quickly enable MR. Now also I got an idea to create my own room in VaM in terms of only colliders (bed, couch, table) so when she's on collider in VaM scene she is actually going to be on my bed, she is going to stay on my floor and so on.

About that dynamic occlusion I am not sure if it's even going to work in VaM. How is it supposed to work if we are just streaming image from PC? Isn't it going to be flat for quest so it doesn't know if our hands are in front of behind objects? Isn't it the same case just like with hand tracking? I think that dynamic occlusion is only for Quest.

 

[3XVirtual]

Do you also see performance enhancement? for example, do you think scenes load faster?

I'm not seeing a performance enhancement. The only enhancement I really see is a clearer picture. I thought with the higher-resolution displays, it would require more processing power, but everything seems to be the same performance wise.

Streaming the game wirelessly to my Quest 3 using Virtual Desktop, I did notice an improvement. The picture stayed clear with far fewer jitters and dropped frames compared to my Quest 2.

 

[Mel]

Really loving this passthrough on the Quest 3, enjoying a dance while laid in bed. Just need to work out the video settings for saving. it is a bit blurry full screen, but is fine on actual quest.

 

[capta134]

I finally received mine. The graphics are better. The headset is more comfortable. Strangely I don't think Scenes load faster than before.

If VAM creators can create good scenes with mixed reality then VAM definitely takes advantage of Quest 3.

In my opinion, at least for now upgrading from Quest 2 to Quest 3 only because of VAM may not be worth it.

That is only for VAM. For people who play PC VR games, the difference is huge.

 

[capta134]

Really loving this passthrough on the Quest 3, enjoying a dance while laid in bed. Just need to work out the video settings for saving. it is a bit blurry full screen, but is fine on actual quest.

Nice!

 

[capta134]

Let's update this post if you find a scene that uses passthrough.

 

[capta134]

I'm not seeing a performance enhancement. The only enhancement I really see is a clearer picture. I thought with the higher-resolution displays, it would require more processing power, but everything seems to be the same performance wise.

Streaming the game wirelessly to my Quest 3 using Virtual Desktop, I did notice an improvement. The picture stayed clear with far fewer jitters and dropped frames compared to my Quest 2.

I agree with you. Performace-wise Quest 3 is not faster for VAM. I think VAM 1.X old technology is not taking advantage of the latest API used in quest 3.

Clearly, there is a Big performance difference for some PC VR games.

 

[keycode]

Got it. Lens and graphic quality, the sound too, are excellent ... I must just get used to those colors gamma, coming from G2 reverb. Through those "pancakes" I see splendid details on the full wide. It is even quite comfortable (wearing it is without excessive pressure on the face).

Battery drain: a nightmare even using a good cable. I will risk tomorrow with testing a 25Watt ... ? charger (they sell it as a 3 ampère 40W in amazon, kiwi the mark).

edited: never mind... it was the quest battery that was prob. needing a full power charge, then after it keeps power (with wired) without problems for all the time we want to spend playing.

Passthrough is also very nice, but I must still find first some more optimal settings for my standard vam playing. My best surprise was the efficiency of my (relatively old) telecom modem-router (wifi6 with 8 internal antennas) and its unexpected very good sinergy with this quest/virtualDesktop: latency and bit-rate are always ok even with my house quite big walls. It is my first wifi-6 toy-device... and it respects all honest promises.

 

[DarkFantasy]

I spent much of yesterday playing with this and tweaking several scenes I had been working on for release. Damnit! I have hundreds of hours of work to do adding a mixed reality component now. Jesus, this might be worse than heroin. It almost scares me a little! Almost.

The possibilities are endless. It's going to be fun watching all the different implementation approaches and ideas.

 

[BlueHorizon]

Ok, I caved in and ordered the Quest 3, but coming from a Valve Index, can someone give me the tl;dr on how Virtual Desktop works. Do I just buy it from the meta shop and go from there?

 

[Saint66]

Yeah, it has better Wifi, its much more stable with VD now. And since I have a 4090, AV1 codec is such a blessing in latency as well.
Like I said before, the only things I am already missing coming from a Quest Pro is the wearing comfort and the colors and blacks, they are way better on the Pro.

Switching between them in the future for different usecases, I guess...

 

[capta134]

Ok, I caved in and ordered the Quest 3, but coming from a Valve Index, can someone give me the tl;dr on how Virtual Desktop works. Do I just buy it from the meta shop and go from there?

Yes, buy it from the store app inside your quest 3. At this moment if you want to play wireless apps this is the only (good choice). The included Air Link technology still suffers from bugs and performance.

 

[capta134]

I finally received mine. The graphics are better. The headset is more comfortable. Strangely I don't think Scenes load faster than before.

If VAM creators can create good scenes with mixed reality then VAM definitely takes advantage of Quest 3.

In my opinion, at least for now upgrading from Quest 2 to Quest 3 only because of VAM may not be worth it.

That is only for VAM. For people who play PC VR games, the difference is huge.

Update: I was using AirLink to connect when I switched to Virtual Desktop now for VAM the difference of experience between the Quest 2 and Quest 3 is huge.

 

[vertigoeighty]

I used Saint66's setting recommendations and built it in to my TryOnMaster Scene if anyone is interested.

Scenes - TryOnMaster

A One Stop Template Showcase that makes use of several fantastic tools, assets, animations and plugins from the VAM community. With this scene, you have the freedom to randomly mix and match your own collection of clothing/hair/pose/appearance...

hub.virtamate.com

To use it with Virtual Desktop on the Quest, make sure you have the newest version of VD and use the following settings in the streaming tab: Red 98, Green 120, Blue 100, Similarity 5%, Smoothing 0%

Once enabled, click on the Passthrough Mode button in the scene and you should be in business. (Make sure you DL all of the dependencies, the scene does quite a bit)

 

[animetiddyenthusiast]

I disagree.

As you mentioned there is the initial requirement that the app running on your PC to uses the OpenXR runtime. Currently 90% of VR games on PC don't meet this requirement. Based of my own research, I think its unreasonable to say that VAM 1.X will ever work with OXR on Oculus with these features through simple modification, it would only be possible with an upgrade to a newer unity version and Oculus SDK version. Its possible that someone could develop a separate dummy OXR runtime that might be able to run at the same time as VAM and communicates with it using a plugin but that would take a lot of work and probably come with a lot of other drawbacks that might make it not worth it at all.

We haven't seen any PCVR games that do use OpenXR implement these newer features that have been available via link for Q2 and Pro (hand+eye+face tracking, passthrough, movement SDK ect.) even if the games use the features in their standalone counterparts and that's because Meta has greatly exaggerated that these features "work for PCVR" using their own methods.

Passthrough over link had been out for over a year and was completely broken and unusable because it dropped you down to 2 FPS on the headset as soon as you activated it on top of several other issues making it difficult to getting it working at all. You can see on the Oculus forums, devs were reporting the issue and there was no help from anyone at Meta to get it working. I'm not even sure if this has been fixed yet.

https://communityforums.atmeta.com/t5/Unity-VR-Development/Quest-Pro-Passthrough-lag-latency-low-framerate-over-Oculus-Link/

Just take a look at the whole PCVR section of their forums, Meta is not providing any support for these features on PCVR to developers and is clearly not actively working on improving them. I assume this is intentional to push devs and users to make and buy the standalone apps instead where they can take the 30% cut of the revenue from their quest app store.

With all that said, I'm sure Quest 3 will still be an excellent headset for PCVR and VaM because of the new lenses, resolution and decoder. And it will still be possible to use the passthrough via VDs chroma key method although that's far from perfect MR. VD+VAM will likely never work with the dynamic occlusion or room meshing since the headset doesn't get any depth information and the passthrough feed and mesh is never sent to the PC. Its just a shame we wont get to take full advantage of a lot of this more advanced hardware the headset offers.

pt over link performance is fixed, its just still limited to few use cases. I wouldnt take PCVR forums as an indication of anything as they also dont provide much support on the other forums

as for the other stuff those are kinds of things alxr might be able to implement to stand apart from vd

 

[spidaman75]

Really loving this passthrough on the Quest 3, enjoying a dance while laid in bed. Just need to work out the video settings for saving. it is a bit blurry full screen, but is fine on actual quest.

Incredible!

 

[leviathan0999]

I just spent some time playing with VR on my brand new Quest 3. I find every looks a little brighter and crisper, but my favorite part is that Hand Tracking works wirelessly through Virtual Desktop. There's certainly room for improvement: while VaM knows you're using your hands instead of the controllers, it doesn't know how to take hand commands, and while the displayed hands follow your own pretty well, VaM can't translate finger movements into the displayed hands. But you can get face to face with your favorite character and reach out with your hands, and see yourself caressing her, and it's freaking amazing.

 

[keycode]

Yeah, it has better Wifi, its much more stable with VD now. And since I have a 4090, AV1 codec is such a blessing in latency as well.
Like I said before, the only things I am already missing coming from a Quest Pro is the wearing comfort and the colors and blacks, they are way better on the Pro.

Switching between them in the future for different usecases, I guess...

after my first hours I feel totally negative about quest 3 "wearing [dis]comfort" ... (not only) because I must use my glasses (-7 miopy) with that nightmare original face mask_badly "blocked_???" by elastic_torture_elements "pressing" all the headset weight on the most painful temple nerfs, nose bone etc.. I can't imagine wich criminal asshole engineer was undersigning this absurd zukkiniproject. With the reverb I had absolutely no issues for the wearing comfort: maybe they were testing on humans heads and not with zukkiniberg personal goat_girlfriend's skull?

passthrough with vam scenes: virtual desktop method works very very easy and nice (thanks for your dummy proof guide). The only little boring thing is that when we edit/save those streaming/walkthrough setting parameters VD don't let us real time check any resulting effects, in vam, before closing the related VD menu/window. Anyway it was funny to watch mixed r. vam animations in our rooms.
edit: it was so banally easy ... it is possible real-time check/correct camera b. colors with personal parameters settings directly with vam Sally plugin sliders after activating VD passthrough with (your) Saint settings.

 

[Bonobo2]

I recently got a quest 3 that I use in vam by Link, I have the impression that the framerate of the scenes has dropped. I'm getting 18 fps in a simple mocap scene with a single unclothed model and no environment with SSS on and physics off. Before, I remember that the decline wasn't that drastic.Do I need to set up VAM somehow? My requirements are R7 3700X, 32 GB ram, RTX 2070

 

[Saint66]

Ouch, that hurts. Cannot speak about Link (wired or Airlink btw?), but in such a scene I got 120fps via Virtual Desktop.
Ok, my system is much more powerful, but you should not end with 18fps. I got a 2070 S with a i5-9600k before, and even with that I was good over 60fps. Dunno, but I think your CPU might brake things down

 

[Bonobo2]

SO i tried Virtual desktop, I get 10 fps but the result is worse, because by moving your head the video update is slower and everything shakes. Should I get a r75800x 3d?

 

[Saint66]

SO i tried Virtual desktop, I get 10 fps but the result is worse, because by moving your head the video update is slower and everything shakes. Should I get a r75800x 3d?

Virtual Desktop very much relies on your Wifi setup, first make sure its properly setup. Best is to use a dedicated router for your headset.

Discord - A New Way to Chat with Friends & Communities

Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.

discord.gg

Check their discord for more info. I would first check this before spending money on a new CPU

Or post a screenshot of your Virtual Desktop Performance overlay:
Sharing Screenshots of the Performance Overlay
1.) Go into the Settings tab in the Virtual Desktop menu in VR and ensure "copy screenshots to desktop" is enabled.
2.) Navigate to the Streaming tab and enable "Show performance overlay".
3.) Launch your VR game.
4.) Look for numbers that are turning orange.
5.) When you see this, hold the right Oculus button and press either the right or left trigger to take a screenshot.
If the screenshot shortcut does not work, press the Oculus button once and press the camera icon on the Oculus menu to take a screenshot.

 

[BlueHorizon]

Just played around a bit with my fleshlight mount and holy shit it's amazing. It's so easy to align the model right, and the best part is the model covers it so you don't see it. Put on some cycle force and you're set. This used to be such a pain to do in full VR, and it never felt convincing.

All we're missing now is some cock tracking

 

[Bonobo2]

Here the check. My internet configuration it's the one in the photo you posted, networking is good i suppose