Please integrate full Support for Oculus Quest Mixed Reality with Passthrough into VAM

I second this, would definitely love to have this feature integrated. At the moment by using the experimental Guardian stationary passthrough feature you can get a peak at what it looks like by sticking your head just at the guardian boundry. Although the passthrough is black and white it was pretty awesome to see a VAM model sitting my couch :)
 
Thirded if it's possible. I've been playing with poking my head through the guardian too and it's a game-changer. Especially with a seated cow-girl position. Recline your head out of the guardian slightly and the, slightly hazy, model is on your lap in your room.
 
I'm the forth one,and I had already devote myseft to Unity,I will try my best to realize passtrough function.I thinck the camrea passthrough just like a background in VAM.
 
yes please I dont wanna have to build my room in blender and import it XD.
 
This is something that will require actual development to implement in Vam which means its never going to happen as development on 1.x is done and complete.

Best you can hope for is to get it added for 2.x
 
ezgif-1-22ed8f7e9d.gif
 

Attachments

  • ezgif-1-fad2da371c.gif
    ezgif-1-fad2da371c.gif
    48.5 MB · Views: 0
Its hard to even tell its mix media, some looks color, some black and white. I wish you would have looked around your room some.
 
My screenshot was from VAM with passthrough, not Captain Hardcore. Here's a screenshot showing a VAM menu. I'm using an Oculus Quest 2, thus the B&W passthrough. No way around it I'm afraid ...

vampassthrough.PNG
 
test2.gif

Looks better (almost real!) when I make the recorded video greyscale. Is it possible to do this directly in VaM (make everything look greyscale)?
 
How did you get this? Did you use a Quest 2? When I try this using this method (https://ar-porn.com/guide-ar-passthru-porn-on-the-oculus-quest-2/ ) I keep seeing those annoying blue boundary lines. Any tips?
I did use a Quest 2 and the ALXR client sideloaded on my Quest 2 with the ALVR server installed on my PC. You can find detailed instructions that I posted in the below thread:

https://hub.virtamate.com/threads/does-this-quest-2-passthrough-trick-still-work.25728/post-69843
 
Any way to get passthrough working for older wired headset like Rift S? Apart from the fact she would be in your real environment, i'd imagine that you could have nothing else in scene only single girl and single colour background so the framerate would also be improved.
 
Any way to do this on a Quest 2 and Virtual Desktop?

What I can currently do is this:
  • Get on a small bathroom rug.
  • Set your Quest Guardian to Stationary Mode on the rug, step out of it
  • And look back to see her ghost image in your room in the passthrough that creeps in.
And then, in epiTemplateLite
Click "L" on the tablet to turn off the virtual room in this AR mode. It will also switch to lights that follow her indefinitely (hence the "L" for lights).

I want to improve that template scene and further optimize it for AR but I'm happy with Virtual Desktop and don't wanna chase down another rabbit hole with ALXR (if I don't have to). But this current method that I'm using offers only a glimpse of AR.

I'm guessing that if there is a better method for Virtual Desktop, it might require me to add something like the Camera Background Color plugin to the template. So it can go from this to this with a single button:

VR.jpg


AR.jpg


But I haven't found anything better than leaning outside your stationary guardian and looking back so far (for Virtual Desktop). So I cannot experiment.

Any ideas? @Pbpjan15
 
Last edited:
Any way to do this on a Quest 2 and Virtual Desktop?

What I can currently do is this:
  • Get on a small bathroom rug.
  • Set your Quest Guardian to Stationary Mode on the rug, step out of it
  • And look back to see her ghost image in your room in the passthrough that creeps in.
And then, in epiTemplateLite
Click "L" on the tablet to turn off the virtual room in this AR mode. It will also switch to lights that follow her indefinitely (hence the "L" for lights).

I want to improve that template scene and further optimize it for AR but I'm happy with Virtual Desktop and don't wanna chase down another rabbit hole with ALXR (if I don't have to). But this current method that I'm using offers only a glimpse of AR.

I'm guessing that if there is a better method for Virtual Desktop, it might require me to add something like the Camera Background Color plugin to the template. So it can go from this to this with a single button:

View attachment 197204

View attachment 197205

But I haven't found anything better than leaning outside your stationary guardian and looking back so far (for Virtual Desktop). So I cannot experiment.

Any ideas? @Pbpjan15

My thought is if you want to use AR, Virtual Desktop doesn't offer any functionality. You should invest the time and effort into getting ALXR working. I compiled a version of ALXR that uses green for passthrough, so I'd advise using that.
 
My thought is if you want to use AR, Virtual Desktop doesn't offer any functionality. You should invest the time and effort into getting ALXR working. I compiled a version of ALXR that uses green for passthrough, so I'd advise using that.
@Pbpjan15; Thank you! You are the one that managed to compile ALXR-client for Quest 2/Pro; I've tested enjoyed your client and I've been trying for days to compile one with red tones, instead of green/black.. so the outline of the person is better mixed with background. From the discussions I saw @Tankshell referring to https://github.com/korejan/ALVR-Ope.../vulkan_shaders/passthroughMask_frag.glsl#L30 to change the keycolor in Korejan's code. Would you mind point me in the right direction? I'm missing something, code compiles already, but mask color still black.
 
My thought is if you want to use AR, Virtual Desktop doesn't offer any functionality. You should invest the time and effort into getting ALXR working. I compiled a version of ALXR that uses green for passthrough, so I'd advise using that.
Pretty sure I got it working last night. Its tough to get the EXACT key value and similarity value. I used the camera background color plugin...
Am I wrong?
 
Pretty sure I got it working last night. Its tough to get the EXACT key value and similarity value. I used the camera background color plugin...
Am I wrong?
yes, but virtual desktop now has superior passthrough functiom.
 
Back
Top Bottom