ALXR Quest/Pico client v0.12.1 for server v18.5.0 with modified passthrough mask

Other ALXR Quest/Pico client v0.12.1 for server v18.5.0 with modified passthrough mask

Prebuilt client for ALXR, a modified version of the open source VR streamer ALVR that can be used as an alternative to AirLink or Virtual Desktop. ALXR uses chromakey techniques combined with camera passthrough to enable mixed reality experiences blending out the background. The main ALXR branch masks or blends out black pixels which can work with certain lighting conditions but often leads to shadowy areas and darker hair, clothes, or makeup being blended out when used in VAM. This resource is my personal fork that aims to resolve those issues using experimental shaders I designed with the help of other community members here. There may also be some additional tweaks to improve visuals or performance specifically targeting the Quest 2.

As of 9/11/23 this build is up to date with the v0.13 nightly ALXR build and requires the v18.5.0 server



You can view an excellent guide on setting up the VAM side of things as well as example footage here


My only notes are that while the color listed there is accurate for current build (100, 129, 100), the image is not up to date so just be careful of that. I also recommend playing with colored ambient lights to adjust visibility. Reds and purples will stand out best and do well as an addition to a 2-3 point light rig with direct white lighting

am leaving my writeup available below if you wish but I think that guide will more than suffice. Have fun, stay hydrated, and lmk if you have feedback










Activate passthrough by holding the system menu key to bring up steamvr and pressing A or B on your right controller to activate blend or mask mode. You can use this with any VR game but few support it as well as VAM. I recommend getting a camera background color plugin from Sally and removing everything but the characters from your scene.

Blend mode still blends out black but does so more precisely. I recommend adding some red or pink ambient light to your scene or cranking up direct lighting to avoid transparency. I plan to also add a mode that works the same but caps at less than 100% opacity so this can be used during menus or when initially loading a scene if you prefer to see your surroundings.

Mask mode uses perceptual color matching techniques to compare the scene color with a predefined key using a more precise color space than RGB. You can set your RGB background to 98, 120, 100 but you'll notice that complete blending is still possible when altering the hue and an additional set of close colors will only partially blend out the background. I recommend using a slightly green hue but you have a bit of range. If the lighting is good you should not be able to see any outlines on your character and you shouldn't have issues with cosmetics or features being blended out. Simply adjust your hue if that is an issue


Be aware that I cannot offer much support, but please report any issues you run into and feel free to make suggestions. As stated earlier this is a culmination of effort from multiple other community members as well. You can view a relevant thread for more technical discussion and steps to build from source yourself in the original description I left below.













Original desc:


Package contains both Pico v4 and Quest versions. Just install the appropriate one or go to History tab to download your preferred version individually

modified version of ALXR client following instructions from this thread. Set scene background to 220,220,240. Should be identical in function to the one linked in the thread but this is uses the newest build that allowed for a small server upgrade from 18.4 to 18.5. Download the server here

.apk is packaged inside a .zip. the hub will probably turn it into a .var but it should unpack no problem. Delete old version and sideload with sidequest
Author
animetiddyenthusiast
Downloads
4,823
Views
13,284
Packages
1
Total Size
3.33 MB
Version
14.1
First release
Last update
Rating
4.82 star(s) 11 ratings

Latest updates

  1. The End?

    EDIT: I have decided to continue work on this project at least until reaching a specific...
  2. Last update for a while, quest only

    Version parity with my client since I'll be unable to work on this for a week or two. should be...
  3. New plugin available on the hub that automates AR scene edits

    Get this plugin right now...

Latest reviews

Works perfectly on Pico 4
Upvote 0
THANK YOU for doing all the hard stuff.
Upvote 0
seems great,but it doesnt work on my pico4,i cant even start the pico4 alxr client, looks like it crashed
Upvote 0
Works on Pico 4, amazing stuff!!
Upvote 0
Mind blowing. What a time to be alive.
Upvote 0
Another great game changer in this Plugin Renaissance Era!
VaM2 who?
Upvote 0
Congratulations, nice job, it's really looking very good, however the version of Saturday at 6:35 AM is much less selective and this is causing some flaws, especially if slightly dark hair or shadows are used in the highlights, I think that if Being able to do something between the version of Saturday and the version of Friday will be perfect. Great job man.
A
animetiddyenthusiast
yeah not much to be done about that aspect for blend mode. you can set up UIassist plugin to change their haircolor automatically or try use some colored ambient light as the shader compares to black in both value and color. Mask mode should be exactly the same as before so if anything looks different to you that would be caused by the main branch changes I merged in
Upvote 0
Thanks to this and other tools VaM in passthrough keeps getting better and better. Looking forward for all Pico 4 updates.
Thanks for sharing
Upvote 0
I used the previous version quite a lot so, Thank you very much for the update!
Can't wait to try it =)
Upvote 0
I used Pico 4 and successfully connected to the computer, but I couldn't use the trigger button in Steam VR, so I couldn't do anything.
A
animetiddyenthusiast
odd, no clue why
Upvote 0
Back
Top Bottom