• Hello Guest!

    We have recently updated our Site Policies regarding the use of Non Commercial content within Paid Content posts. Please read the new policy here.

    An offical announcement about this new policy can be read on our Discord.

    ~The VaMHub Moderation Team
  • Hello Guest!

    VaMHuB! Has been updated!

    Please see this thread for more information.

How to use Passthrough in VAM (VR Mixed Reality)

Guides How to use Passthrough in VAM (VR Mixed Reality) 1.7

Disclaimer: I did not invent these methods, credits go to the owners who discovered them (Full credits at bottom). I only compiled them all into an updated list here

Guide last updated: September 2023, big thanks to ALXR dev Korejan
This guide will be separated into 2 parts: Basic & Advanced
*Difficulty level: 4/5*

What is this?
Imagine using VAM in real life, with just your models & you, anywhere, with Mixed Reality. The immersion is pretty great!
*This is a WIRELESS guide, if you want to use it WIRED skip to the bottom
V1B.gif
V3B.gif

V7B.gif
V6B.gif


What will I need?
- A VR headset with passthrough that is supported by ALXR
Fully Supported headsets:
Quest 2, Quest Pro, Vive Focus 3, XR Elite, Pico Neo 3, Pico 4
- ALXR Server Client (Nightly build) + APK in your headset
- A scene in VAM with a plain background

Basic Passthrough (Black background)
1) Install the ALXR Client (v0.13.0 nightly 2023.09.07 is a tested working version) on your PC. To install, download alvr_server_windows.zip and follow the install steps.
Download: https://github.com/korejan/ALXR-nightly/releases
Screenshot 2023-08-22 141633.jpg


To clarify, this is ALXR (nightly build), not ALVR (mainline build), even though it is called ALVR server
*Additional note: Feel free to use the more updated versions, ALXR is constantly updating. However, not all newer versions might 100% work

FAQ: How to set up ALXR
FAQ: The difference between ALVR & ALXR:
ALXR supports more features in development such as Mixed Reality

2) Sideload the ALXR apk into your headset. Pick the correct APK for your headset.
eg: Quest will use alxr-client-quest.apk
Download: https://github.com/korejan/ALXR-nightly/releases

FAQ: How to sideload APKs onto your headset

3) Set up ALXR on your PC & headset.

FAQ: How to set up ALVR/ALXR

4)
i. Launch ALVR Launcher.exe & SteamVR on your PC
ii. Launch the ALXR apk from your Headset
iii. Launch VAM (VR Version) on your PC
1692772262704.png
What your ALVR Launcher should look like after set up

*When you launch ALXR on your headset, it will have a green background, then load into SteamVR. This is the correct sequence if you followed the steps correctly (Launch on PC > Launch on Headset)

iv. When you're in VAM, pick a scene with a Black background. (Default scene works for testing)

v. Press the Left Menu + Right B button to enable full passthrough to Black color. Press again to disable.
2.jpg

Press the Left Menu + Right A button to enable half transparent passthrough.
3.jpg


That's it for the Basics. You will see some clipping as the blacks may go through. Try using bright colors on your model (hair, clothes, etc)
You can also turn off shadows from light sources to make it better.

Advanced Passthrough (Custom Color background)
1) Continued from Basics, we will now use custom color backgrounds to make the chroma keying more accurate. (Long story short, it will look cleaner)
*Skip to step 6 if you don't want to use a built-in color & want to customize your own color background

2) Download the VAM plugin Camera Background Color Plugin by Sally Whitemane
(Alternative: Camera Background Color Session Plugin that stays for the whole session)

3) Sideload an updated ALXR APK onto your headset that changes the background to a Modified color instead of Black. (Don't forget to delete the old ALXR APK from your headset)
Updated APK for ALXR with passthrough by animetiddyenthusiast

4) Launch the same steps as Step 4 in Basic. When in VAM, launch the Camera Background plugin in Session Plugins. Pick green, or to be accurate the colors are: 98, 129, 100

Note: You will still have some color outline around the character. It isn't perfected yet.

1692686057691.png


5) Press the Left Menu + Right B button to enable full passthrough to color. Tap again to disable.

You're done! Enjoy passthrough VAM wherever you are. It really helps to the immersion for me.

6) To customize even further: How to customize any color you want for passthrough, a walkthrough by krch

Tips:
- Getting the color key outline can be a bit tricky, move around the color picker until you're happy. It will not be perfect.
- I recommend using JayJayWon's UI assist plugin to get a one-click shortcut to launch Background Changer
- Recommended VAM settings: 8X MSAA, Lighting Pass 4-6
- Recommended ALVR settings: 100 bitrate & above
- Recommended scenes for Passthrough: Scenes from ABC Tits, AlpacaLabs & VamX
- You can technically use this on any scene you like, just remove any background
- If you are having issues, try fixing/reinstalling VAM, make sure to remove all FSR files if you used them
- Optional: You can also set this up wired through ALVR here

Demo video use on a Quest 2:


















Full credits: (Let me know if you don't want to be in it)
Dev of ALXR- Korejan
u/Prestigious_End_1784
Sally Whitemane
krch
Tim
Model by Vectorr
Author
thinoreos
Downloads
111
Views
9,223
First release
Last update
Rating
5.00 star(s) 7 ratings

More resources from thinoreos

Latest updates

  1. 1.7

    Updated with file, note of future versions of ALXR that are always updating
  2. 1.6

    Updated to ALXR 0.13.0
  3. 1.5

    Now using latest version of ALXR's nightly builds

Latest reviews

THIS
Upvote 0
instructions worked perfectly on my pico4. thanks!
Upvote 0
I was thinking I should probably add some of this info on my page but you're doing my work for me 🫡 preciate it boss gonna link to here from my page
Upvote 0
Holy... this is just on fire. Nights are going to be heaven-like.
Upvote 0
Wow. It worked like a charm.
thinoreos
thinoreos
Nice!
Upvote 0
Oh yeah. My night just got more exciting! Really easy to follow. Thanks for taking the time for this.
thinoreos
thinoreos
Glad it worked for you!
Upvote 0
very cool
Upvote 0
Back
Top Bottom