Sorry for necroing but are you still able to run VaM/VaMx through SteamVR? The same behaviour you described it's happening the same to me, the game just opens in desktop mode when SteamVR is running.
I tried changing the parameters, Proton version, enabling the "add to VR library check" and...