I have the same problem, so I'm happy to see that you will try to fix that.
For the next tech level, I'm trying to use it with VR..(I'm on wmr) .But I think the solution is not into VAM so I dont ask to fix it. I just wonder if some one just succed to make it working like that, remotly.