Messed up. When converting to Unity forgot to click "enable VR" in the player setup setting. This worked prior, but caused strange artefacts that are headache inducing alongside no collisions.
Converted it again to fix these issues. A side effect is altered the lighting to appear slightly darker, but can adjust it in the invisible lights settings, or just redo it to your liking.