If you fix the pose buttons to a wall, for example, it might work.
In the VR environment, anything floating in the eye or camera view works badly. For example, there are several scenes out there, even recent ones, that have 3 or 4 buttons that appear in the top left corner. In VR these buttons are very difficult to use. In VR you realise there's something there, but you can't even read the content...