Buttons need a resonable angle and close distance to be used as buttons, and things in the way, even hidden ones, can limit a button's operation.
I would understand that some scenes may have weirdly positioned or arranged buttons, with others having no issue. Does it happen in all scenes at any angle or distance?
Note that walls and other objects block the hit on the button. That includes the invisible ("culled") backside of walls/objects!