Question about disabling grab input

[zakban]

Is it possible to disable an ability to grab joints of the model with vr hands, but for the collisions to still work? Even when unchecking the 'Interact in play' button, it still allows me move the model around. I think I'm missing something