If you pick up an object inside VaM and then put the controller down and wait for it to go to sleep - once it does, you end up holding the object in your virtual hand anyway even without the controller as I'm guessing the hand tracking gets activated and still works as it goes through