Weirdly enough, I tried it again and the controls just worked pretty much as they should. Then next time I loaded it they didn't, then next time they did again. So not sure what's going on, but at least I have it usable if I just keep loading it.
The only control that wasn't bound was holding...