Yeah, I figured this would be a problem at some point. I'll try out divining rod and polish the scene overall, thanks for the feedback!
UPDATE: So I just tried out divining rod, and it unfortunately does not help much. One of the reasons is that the plugin can't decide if it wants to aim for...