That's the thing though, the higher the FPS, the worse it gets. I use this framelimiter plugin to keep it at 20 fps, cause if I let it run 60, the usage is at 70% easily without much going on in the scene.
I guess it's mostly that. My 970 died on VaM, my 1070 now has to be bottlenecked for its...