Yeah this is very strange, I mean I know my VAM drops in fps when I open the UI in heavy scenes - but only by like 10-15 fps. Not sure why yours is nuking as hard as it is, as @labato80 said I'd try a fresh install.
Don't delete everything, rename your main VAM folder to something like...