Neither the CPU or the GPU get no where near 100% usage, maybe cpu 20% and the gpu 60-70% This doesn't even make sense....
The Ryzen 7 5800X is an 8 core CPU with 16 threads. If you got a single core maxed out, it will show a CPU usage of 12.5%. So you got the VaM main thread and a second worker thread that has another core partially used. You can check it like this:
- Press Ctrl+Shift+ESC to open TaskManager
- Click "More details" at the bottom.
- Go to Performance tab, then CPU
- Right click the graph, and "Change graph to" and set it to logical processors.
- Now you see the load for each logical core of your CPU.
A usage of 60-70% for the GPU means it is waiting for
something. With VaM that is likely the CPU. Although it could also be VSync, which means waiting for the next refresh of your monitor or VR headset. Note that most VR headsets lock you to 45Hz, if your rig can't make stable 90Hz. Its better to measure performance differences in VaM Desktop mode with VSync off.
If the CPU is the limit that may mean you can't get more FPS on your system. However, since your GPU still has reserves, you could use them without loosing FPS. For example you could increasee resolution. In VR you can use the RenderScale slider in VaM's User Preferences. Also you can set MSAA to 8x. This improve image quality a LOT, especially for hair. After switching from a GTX980 to an RTX2070 I could set RenderScale to 1.5 and enable MSAA 8x instead of 4x. Day and Night difference. Obviously you could also have a more complex scene in terms of background assets, etc.
Another thing that may (or may not) be an issue is your mainboard and RAM. You did not mention it, so I have to guess. Are you maybe still using your old mainboard and RAM, because its still AM4 socket it physically fits together, but you can't use the potential of the new CPU/GPU? The 5800X
should be way faster, even in single core. Most people, even many programmers, don't realize how important RAM is. Quite often the CPU is just waiting for fetching some data from RAM. Most CPUs are roughly 50x faster than their RAM, so you waste a lot of time on just waiting. So, clever engineers invented CPU caches and hyperthreading. However, that only helps so much, if the data is not in cache and there is no other thread to switch to while waiting.
Ryzen 5800X should be able to support up to about DDR4-4000 without overclock, although officially only up to DDR4-3200 for some reason. Make sure the board supports it, too. RAM with low CL/Latency number also helps, there is a reason these are WAY more expensive. For your CPU I would recommend a DDR4-4000 Kit with CL16. Difference between a cheap CL18 vs. expensive CL16 is roughly 10% faster memory. Whether that direclty translates into % fps I can't tell you, certainly not 1:1, but it may help slightly. However, a good CL number is almost more important than a high DDR4-xxxx number. There are also CL15 modules around, but prices are insane..
Another thing to check is whether you mounted your RAM correctly. Check your mainboards manual in which slots the RAM modules are recommended to be mounted. You want them to operate in Dual Channel or Quad Channel mode. You might also want to check in BIOS whether that mode is enabled and the XMP profile stored in the module is used, although that
should be the default. In any case, all your RAM modules should be identical from the same production batch. Don't combine different modules or you can't use Dual/Quad mode. (That's why they are sold as kits of 2 or 4)
Last but not least, VaM performance also depends a lot on the scene. E.g. you might notice my DoubleTrouble scene running faster than other scenes with 3 characters. It's because I turned of Advanced Colliders for the characters as they are not needed, and some other minor things, which gains a lot of FPS on my machine.