This thread is intended to share and discuss result from the MacGruber Benchmark plugin.
As a side project, I was looking at PC components for upgrading my old machine. That made me browse through various forum threads on the Hub discussing FPS in VaM. Everyone is posting random FPS values, but barely anybody shares which exact settings and scene was used. But those differences can make huge difference, if they are not identical comparing performance is really pointless. Being half a meter further back or using a different FoV may give you 10 more FPS. Especially resolution makes a big difference. It would be really helpful when deciding whether you want to spend some extra 100€ on that faster RAM module, different CPU, etc. Does it make sense to sink money in an RTX3080....or is an 3070 enough?
So, to help solve this problem, I'm presenting you the MacGruber Benchmark! Its a series of scripted scenes that measure performance of different aspects in VaM. In the end you are a presented with a nice result screen which shows you an overall average FPS value for quick comparison, detailed results and time measurements for each individual scene, the VaM settings that were used and of course some basic system stats like CPU, graphics card, VR headset used, etc. It does not know about things like overclocking or undervolting, so you should mention it in your post here.
The plugin does also ensure that unknowing users can't accidentally produce invalid results. There are various integrity checks, like checking all dependencies are present, all plugins were allowed to run, the scenes weren't modified, etc. In VR the plugin does also lock your head movement to make sure everyone sees exactly the same.
As a side project, I was looking at PC components for upgrading my old machine. That made me browse through various forum threads on the Hub discussing FPS in VaM. Everyone is posting random FPS values, but barely anybody shares which exact settings and scene was used. But those differences can make huge difference, if they are not identical comparing performance is really pointless. Being half a meter further back or using a different FoV may give you 10 more FPS. Especially resolution makes a big difference. It would be really helpful when deciding whether you want to spend some extra 100€ on that faster RAM module, different CPU, etc. Does it make sense to sink money in an RTX3080....or is an 3070 enough?
So, to help solve this problem, I'm presenting you the MacGruber Benchmark! Its a series of scripted scenes that measure performance of different aspects in VaM. In the end you are a presented with a nice result screen which shows you an overall average FPS value for quick comparison, detailed results and time measurements for each individual scene, the VaM settings that were used and of course some basic system stats like CPU, graphics card, VR headset used, etc. It does not know about things like overclocking or undervolting, so you should mention it in your post here.
The plugin does also ensure that unknowing users can't accidentally produce invalid results. There are various integrity checks, like checking all dependencies are present, all plugins were allowed to run, the scenes weren't modified, etc. In VR the plugin does also lock your head movement to make sure everyone sees exactly the same.
