the answer is out of my league as to why it scans AddonPackages every time i think that's one of the reasons they are working on a sequel to VaM that is easier to run this is a quote from a Dev about it.
Most of the load time is Vam processing information. The actual "reading data from disk" delay is pretty small.
I have done some testing and found that the larger my addonPackages folder, the slower the startup time. This makes sense, as VaM is having to go through every .var file to add clothing, morphs, look, etc to the vam menu system.
It's a major limitation with no obvious solution.