Yes, the CPU has always been my primary bottleneck, and for most people too regarding VAM, but to me it's enough for what I get. Buying a new one would also mean new motherboard, possibly RAM too, and prices are ridiculous.
I upgraded my GPU not so much for VAM but because of the expected price...