QUOTE
I see what you mean but if more frames are not needed, why has the file to be bigger when it can be smaller?
Now, I thought you asked in your first post "if size doesn't matter"!

If size DOES matter to some degree (and obviously it does, lest we all use lossless compression, or no compression at all...), and you want an optimally, efficiently encoded file, with great sound, then VBR is absolutely the way to go.
For me (and I don't have bat ears), the perceptual audial difference between CBR 320 and --alt-preset extreme (or even --alt-preset standard in most cases) is null - 0%. The file size difference, however, is readily apparent.
As for me, I don't like to waste bits on silent, or easy-to-encode material. I like to save those bits for the hard stuff. It's about maximizing compression potential without sacrificing quality. The file size savings, in this case, vastly outway any (imperceptible!) quality lost due to encoding certain 'easier' frames at less than 320.