Seconds if you use a magnet as a heat sink.
I (like many other VC vapers) use a metal tin to store my pre ground herb, with a magnet under the lid so you can use the lid as a cooler, stand and cap puller.
Not that you really need to wait for it to cool tho as you can fill it while it's hot with...