When I first got my Ti Vapcap it was the same deal. I went to town with 91% iso on the tip and condenser tube and it took many many Q-tips before iso swabbing wasn't producing any 'gray matter' on the Q-tips.
IIRC, after a few swabs, it appeared to be all clean when swabbing with a dry Q-tip...