Thanks for sharing your method! I don't have collets, so I may just try and make my own bushings out of brass or HDPE.
Have you tried a stem with stabilized wood? I'm not sure how it would do with the heat, but using a brass tube inside the stem where the tip connects might be enough to keep it...