I noticed the tolerance difference in my glass sleeve also, but in my case it's snug or extra snug when orientation rotated so I'm not getting any slippage. Does your ball bearing feel like it can be compressed and spring back slightly? Mine does.
Pretty easy for most part even though there's...