Yeah I gave up on trying to wipe off the ink, I just rip off the tape when I refill and make a new label for the new name.
TBH even though they work well for smell, I don't use the sharpie caps, they add about 3/4" to the length and make it stick out of the pocket a bit. I'm still hunting for...