I reckon it could be solved with a skirt/bump around the middle section. You could use that to grip more effectively and no way of accidentally opening the bottom chamber. Might make it less beautiful though...
I don't have the problem, whether it's hand shape, technique or the grinder I don't...