So, I fixed my stem, bought the correct screwdriver, and inside I had to use a normal screwdriver to tighten the screws.
I think it was just too dirty, the resin goes into the threading, so if you clean it more often than I did, it should be fine, if not - get the screw.