In my opinion, the magnets would not have much force. vertainly more if you use a rare earth magnet, but the ball catch requires the same drilling that you're referring to and locks quite solid with a very satisfying "snap"
I've done this twice now, soon a third. Nice upgrade. Last time I used...