Body insecurity is a tricky thing.
It would be easy to just say don't worry about it, but that doesn't make people feel better. That might be the answer, but it's much easier said than done. There's a reason why these things often require therapy.
I will guarantee to you that you spend more time thinking about your body, and your insecurities than anyone else will.
Most people will probably not even notice your hands in the first place. I genuinely can't remember the last time I gave a thought to the size of someone's hands. And even if I did think about someone else's hands, it would be something I would think about for a few seconds at most. "Oh neat, they have huge hands." "Oh neat they have surprisingly small hands." And then never have any thought related to those hands cross my mind ever again.
The main person your insecurity is stopping, is yourself. Most people aren't going to care. There's probably a 1 in a million chance that some weirdo will stop being friends with you over your hand size. In that case, that person is the weirdo. Probably more likely a woman might care more, but even that feels unlikely.
Again, the person that will care the most is yourself. It's not some unpleasant trait that other people have to worry about. It might even be a slightly preferable trait for some women.