Fame can indeed make you feel more lonely. Especially if you get more contact/interactions from people that know you far less than your immediate circle of friends/family. But because modern humans in Western society are so busy with the daily grind, it can get quickly skewed to where your most common interactions are actually bite-sized moments with basically strangers, well-meaning as they may be, and who know things about your public persona and this creates preconceptions for them that color their exchanges with you.
It's just a strange phenomenon. I may have some similar experiences. I was something of a child star (national media coverage in US in print, TV, magazine, etc, and international attention from Japan), and it burned me out pretty fiercely. I did my best to move on, only to be dragged by a very well meaning old friend into a documentary nearly ten years ago now, and which has renewed this kind of attention, interviewers, visitors to my house from strangers, etc.
I have no animosity, and am quite moved by some of these exchanges, but it remains a surreal feeling, and kind of depressing in some ways. I lost my wife last August to a car accident, leaving my 11 year old son suddenly without that part of his life. I am privately fighting a long term illness and do not want to add this burden to my family or the fans and friends who mostly know me for the more optimistic public persona that I carry.
We do our best, what else can we do?