Should I call this ironic? Considering your past.
Either way, it is no surprise that becoming famous is hard. Even super rich people have to deal with tons of annoying people every day. Imagine for a second that you won the lottery, even your closest friends and family members would become different people just because you won some money. Generally, at least in my country, when people win the lottery they end up much less happy as a result of all the harrassment.
I don't have a solution for you. All I can do is suggest getting some daily habits outside of your home with trusted people and wait for time to pass.