You said it made it, "worse." So it was there beforehand. (Obviously, I know) I tell people this all the time who suffer from depression or social anxiety since the two go hand in hand, there must be an underlying issue that is the root cause for your condition. Much like your fame, other factors have contributed to your ailment but aren't necessarily WHY you're suffering.
You need to uncover what exactly it is that causes the anxiety. Is/was it a person? Is it people in general? Was it an event? More than likely it is a present occurrence since it's an ongoing issue. Anyway find out what it is an ACCEPT IT. Accept being afraid of it. Then, once you've realized you're afraid of whatever it is, ATTACK. That's when you address it in a serious manner..
Insert Coin. Press START. You Died. Continue?
