There is a risk forsure. Luckily I had a failed attempt (shitty acid) a year ago. So when I tried it foreal this time I was totally comfortable which leads to a good trip where there is greatly diminished risk of screwing up your brain. But I totally respect someone not trying it for reasons as such.
I'm not a big drinker or weed smoker. I just hate the hangover of getting drunk, though sometimes you can avoid that with a good breakfast, green tea, and some exercise the next day.