I can't really say about other religions, but I used to go to a christian church since I can remember. You're totally right when you say they judge someone's morals based on drinking, gambling or even sex (women who have sex before marriage are considered "immoral", and masturbation is a sin. I'm serious.).
Thankfully, after rationalizing for some time, I realized how illogical and stupid was to have someone tell me what to do or not to do - especially when they don't give any reasons, it's just based on fear ("You're going to hell if you don't do that or do this."). I'd go as far as to say that it brainwashes people, especially when it's about sex.
Thankfully, it seems that the number of people adhering to what I call "free faith" is constantly increasing. That is, people who believe in God or any other deity they so choose to believe, but do not follow what the churches tell them and don't agree with any of the religion's dogmas/tenets/teachings. I'm one of those people myself.
