The hackers are at fault. The website is negligent. The users of the Ashley Madison service are 100% victims.
All the "holier than thou" moral police who think these people deserved their fate are disgusting people. Mind your own business and realize that people were victims of a crime. Last I checked, infidelity wasn't a crime, while hacking and stealing sensitive information most certainly is.