I'm not sure about the US, but one man was recently convicted for it in the UK. Interestingly, it seems that the act of modifying a console itself is illegal, rather than modifying it for the purpose of playing pirated games; that means that one is no longer allowed to modify a console to play homebrew or imported games. It seems that Spain is an exception to this interpretation (probably NSFW).