The position of President of the United States is an executive position and, like executive positions in the private sector, the job is almost entirely determining what needs to be done and delegating to the right people to ensure that it is done correctly. Unlike a grunt labourer, putting in more effort and "working harder" does not translate into the work of an executive being done faster or better (or that more of it is accomplished). Getting upset at Obama for how much vacation time he spends or how he spends his time is just as moronic as it was when people were critical of Bush for the same thing.
Obama failing to act in a way to "fix" issues that most Americans care about has little/nothing to do with how he is spending his spare time; and it is entirely caused by his ignorance, incompetence or political cowardice







