I always thought those that worked the hardest for there money, were the ones least likely to allow someone else to chose what to do with it.
Money is effort, but the more educated you are, the less effort it takes to earn it. If you sit in an office all day and think "All I did was think a little, we can take a little more from people who do this and give it to the poor, because how hard is it really?".
While a unskilled (or less skilled) farmer would think "I am living off my own effort, doing something anyone in the world could do. Why take my money and give it to someone who chose not to work as hard as I did today?"
Oversimplification, but I think that line of reason has some marrit.