I think that it's rather naive to suggest that either graphics never matter or that they matter for all games.
I don't think anyone here would argue that graphics improvements would matter for, say, Tetris. On the flipside, graphics improvements for Endless Ocean would make a significant impact, since the graphics are one of the major points of the game (in a rare case of that being a good thing).
In the majority of cases, graphics that are "good enough" are sufficient. If Super Mario Galaxy had had graphics comparable to those of Super Mario Sunshine, or even Super Mario 64, it wouldn't have made it a worse game. N64 graphics are good enough for a game like Galaxy - any more is just icing on the cake, nothing more.
On the other hand, Dead Rising: Chop Til You Drop was a demonstration of a situation where graphics were not good enough for the game, and the comparison with the original versions emphasises this. The insufficient graphical power meant that the game couldn't provide the same experience, it was forced to provide an inferior experience.
Why did Pokemon only just move into proper 3D graphics on handhelds? Because it's only with the 3DS that the graphical power is sufficient to do the game justice. However, improvements to the graphical engine beyond this would be unnecessary - nice, but unnecessary. They wouldn't really matter.
At least, that's my opinion on the issue.