Graphics should definitely count, but as already said, not as much as gameplay.
But the graphics of a game can most definitely affect the experience of the game, because we have a little something called immersion.
Of course, many things add up to immersion, but graphics can be a huge factor in this.
A game like Killzone 2 would be less immersive, if it had worse graphics.