If graphics can effect the gaming experience then they should effect the review score. End of story.
While there are a number of valid points here, these situations are the exception rather than the rule. Quality gameplay and graphics tend to be highly correlated, as both are indicative of high production values and effort. Games that are relatively ugly compared to other games on that console, will on average, have inferior gameplay.