My 50th game is considered by most to be the most hyped and disappointing game of 2014.
For my rating criteria I am going with (in order of importance):
1. First impression. If the game didn't wow me the first time I played it, screw it.
2. Replayability. If I put the game down and feel like I never need to play it again, it's out.
3. Nostalgia points. If I can recall a game fondly, chances are it is in.
4. Gameplay. This one is tough because it's like judging different sports starts of different eras against one another. Gotta be able to keep the limitations of the times in perspective.
5. Story. I enjoy a good story, but it isn't the be all end all for me.
6. Graphics. If I can't look at it without thinking it is ugly (for the wrong reasons of course, ugly by intent can be awesome) then it comes into play. Graphics though are the least important part of games for me.