Bioshock > Infinite > Bioshock 2
Bioshock had everything at its time. Great gameplay, awesome story, fantastic world. There was really nothing to complain about except the end boss.
Bioshock 2 took the gamplay even a small step farther while playing it safe, but it was obviously not as original and the story couldn't hold up. Still a very good game though. It also introduced multiplayer and had really good DLC.
Infinite had just like the first Bioshock an amazing story line and a beautiful crafted world, though I personally preferred the atmosphere of Rapture. That seemed much more mysterious. The enemies in Infinite were sadly not as interesting as I hoped them to be and the Vigors weren't as important as the Plasmids in Bishock IMO. The gunplay is decent but hasn't evolved one bit.
IMO it's a bit sad that the choices you make in the game have no impact for the ending and almost no impact during the game.
Elizabeth is a great companion and a very useful addition to the game. Sky-Line riding also works as well as the videos made it seem.
Only thing I really hated was (again) a certain boss.