Ok just finished Uncharted 4. For a while there it was a little sketchy, but the game came roaring back in the last 6 chapters.
So I'd give the win to Uncharted 4. On the technical and story sides it's a clear win, and Uncharted also tops Rise of the Tomb Raider in gunplay, traversal, and sheer spectacle.
Overall, I'd rank the games as follows.
1) Uncharted 2
2) Uncharted 4
3) Uncharted 1
4) Rise of the Tomb Raider
5) Uncharted 3
6) Tomb Raider (2013)