GPGPU isnt fully utilised yet, and can have drastic speed up effects compaired to doing things via the cpu (esp when its not that strong a cpu to begin with).
Stuff like Asynchronous shaders is used in a games like Infamous: Second Son, but many developers probably arnt useing it yet (esp 3rd party games).
I think games will look better 2years from now, than they currently do.