haxxiy on 07 December 2023
A decent step up for AMD Instinct, a lot of it due to the smaller node and higher power budget, of course, but still competitive nevertheless.
Blackwell has to at least match its 192 GB RAM, right? It's so easy to choke a previous generation/competitor with a large enough inference model in these slides.
