Hah, yes, same. But it's basically 1 GPU with multiple cores. I am more excited about the 192 Gb GPU memory here. But then, would it support mixed-precision training and bfloat 16? Probably no. So that's actually worse than than an A100 with 48 Gb for example.
GPU Memory Capacity vs Mixed-Precision Training Support Trade-offs
By
–