Nice! H100 is a great "free win" to bring this down.
Turning on fp8 for GEMMs would be the other source of really solid improvement, imminently
H100 and FP8 optimizations for performance improvement
By
–
Global AI News Aggregator
By
–
Nice! H100 is a great "free win" to bring this down.
Turning on fp8 for GEMMs would be the other source of really solid improvement, imminently
Leave a Reply