AI Dynamics

Global AI News Aggregator

About

H100 and FP8 optimizations for performance improvement

By

@karpathy

–

Nice! H100 is a great "free win" to bring this down.
Turning on fp8 for GEMMs would be the other source of really solid improvement, imminently

→ View original post on X — @karpathy

MORE ARTICLES