AI Dynamics

Global AI News Aggregator

About

Visualizing Computation DAGs: Identifying Narrow and Wide Bottlenecks

sorry i just made that word up in my head right now, didn't mean to hijack some existing term. I meant – imagine the computation as a DAG, lay it out in your head, and look for "narrow" and "wide" parts. Open to alternatives for future use!

→ View original post on X — @karpathy