AI Dynamics

Global AI News Aggregator

About

Cost per token: Real AI infrastructure economics beyond raw FLOPS

Compute cost = what enterprises pay for AI infrastructure (cloud or on-prem) FLOPS per dollar = raw compute per dollar But raw compute ≠ real-world output. Cost per token = the all-in cost to generate each delivered token (AI output)

→ View original post on X — @nvidia