AI Dynamics

Global AI News Aggregator

About

Prompts per kWh as a Performance Metric for Energy Efficiency

Think of it as a performance measure, like queries per second, transactions per second or miles per gallon or something, and then prompts per kWh makes more sense, perhaps. The energy on the X axis is a constant unit of 1 kWh.

→ View original post on X — @jeffdean