AI Dynamics

Global AI News Aggregator

About

MMLU-Pro Score vs Inference Costs Analysis

MMLU-Pro score vs inference costs "To see which models are on the current frontier, I plotted the MMLU-Pro scores against the inference costs. Of course, inference costs are difficult to estimate, especially for the smaller models, so I either took the cheapest API costs I

→ View original post on X — @kimmonismus