AI Dynamics

Global AI News Aggregator

About

H100 GPU costs for 120B and 20B LLM model training

According to the model card gpt-oss-120b took 2.1 million H100-hours and the 20b model 1/10th of that I found quotes for H100 pricing ranging from $2/hour to $11/hour, which would indicate that the 120b model cost between $4.2m and $23.1m and the 20b between $420,000 and $2.3m

→ View original post on X — @simonw