Inflection-2 was trained on 5,000 NVIDIA H100 GPUs in fp8 mixed precision for ~10²⁵ FLOPs. The goal was to beat Google’s flagship PaLM 2 Large on all the standard LLM benchmarks including MMLU, TriviaQA, HellaSwag & GSM8k.
Inflection-2 Trained on 5000 H100 GPUs Beats PaLM 2
By
–