The 72B model looks amazing but wow what an excellent benchmarking! Super happy to see MixEval and MMLU-Pro there. I have high hopes for MixEval as a proxy for Arena Elo. Also curious to see if these models behave better than Llama 3 for SFT.
72B Model Benchmarking: MixEval and MMLU-Pro Performance Analysis
By
–
