Because 1T parameters might be a bit too much, I'm also releasing an "intermediate checkpoint": BigLlama-3.1-681B-Instruct. It's closer to what Llama 3 120B was to the 70B, so it might be more coherent as well. Model: https://
huggingface.co/mlabonne/BigLl
ama-3.1-681B-Instruct
…

→ View original post on X — @maximelabonne