I don't think that formatting alone can explain such a gap. You could maybe try to reproduce LLaMA numbers given the available model. It is likely that fixing these differences for LLaMA will also improve the numbers you report for your model.

→ View original post on X — @guillaumelample