Arcee releases Arcee-SuperNova, better fine-tune of Llama-3.1-70B! versions: 70B and 8B Trained by distilling logits from Llama-3.1-405B Used a clever compression method to reduce dataset weight from 2.9 Petabytes down to 50GB (may share it in a paper) Not all

→ View original post on X — @aymericroucher