Yi-34B-200Khas enhanced the long text capability. In the Needle-in-a-Haystack test, the performance rises from 89.3% to 99.8%. @01AI_Yi continues to pretrain the model on 5B tokens long-context data mixture and demonstrates a near-all-green performance!
https://
github.com/01-ai/Yi?tab=r
eadme-ov-file#news
…

→ View original post on X — @01ai_yi,