In this preview release, we focused on delivering the best-in-class 32k context window. These results are extremely promising, but we want to expand it to very, very long contexts. Here are our RULER scores (
https://
github.com/hsiehjackson/R
ULER
…) for LFM-3B ↓
LFM-3B Achieves 32K Context Window with Promising RULER Scores
By
–
