@sambanovaai

Thanks for highlighting our team's paper 🙌 Key findings show attention-based token importance transfers well across models, enabling training-free prompt compression with ~90-100% performance retention and faster first-token latency.. Check it out 👇 Natural Language Processing Papers (@HEI) Cross-Family Speculative Prefill: Training-Free Long-Context Compression with Small Draft Models Shubhangi Upasani, Ravi Shanker Raju, Bo Li, Mengmeing Ji, John Long, Chen Wu, Urmish Thakker, Guangtao Wang arxiv.org/abs/2603.02631 [𝚌𝚜.𝙲𝙻] — https://nitter.net/HEI/status/2029181798924660997#m

→ View original post on X — @sambanovaai, 2026-04-01 21:33 UTC