Can LLMs find a needle in a haystack of text? Stony Brook University and Meta AI present HiLight: a lightweight system that highlights key evidence in long contexts for frozen LLMs. Instead of rewriting or compressing input, it trains a small Actor to insert highlight tags

→ View original post on X — @jiqizhixin