10/ Consistent Middle Enhancement in LLMs – proposes an approach to tune an LLM to effectively utilize information from the middle part of the context; it first proposes a training-efficient method to extend LLMs to longer context lengths (e.g., 4K -> 256K).

→ View original post on X — @dair_ai