I've doubled LLaMA 3's context window to 16K tokens. Fully open-source. Link in thread:

→ View original post on X — @mattshumer_