Thanks @KalleyHuang and @theinformation for writing about my work extending LLaMA 3’s context window. And shoutout to @winglian @nisten and @markatgradient who took this even further and scaled LLaMA to 1M tokens. Article in next tweet:

→ View original post on X — @mattshumer_