LongWriter

Unleashing 10,000+ Word Generation from Long Context LLMs

discuss: https://t.co/UeebckjbtH

Current long context large language models (LLMs) can process inputs up to 100,000 tokens, yet struggle to generate outputs exceeding even a modest length of 2,000 words.… pic.twitter.com/uXzdZsG4RV

— AK (@_akhaliq) 14 août 2024

LongWriter Unleashing 10,000+ Word Generation from Long Context LLMs discuss: https://
huggingface.co/papers/2408.07
055
… Current long context large language models (LLMs) can process inputs up to 100,000 tokens, yet struggle to generate outputs exceeding even a modest length of 2,000 words.

→ View original post on X — @_akhaliq