Wonder what compute times we will see with 10M input tokens on a rather beefy system. The NiH tests are also insane, It’s hard to believe we are moving towards infinite token context lengths with near perfect retrieval.

→ View original post on X — @linusekenstam