But 2 and 4 can be easily relaxed. They are not fundamental challenges. For 2, note that PAQ8 LMs were trained in continual style. We could easily do the same with LLMs, but indeed what we’re doing here is accelerating evolution in the outer metalearning loop. 4 is often

→ View original post on X — @nandodf,