This made me think of the "Meet in the Middle" paper https://
x.com/rasbt/status/1
638538494887821313
…
When I remember correctly, they run two LLMs in both directions with parameter sharing. So it shouldn't impact training time. Kind of wild but hey why not.

→ View original post on X — @rasbt