You could make AI inference 3x faster without any extra training. Researchers from SJTU & Huawei present LoPA just for that! Their new "Lookahead Parallel Decoding" method is a plug-and-play trick. It smartly predicts the best order to generate multiple tokens at once, instead

→ View original post on X — @jiqizhixin