A new approach from CSAIL & Google marks a shift toward teaching models to orchestrate their own parallel decoding strategy. The team's "Parallel Structure Annotation" (PASTA) enables LLMs to generate text in parallel, accelerating their response times: https://
bit.ly/4eDsVVo

→ View original post on X — @mit_csail