Probably 90% of academia operates under that constraint, and lots of useful insights and contributions (although maybe not models) still come from academia. Alpaca, LIMA, FlashAttention, QLoRA … to name a few innovations from academia.

→ View original post on X — @rasbt,