Probably 90% of academia operates under that constraint, and lots of useful insights and contributions (although maybe not models) still come from academia. Alpaca, LIMA, FlashAttention, QLoRA … to name a few innovations from academia.
Academic Contributions to AI Despite Resource Constraints
By
–