But that sometimes breeds innovation—like in the case of LLaMA. And scrappy developers without access to massive training clusters like Google or OpenAI have to find ways around the problem. That's led to the widespread adoption of techniques like quantization and LoRA.

→ View original post on X — @mattlynley