“Training LLMs from scratch costs $ millions in compute. But LLMs can cheaply be adapted to new tasks via fine-tuning, leading to a proliferation of models that suit specific use cases. Fine-tuned models can be rapidly merged to combine capabilities and generalize to new skills.”

→ View original post on X — @hardmaru,