Serving multiple #finetuned models typically requires dedicated, costly GPUs for each deployment—until now. Introducing LoRA Exchange (LoRAX): dynamically serve 100s of fine-tuned #LLMs on a single GPU w/out sacrificing throughput at a much lower cost.

→ View original post on X — @predibase,