I believe this would be easiest and most cost-effective because they won't have to store a new 175B parameter LLM for each customer then. With LoRA, you can use the same base LLM but only need to store the LoRA weights.

→ View original post on X — @rasbt,