We are open-sourcing scale-llm-engine, our library for hosting and fine-tuning open-source LLMs. This can run on your own infra, as well as on Scale's cloud infrastructure. Docs here: https://
scaleapi.github.io/llm-engine/ Github link:

→ View original post on X — @alexandr_wang