New minor release for #LoRAX, our open-source framework for serving 100s of #LLMs on a single #GPU:
LoRAX v0.8 now supports structured outputs (#JSON mode) courtesy of #Outlines!
LoRAX v0.8 Release: JSON Structured Outputs Support Added
By
–
By
–
New minor release for #LoRAX, our open-source framework for serving 100s of #LLMs on a single #GPU:
LoRAX v0.8 now supports structured outputs (#JSON mode) courtesy of #Outlines!