We are open-sourcing scale-llm-engine, our library for hosting and fine-tuning open-source LLMs. This can run on your own infra, as well as on Scale's cloud infrastructure. Docs here: https://
scaleapi.github.io/llm-engine/ Github link:
CODE
-
Scale Open-Sources LLM Engine for Self-Hosted Deployment
By
–
-
Scale API releases Llama 2 fine-tuning cookbook in 5 minutes
By
–
We're also releasing a cookbook for fine-tuning Llama 2 in 5 minutes Get started here: https://
scaleapi.github.io/llm-engine/gui
des/fine_tuning/
… Cookbook here: https://
github.com/scaleapi/llm-e
ngine/blob/main/docs/examples/finetuning.ipynb
… -
Scale AI Open-Sources LLM Engine for Llama 2 Fine-Tuning
By
–
With @MetaAI
's the launch of Llama 2—
@scale_ai will also be: open-sourcing scale-llm-engine, our library for hosting and fine-tuning open-source LLMs releasing the fastest way to fine-tune Llama 2 launching Scale Custom LLMs for enterprises Read more in -
LangSmith: Production-Grade LLM App Debugging Platform Released
By
–
@Langchain just released LangSmith: a platform for debugging, testing, and monitoring production-level LLM apps. This is a really smart move. It solves for the #1 complaint I hear from developers who are actually trying to build production-grade AI apps (instead of Twitter
-
Meta releases LLaMa-2 open-weight language model free
By
–
LLaMa-2 from @MetaAI is here!
Open weights, free for research and commercial use. Pre-trained on 2T tokens.
Fine-tuned too (unlike v1). Lets gooo…. https://
ai.meta.com/llama/
The paper lists the amazing authors who worked to make this happen night and day. Be sure to thank -
Run Llama 13B v2 Chat on Replicate Platform
By
–
Run it at https://
replicate.com/a16z-infra/lla
ma13b-v2-chat
… Happy hacking! -
Code Generation: BERT Training on IMDB with Distributed Data Parallel
By
–
> It can write code. "Write a python script that trains `bert-large` on the `IMDB` dataset using the Transformers `Trainer` class and Datasets library. I have access to four GPUs, so let's use DDP." https://
replicate.com/p/gzcomldbikya
y2s6q6744lsyt4
… -
Meta Releases Llama Model Weights and Code 7B to 70B
By
–
"This release includes model weights and starting code for pretrained and fine-tuned Llama language models — ranging from 7B to 70B parameters."
-
Facebook Research Llama GitHub Repository Link Shared
By
–
github: https://
github.com/facebookresear
ch/llama
… -
Meta Releases Llama 2 Open-Source LLM Free Commercial
By
–
Meta released Llama 2: An entirely new version of the open-source LLM that's free for commercial use: https://
ai.meta.com/llama/