This was based off of an older project I did, so the model we train is LLaMA 2 7B. If you want, you can easily use a newer + better model like Mistral 7B.
OPEN SOURCE
-
Claude LLM Trainer: Open-Source Task-Specific Model Training
By
–
Introducing `claude-llm-trainer` ✍️
— Matt Shumer (@mattshumer_) 27 mars 2024
The world's simplest way to train a task-specific LLM.
Just write a sentence describing the model you want.
A chain of AI systems will generate a dataset and train a model for you.
And it's open-source. pic.twitter.com/k6NDkSMmcBIntroducing `claude-llm-trainer` The world's simplest way to train a task-specific LLM. Just write a sentence describing the model you want. A chain of AI systems will generate a dataset and train a model for you. And it's open-source.
-
claude-llm-trainer: AI Model Training Platform Using Claude 3
By
–
How it works: – The user describes the model they want
Ex: "A model that writes Python functions" – claude-llm-trainer leverages a chain of Claude 3 calls to create a great dataset for your task. – We process the dataset, and train a LLaMA model! -
Databricks New LLM Beats Mixtral in Open-Source Race
By
–
There's a new king of open-source. The new LLM from @databricks just beat Mixtral! – 132B total params (16 experts), 36B active (4 experts)
– Trained on *12T* tokens
– 32K context length From my initial tests, I'm really impressed. -
Hugging Face discusses purpose-trained AI models for B2B sector
By
–
#hf #friends #solarllm We had a great dinner with Hugging Face friends @art_zucker in Korea. We discussed AI challenges. In the B2B sector, smaller, purpose-trained models seem to perform better. Overall, it was a heartwarming conversation about the future of Upstage. It was a
-
Building DBRX: Open Source LLM Development and Enterprise GenAI
By
–
What goes into building the most powerful open source LLM yet? @DbrxMosaicAI gives a glimpse into how they created #DBRX – from GPU decisions to benchmarking. Great read from @willknight @WIRED that shows why open source is critical for enterprise GenAI.
-
Mosaic Databricks Releases Competitive New Open Model
By
–
legit new open model just dropped from Mosaic/Databricks.
Seems very competitive on offline benchmarks.
Check it out -
DBRX: New Efficient Open Source LLM Standard
By
–
#DBRX sets a new standard for efficient open source LLMs. While it has 132B total parameters, with its fine-grained MoE architecture, DBRX only uses 36B at any given time. Learn more about how we built #DBRX & benchmarked its performance. https://
dbricks.co/3J13hed -
DBRX: New Open Source Model Beats Grok and Competition
By
–
Scoop: Grok had a good run but there’s a new open source model that beats out the rest: DBRX. I got an inside look at the impressive work that went into building it:
-
DBRX: New Efficient Open Source LLM Standard
By
–
Meet #DBRX: a general-purpose LLM that sets a new standard for efficient open source models.
— Databricks (@databricks) 27 mars 2024
Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications. https://t.co/wXzxQOZym6 pic.twitter.com/CaW3wFfJkoMeet #DBRX: a general-purpose LLM that sets a new standard for efficient open source models. Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications. https://
dbricks.co/43xaCMj