Neat – would that be in the https://
huggingface.co/databricks/dbr
x-instruct/tree/main
… repo? I couldn't spot it there
OPEN SOURCE
-
DBRX Instruct Model Repository Access Discussion
By
–
-
Fine-tuning LLaMA 2 7B and Mistral models for practical applications
By
–
This was based off of an older project I did, so the model we train is LLaMA 2 7B. If you want, you can easily use a newer + better model like Mistral 7B.
-
Claude LLM Trainer: Open-Source Task-Specific Model Training
By
–
Introducing `claude-llm-trainer` ✍️
— Matt Shumer (@mattshumer_) 27 mars 2024
The world's simplest way to train a task-specific LLM.
Just write a sentence describing the model you want.
A chain of AI systems will generate a dataset and train a model for you.
And it's open-source. pic.twitter.com/k6NDkSMmcBIntroducing `claude-llm-trainer` The world's simplest way to train a task-specific LLM. Just write a sentence describing the model you want. A chain of AI systems will generate a dataset and train a model for you. And it's open-source.
-
claude-llm-trainer: AI Model Training Platform Using Claude 3
By
–
How it works: – The user describes the model they want
Ex: "A model that writes Python functions" – claude-llm-trainer leverages a chain of Claude 3 calls to create a great dataset for your task. – We process the dataset, and train a LLaMA model! -
Databricks New LLM Beats Mixtral in Open-Source Race
By
–
There's a new king of open-source. The new LLM from @databricks just beat Mixtral! – 132B total params (16 experts), 36B active (4 experts)
– Trained on *12T* tokens
– 32K context length From my initial tests, I'm really impressed. -
Hugging Face discusses purpose-trained AI models for B2B sector
By
–
#hf #friends #solarllm We had a great dinner with Hugging Face friends @art_zucker in Korea. We discussed AI challenges. In the B2B sector, smaller, purpose-trained models seem to perform better. Overall, it was a heartwarming conversation about the future of Upstage. It was a
-
Building DBRX: Open Source LLM Development and Enterprise GenAI
By
–
What goes into building the most powerful open source LLM yet? @DbrxMosaicAI gives a glimpse into how they created #DBRX – from GPU decisions to benchmarking. Great read from @willknight @WIRED that shows why open source is critical for enterprise GenAI.
-
Mosaic Databricks Releases Competitive New Open Model
By
–
legit new open model just dropped from Mosaic/Databricks.
Seems very competitive on offline benchmarks.
Check it out -
DBRX: New Efficient Open Source LLM Standard
By
–
#DBRX sets a new standard for efficient open source LLMs. While it has 132B total parameters, with its fine-grained MoE architecture, DBRX only uses 36B at any given time. Learn more about how we built #DBRX & benchmarked its performance. https://
dbricks.co/3J13hed -
DBRX: New Open Source Model Beats Grok and Competition
By
–
Scoop: Grok had a good run but there’s a new open source model that beats out the rest: DBRX. I got an inside look at the impressive work that went into building it: