To train this model, we use Curriculum Learning by gradually increasing the token lengths trained on from 2K to 8K. We additionally train on an instruction tune dataset sampled from various popular sources and curated in-house. (4/10)
GENERATIVE AI
-
Dataset Curation for Long Sequence Instruction Following
By
–
To curate a dataset that encourages long sequence instruction following, we use two techniques. First we find tasks that truly benefit from longer sequences and add them to our instruction tuning datasets. (5/10)
-
SN-13B-8K-Instruct Outperforms MPT, XGen, LLAMA2 on Long Sequences
By
–
We compare SN-13B-8K-Instruct with MPT, XGen and LLAMA2 and find that this model achieves better scores on long sequence suite derived from Scrolls and validation set of ZeroScrolls, a benchmark developed by @TelAvivUni and @MetaAI
. (3/10) -
SN-13B-8K-Instruct Open Source Model Outperforms Long Sequence Competitors
By
–
Today we are excited to introduce and open source SN-13B-8K-Instruct, an 8K SS model that achieves better accuracy than leading long sequence open source models specialized for long sequence size tasks. (1/10)
-
Sambanova SN-13B-8k-Instruct Model Now Available for Download
By
–
This model is available for download on @huggingface for people to try: https://
huggingface.co/sambanovasyste
ms/SN-13B-8k-Instruct
… (2/10) -
Popular Prompt Perfect Plugin Originates from Ben’s Bites Hackathon
By
–
Most popular plugin 'Prompt Perfect' came from a Ben's Bites hackathon
-
Malt Community: European AI-Powered Freelancing Platform Leader
By
–
You forgot @Malt_Community
, a French company, leading the freelancing industry in Europe. -
Practical tips for using generative AI tools like ChatGPT and Midjourney
By
–
Cut through the hype and get some practical, down-to-earth tips about how to use generative #AI technologies like #ChatGPT, #MidJourney, and more in the latest version of our #podcast! https://
hubs.ly/Q01-6KNn0 -
Fine-tuning smaller models for specialized tasks with custom data
By
–
Yes, it's more impressive. But if you are a small company that specializes on a specific task and has some custom data, I'd say that finetuning a smaller (e.g. 1.5 B) model is the way to go.
-
Salesforce Einstein Studio Enables Enterprise Generative AI Model Training
By
–
Salesforce Einstein Studio to help enterprises train #GenerativeAI models https://
infoworld.com/article/370426
9/salesforce-einstein-studio-to-help-enterprises-train-generative-ai-models.html
… via @infoworld