Probably about the same as the 11B T5 model
MACHINE LEARNING
-
SambaNova Releases SN-13B-8k-Instruct Language Model
By
–
@huggingface | SN-13B-8k-Instruct, a 13 billion parameter model https://
huggingface.co/sambanovasyste
ms/SN-13B-8k-Instruct
… Join our Discord to ask questions and discuss. https://
discord.gg/8z2Pe7cpRv Read the full blog and technical details at https://
sambanova.ai/blog/training-
long-sequence-size-models-on-sambanova/
… (10/10) -
Curriculum Learning Boosts Model Training From 2K to 8K Tokens
By
–
To train this model, we use Curriculum Learning by gradually increasing the token lengths trained on from 2K to 8K. We additionally train on an instruction tune dataset sampled from various popular sources and curated in-house. (4/10)
-
Instruction List Technique Enhances Long Sequence Attention
By
–
Second, we use a technique that we developed called instruction list that synthetically creates tasks that encourage more long sequence attention and instruction following. (6/10)
-
13B Parameter Long Sequence Model Achieves Competitive Accuracy
By
–
Using this recipe, we are able to train a competitive long sequence model at 13B parameter scale. We achieve 2-12 points better accuracy across a wide variety of long sequence tasks from Scrolls and ZeroScrolls. (7/10)
-
SN-13B-8K-Instruct Outperforms MPT, XGen, LLAMA2 on Long Sequences
By
–
We compare SN-13B-8K-Instruct with MPT, XGen and LLAMA2 and find that this model achieves better scores on long sequence suite derived from Scrolls and validation set of ZeroScrolls, a benchmark developed by @TelAvivUni and @MetaAI
. (3/10) -
SN-13B-8K-Instruct Open Source Model Outperforms Long Sequence Competitors
By
–
Today we are excited to introduce and open source SN-13B-8K-Instruct, an 8K SS model that achieves better accuracy than leading long sequence open source models specialized for long sequence size tasks. (1/10)
-
Installation and requirements setup for deep learning workshop
By
–
Maybe this installation + requirements.txt from my recent DL workshop is useful here: https://
github.com/rasbt/scipy202
3-deeplearning/tree/main/00-2_python-libraries-for-workshop
… -
Power User PyTorch Nightly and Lightning GitHub Installation
By
–
As a "power user" I usually install the PyTorch nightly and the lightning from the GitHub branch .
-
Hootsuite Insights: AI analysis of social data for actionable insights.
By
–
5) Hootsuite Insights.
Hootsuite Insights uses AI to analyze social media data and provide actionable insights. Features:
– Sentiment analysis
– Trend identification
– Competitive analysis
– Influencer identification