OPEN SOURCE

→ View original post on X — @replicate

Llama 2 Model Comparison: 7B vs 13B vs 70B Guide

By

@replicate

–

07 August 2023 20h48

What's the difference between Llama 2 7b, 13b and 70b, and when should you choose one over the other? @zeke breaks it down for us: https://
replicate.com/blog/all-the-l
lamas
…

→ View original post on X — @predibase

Deploy and Fine-tune Open-Source LLMs with Ludwig AI

By

@predibase

–

07 August 2023 19h00

Want to learn how to deploy and #finetune open-source #LLMs on your own data the easy way? Join our hands-on webinar to learn about the latest release of open-source @ludwig_ai and how to build custom LLMs in just a few commands. Save your spot: https://
pbase.ai/3s1KiLy

Open Source AI Checkpoint Released on Hugging Face

By

–

07 August 2023 18h16

When we do a LikeRT human evaluation of our checkpoint and compare with other models, we achieve comparable results. We are open sourcing the checkpoint on @huggingface for the community to try. (8/10)

Open License Model Released for Long Sequence Understanding

By

–

07 August 2023 18h16

It is available with an open license and created to understand long sequence capabilities. It is not meant to be a drop-in replacement for chat models. We are excited to see how people use the checkpoint. (9/10)

SambaNova Releases SN-13B-8k-Instruct Language Model

By

–

07 August 2023 18h16

@huggingface | SN-13B-8k-Instruct, a 13 billion parameter model https://
huggingface.co/sambanovasyste
ms/SN-13B-8k-Instruct
… Join our Discord to ask questions and discuss. https://
discord.gg/8z2Pe7cpRv Read the full blog and technical details at https://
sambanova.ai/blog/training-
long-sequence-size-models-on-sambanova/
… (10/10)

13B Parameter Long Sequence Model Achieves Competitive Accuracy

By

–

07 August 2023 18h16

Using this recipe, we are able to train a competitive long sequence model at 13B parameter scale. We achieve 2-12 points better accuracy across a wide variety of long sequence tasks from Scrolls and ZeroScrolls. (7/10)

SN-13B-8K-Instruct Outperforms MPT, XGen, LLAMA2 on Long Sequences

By

–

07 August 2023 18h16

We compare SN-13B-8K-Instruct with MPT, XGen and LLAMA2 and find that this model achieves better scores on long sequence suite derived from Scrolls and validation set of ZeroScrolls, a benchmark developed by @TelAvivUni and @MetaAI
. (3/10)

SN-13B-8K-Instruct Open Source Model Outperforms Long Sequence Competitors

By

–

07 August 2023 18h16

Today we are excited to introduce and open source SN-13B-8K-Instruct, an 8K SS model that achieves better accuracy than leading long sequence open source models specialized for long sequence size tasks. (1/10)