Thrilled to see the positive feedback from the community, especially when it comes to something we are deeply passionate about @h2oai
: Democratizing #LLMs. The winner is h2ogpt falcon-7b model: https://
youtu.be/1yHNth_yzcw via @YouTube
OPEN SOURCE
-
H2O Celebrates h2ogpt Falcon-7B Win in LLM Democratization
By
–
-
Running State-of-the-Art Models Locally Six Months Prior
By
–
This is far from state-of-the-art, but I was already able to do this on my local machine with open-source models six months ago: https://t.co/aEauJTXeZs
— hardmaru (@hardmaru) 10 juin 2023This is far from state-of-the-art, but I was already able to do this on my local machine with open-source models six months ago:
-
Otter: Multi-modal Model with Enhanced Instruction Following
By
–
Otter is a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo developed by @laion_ai
), trained on MIMIC-IT dataset and showcasing improved instruction-following and in-context learning ability. -
Falcon vs LLaMa: Evaluation methodology comparison issues
By
–
Cool though at the moment the comparison with Falcon doesn’t make any sense since the numbers come from two different evaluation setups (EleutherAI harness for Falcon on the leaderboard and Francis setup for LLaMa in this thread).
-
New short: generate music with AI and text (MusicGEN)
By
–
New YouTube short! It is possible to generate music using #AI with just a text and it’s amazing!! Less than 48 hours ago, @MetaAI released a new paper with the code to make #MusicGEN work. I explain it to you.
-
LLama Adapter Development Benchmarked Against ChatGPT
By
–
yes, but we're working on an adapter on top of LLama too. Something we hope will be decently benched vs chatgpt.
-
Llama and QLoRA: The Cost-Effective Path to LLM Competition
By
–
Also don't forget llama exists and weights are available all over the internet. It's illogical to build an LLM from scratch if your goal is build a Chatgpt competitor. Qlora exists to reduce compute costs. Cost argument is weak unless there's some need to reinvent the universe.
-

Instruction Tuning Capabilities on Open Source Resources
By
–
How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources Wang et al.: https://
arxiv.org/abs/2306.04751 #ArtificialIntelligence #DeepLearning #MachineLearning -
SlimPajama Tools Released for Building AI Models
By
–
Here are the tools we created to build SlimPajama. Have fun! x.com/dmsobol/status…
-
SlimPajama Tools Released for Open Source AI
By
–
Here are the tools we created to build SlimPajama. Have fun!