We did an awesome webinar on open source LLMs last Wednesday Thanks to @nomic_ai and @MosaicML for joining Catch up on it here
OPEN SOURCE
-
Découvrez le générateur IA de QR codes Hugging Face
By
–
ICYMI: Try huggingface AI QR code generator which was released recently if you want to play around with such things https://
huggingface.co/spaces/hugging
face-projects/QR-code-AI-art-generator
… -
T5X and SeqIO remain dominant LLM training frameworks
By
–
Looks good! Would love to play with this someday. Although I think it would be hard to dethrone t5x + seqio as the best LLM training framework.
-
DeepSpeed Issue Resolution in Finetuning Script
By
–
Btw it's not a DeepSpeed bug, more like something to address in the finetuning script! Sry for the confusion!
-

LMFlow-CHAT: Robin Series V2 Language Model Upgrade
By
–
LMFlow-CHAT demo: https://
huggingface.co/spaces/Optimal
Scale/Robin-7b
… fully upgraded Robin Series V2 language model carried out in-depth fine-tuning based on the entire LLaMA series, including 7b, 13b, 33b, 65b, all of which have achieved pleasing results. Robin-7b scored 51.7 in the OpenLLM standard -
Falcon’s Rise Signals New LLM Competitors on Horizon
By
–
The challenges it faces go beyond just those that go into making a commercially permissive model. If Falcon came out of nowhere and was highly competitive on some benchmarks, what else is in the works that can do the same—or pass—LLaMA? Unclear! But surely they are in development
-
Meta dominates AI landscape with PyTorch and LLaMA models
By
–
Meta has consistently outmaneuvered Google (and OpenAI/Microsoft by extension) in AI, both open source and the sheer volume of research it releases on a regular basis. It's pretty much locked up the ML dev ecosystem with PyTorch, and is well on its way w/ LLaMA.
-
Emerging Open Source Language Models After LLaMA Leak
By
–
But several other models have emerged since LLaMA leaked in early March. MPT-7B from MosaicML. RedPajamas-INCITE from Together (based on a data set similar to LLaMA). Alpaca. Vicuna. Instruction-tuned versions of all of the above. Plus *many* domain specific ones like Starcoder.
-
Falcon 40B Apache release may accelerate Meta’s LLM timeline
By
–
People I've talked with have speculated that the release—and abrupt change to an Apache license—of Falcon 40B might accelerate Meta's timetable for release. It made an enormous splash as being both commercially permissive and competitive with LLaMA.
-
Meta evaluates commercial release strategy for 3B AI model
By
–
I reported earlier last month that Meta was evaluating what model(s) to make commercially permissive, and at the time was evaluating a 3B model. Obviously a lot goes into putting out a commercially permissive one vs. just one for research.