Snowflake just launched the largest open-source model yet. A 482B parameter MoE. 17B active parameters and 128 experts, trained on 3.5T tokens. This model is more open than others — even the data recipe is open-source!
OPEN SOURCE
-
Chanel emerges as major open source machine learning benefactor
By
–
move over meta, the true biggest benefactor of open source machine learning is CHANEL
-
Snowflake Arctic: Massive Open-Source Model for SQL and Coding
By
–
Snowflake Arctic is a new open-source language model from @SnowflakeDB
. – It's absolutely massive (480B)
– It's very good at SQL and other coding tasks
– It cost just under $2M to train (less than half of Llama) Try it out: https://
arctic.streamlit.app -
Llama 3 and Mixtral: Major Open Source AI Model Improvements
By
–
Not when I last looked ~8 months ago but today we have Llama 3 and Mixtral and various other options that might be a whole lot better than the options last time I looked
-
Apple Releases OpenELM Open-Source Language Models Family
By
–
OpenELM: a family of Open-source Efficient Language Models Welcome Apple Inc. in the family of open-source LLM trainers! https://
huggingface.co/collections/ap
ple/openelm-instruct-models-6619ad295d7ae9f868b759ca
… And together with a new library: CoreNet https://
github.com/apple/corenet -
AgentPublic Models Available on Hugging Face
By
–
Et les models: https://
huggingface.co/AgentPublic Merci pour ce thread, très clair ! -
PhotoRoom Builds Custom Image Model Instead of Relying Closed AI
By
–
Interesting in-depth read from @BenTheEgg about how PhotoRoom trained their own image model from scratch Another proof point that you should build your own ML capabilities rather than rely on closed AI
-
Model License Terms and Commercial Use Clarification
By
–
As far as I can tell the license for this model is here – it looks to me like you can use it commercially but I don't recognize the general shape of the license and IANAL
-
OpenELM Model Weights Now Available on Hugging Face
By
–
Here are some OpenELM weights on a Hugging Face, anyone got these working yet?
-
OpenELM Training Data Sources Documentation
By
–
This is the best documentation I could find of the OpenELM training data – it looks like the bulk of it comes from RefinedWeb, RedPajama, The Pile and Dolma https://
github.com/apple/corenet/
blob/main/projects/openelm/README-pretraining.md
…