AutoTrain finetuned llama3 beats the base instruct model on all but one benchmark on the open llm leaderboard This model was finetuned using ORPO and is also publicly available. No code was written and all the setup took less than 10mins. `pip install autotrain-advanced`
OPEN SOURCE
-
Open-source AI models: commitment and strategic choices
By
–
I have some opinions on this matter. I don’t think everything needs to be open-source, but for models that companies decide that it is strategically better for them to release, they might as well go all the way.
-
Apache-2 Licensing vs Restrictive Community Licenses Debate
By
–
This is controversial, but I’d rather see companies release Apache-2 licensed models, but keep certain models proprietary, than release everything under some non-open-source restrictive “community” license, which has the adverse effect of encouraging and normalizing restrictions.
-
Groq and Llama3: 24 Hours of Development Updates
By
–
24 hours for Groq and #Llama3. Read more about today's developments at https://
groq.link/llama3blog. -
Need Apache-2.0 Licenses for Open-Source AI Acceleration
By
–
Although I must say that we need more Apache-2.0 style licenses, and less of these “non-commercial, research only” restrictive ‘community’ licenses for model releases to really accelerate open-source AI adoption.
-
llm-gpt4all 0.4 Release Notes Published
By
–
Release notes for llm-gpt4all 0.4 are here: https://
github.com/simonw/llm-gpt
4all/releases/tag/0.4
… -
Llama 3 8B Now Available via llm-gpt4all Plugin
By
–
I upgraded the llm-gpt4all plugin to support running Llama 3 8B Instruct (thanks, @nomic_ai
) llm install –upgrade llm-gpt4all
llm -m Meta-Llama-3-8B-Instruct 'Write Python code to print 5 great names for a pet pelican' The quantized model is a 4.34GB download, needs 8GB RAM -
Kernel optimization attempts yield minimal performance gains
By
–
added under kernel4 https://
github.com/karpathy/llm.c
/commit/cb791c4ef58d45d58e5af624b0ed41439ac7aeff
…
a bit surprised to only see ~1-2% out of it, which then washes out in training, as the layernorm is not a top-ranking time kernel. Also tried float4 and unrolling but that didn't improve it too much bleh -
PyTorch Pay-Per-Use Model Through Advanced Compiler Technology
By
–
I think some day, projects like PyTorch will make users pay only for the overhead they use. Lots of R&D needed to get there: compiler technology, type systems, various other things. Actually, LuaJIT was really cool in that aspect — one of the most brilliant pieces of
-
Major Data and AI Event: GenAI and Engineering Conference June 10-13
By
–
POV: you would do anything to get into the biggest data and #AI event of the year.
— Databricks (@databricks) 19 avril 2024
Register to hear from leading experts, researchers, and open source contributors about topics like #GenAI and data engineering and streaming.
Join us June 10-13: https://t.co/Rl8WajxnNn pic.twitter.com/x2fNrVOgAJPOV: you would do anything to get into the biggest data and #AI event of the year. Register to hear from leading experts, researchers, and open source contributors about topics like #GenAI and data engineering and streaming. Join us June 10-13: https://
bit.ly/3UlaDA7