MLX is nice, early in its complexity phase.
also tinygrad.
OPEN SOURCE
-
MLX and Tinygrad: Open Source ML Frameworks in Complexity Phase
By
–
-
Multi-Agent Collaboration Boosts AI Performance Beyond Model Size
By
–
A new study from Cornell researchers just found that increasing the number of AI agents collaborating on a problem can significantly improve performance. Notably: A 13B parameter Llama model beat a 70B version on some tasks by scaling the number of agents up.
-
LLM Agents Challenge: Porting PyTorch GPT-2 Training to C
By
–
Btw writing the llm.c training code would imo be a very interesting, impressive, self-contained and very meta challenge for LLM agents. The prompt is: Take the PyTorch code train_gpt2.py
And write, compile and unit test a single .c file that reproduces the training: train_gpt2.c -
PyTorch Layers Migration to C: Tutorial and Implementation Guide
By
–
I added a quick crappy tutorial on how PyTorch layers are moved to C, with a few possibly helpful pointers: https://
github.com/karpathy/llm.c
/blob/master/doc/layernorm/layernorm.md
… -
LLaMA 3 Release Expected to Surpass Mistral Models
By
–
LLaMA 3's will start to drop next week. Assuming there's a 7B version, I'm expecting it to far surpass the current Mistral model.
-
Llama2.c translations and broader training design possibilities
By
–
😀 😀 I really do love how llama2.c was translated to a zillion languages I've never heard about. Looking forward to that with the training too! The design space is a lot wider too because you can train stuff, not just inference a fixed, given thing.
-
Sweeps Training System for Axolotl Open Source
By
–
Built a simple sweeps system for training with Axolotl… would anyone want this/find this useful? cc @winglian
-
Stability AI Models Now Available on Hugging Face Platform
By
–
Both models are available for testing on Hugging Face and can be utilized commercially as well as non-commercially with a Stability AI Membership. You can learn more on our blog: https://
bit.ly/4aGDXqt (3/3) -
Stable LM 2 1.6B Update: Enhanced Conversations and Tool Usage
By
–
This release includes an update to Stable LM 2 1.6B, which improves its conversational skills in all of the seven aforementioned languages and incorporates tool usage and function calling. (2/3)
-
Stable LM 2 12B Multilingual Language Model Released
By
–
Stable LM 2 12B is a pair of powerful 12 billion parameter language models trained on multilingual data in English, Spanish, German, Italian, French, Portuguese, and Dutch, featuring a base and instruction-tuned model. You can now try the model here: