regardless of the outcome and results of the reflection-70b dive-in, the amazing thing about open-weights and open-source is how the whole community can dive in these questions together and study the model transparency in AI is becoming so crucial as the field grow
@thom_wolf
-
Robotics Project Tops GitHub AI Trending Section
By
–
i'm pretty sure it's the first time I see a robotics repo topping github's AI trending section huge congratulations @RemiCadene @alibert_s @asoare159 @mar1nab @AractingiMichel @HaixuanT @JessMoss429864
-
Open-source AI: Efficient video training storage for robotics
By
–
One of the essential next step in open-source ai the results of several months of exploration, benchmarking, collaborations – efficient video training/storage for robotics and video models – finally out
-
Getting Started with Real Robot on Hugging Face
By
–
Yes! here: https://
github.com/huggingface/le
robot/blob/main/examples/7_get_started_with_real_robot.md
… -
Aleph-Alpha Joins Open-Weight AI Community with Open Knowledge
By
–
So great to welcome Aleph-Alpha in the OSS/open-weight AI community! Impressive open-knowledge approach https://t.co/f76SdM454v
— Thomas Wolf (@Thom_Wolf) 26 août 2024So great to welcome Aleph-Alpha in the OSS/open-weight AI community! Impressive open-knowledge approach
-
Open-source robotic AI revolution with cheap 3D-printed arms
By
–
-
Training LLM Engineers and Open-Sourcing Knowledge at Scale
By
–
3 years ago we trained a big LLM together with +1000 people one of the part I'm most proud of is how it became the school for a generation of model training engineers as well as a strong push for sharing and open-sourcing knowledge in the field
-
Stable FP8 Training Recipe for Llama Models
By
–
Summary of stable FP8 training recipe for Llama models:
1. Clip learning rate when 2nd moment estimator is outdated by coming spike – see https://
arxiv.org/abs/2304.13013
2. SmoothQuant: smooths activation outliers by migrating the quantization difficulty to weights – see -
SmolLM 360M: Instant Lightweight Language Model Browser Demo
By
–
Sharing one demo which is blowing my mind, the new instant SmolLM 360M running live in your browser: https://
huggingface.co/spaces/Hugging
FaceTB/instant-smollm
… And find more info here: https://
huggingface.co/collections/Hu
ggingFaceTB/smollm-6695016cad7167254ce15966
… And here: -
Synthetic Data and Small Language Models Journey
By
–
It’s Sunday morning we have some time with the coffee so let me tell you about some of our recent surprising journey in synthetic data and small language models. This post is prompted by the coming release of an instant, in-browser model called SmolLM360 (link at the end) The