OPEN SOURCE

–

31 October 2024 11h10

Check out the model checkpoints here:

Meta Releases MobileLLM: Depth Critical Over Width

By

–

31 October 2024 11h10

Meta released MobileLLM – 125M, 350M, 600M, 1B model checkpoints! Notes on the release: Depth vs. Width: Contrary to the scaling law (Kaplan et al., 2020), depth is more critical than width for small LLMs, enhancing abstract concept capture and final performance Embedding

Hugging Face Releases AutoTrain Advanced Open Source Code

By

–

31 October 2024 10h43

And the code lives free for anyone to use too! https://
github.com/huggingface/au
totrain-advanced
…

The Power and Possibilities of Open Source Software

By

–

31 October 2024 6h15

The beauty of open source is that you can do all of that and more.

Community Praise for Open Source and Scientific Contributions

By

–

31 October 2024 5h39

Class apart! – I love all that y’all do for open source & science!

→ View original post on X — @_jasonwei

SimpleQA Evaluation Tool Update on GitHub

By

@_jasonwei

–

31 October 2024 5h08

https://
github.com/openai/simple-
evals/blob/main/simpleqa_eval.py#L104C19-L104C97
… Updated here!

→ View original post on X — @soumithchintala

Building Large-Scale Clusters to Train and Release Llama

By

@soumithchintala

–

31 October 2024 4h06

its super fun to build very very large clusters, train llama on them, and release it for y'all to enjoy — and talk in great detail about how we did it!
It's also really fun to partner with @Ahmad_Al_Dahle in creating this disruptive chaos Join us, there's lots of work to do!

→ View original post on X — @jiqizhixin

Open Source TTS Model MaskGCT Released

By

@jiqizhixin

–

31 October 2024 3h43

introducing an opensource TTS model Masked Generative Codec Transformer (MaskGCT)!!!, https://
arxiv.org/abs/2409.00750 https://
github.com/open-mmlab/Amp
hion/tree/main/models/tts/maskgct
…