LLaMa is dethroned A brand new LLM is topping the Open Leaderboard: Falcon 40B *interesting* specs:
– tuned for efficient inference
– licence similar to Unity allowing commercial use – strong performances
– high-quality dataset also released Check the authors' thread https://
x.com/slippylolo/sta
/slippylolo/status/1662082035744227330
…
@thom_wolf
-

Falcon 40B Dethrones LLaMa on Open Leaderboard
By
–
-

Open LLM Leaderboard promotes transparency and innovation in AI
By
–
just saw the shout out to the Open LLM Leaderboard from @Jason in the latest @theallinpod podcast E129 https://
youtube.com/watch?v=C762HW
Sz67w&t=972s
… on how open-source and transparency are super strong catalysts to foster innovation and trust -

Open LLM Evaluation: 228 Community Models in Queue
By
–
Super nice to see so much excitation for open evaluation of large language model. Currently 228 community-submitted models in the queue for being evaluated on the Hugging Face cluster's spare cycles and added to the leaderboard! Check it out here: https://
huggingface.co/spaces/Hugging
FaceH4/open_llm_leaderboard
… -
Philippe Tillet continues Triton development at OpenAI
By
–
yep though the real story is more that everyone was scared when Philippe (the creator of Triton) got hired at OpenAI that he would stop contributing/pushing Triton (that he created and open-sourced during his PhD) but thankfully he was allowed to continue working on it…
-
Google as Open-Sharing Player in AI Development
By
–
I definitely count Google in the good open-sharing players (and hope it will stay so) 🙂
-

Closed-Source AI Companies Hide Algorithmic Breakthroughs from Public
By
–
realized yesterday that if a closed-source AI company had invented flash attention nobody would know about it – and this makes me sad for the current state of AI knowledge sharing many cool AI algorithmic improvements are probably already being kept behind closed doors
-

Hugging Face Transformers: Five Years of Open Source AI
By
–
This is crazy! I still remember when I started coding Transformers with Victor and Tim one cold night of October 2018 in Bruxelles after attending the EMNLP conference and its social event at the Royal Museums of Fine Arts And today, 5 years after, Hugging Face Transformers is
-
Why Is Dangerous Code Writing Unrestricted for Everyone
By
–
you can write very dangerous code with a computer – how come everyone is allowed to do so
-
StarCoder 15B Outperforms Larger Models on Reasoning Tasks
By
–
We saw that with StarCoder in @BigCodeProject as well: being trained on code the 15B StarCoder is beating much larger models on HELM synthetic reasoning and logic tasks, like cohere command beta 52B, Anthropic-LM v4 52B, Aleph-Alpha Luminous Supreme 70B or OPT 175B
-
Unexpected AI Education Rules Set Discovered
By
–
Interesting unexpected set of rules for using AI in education