Pumped to announce the brand new open LLM leaderboard. We burned 300 H100 to re-run new evaluations like MMLU-pro for all major open LLMs! Some learning:
– Qwen 72B is the king and Chinese open models are dominating overall
– Previous evaluations have become too easy for recent
@clementdelangue
-
New Open LLM Leaderboard: Qwen 72B Dominates Chinese Models
By
–
-
Open-source AI models integrated into Firefox browser
By
–
Very cool to see HuggingChat and as a result dozens of open-source models (example below with Command R+ by @CohereForAI
) make their way into @firefox
! This is not in-browser (yet) but would be super exciting to make sure no data is sent to servers: https://
blog.nightly.mozilla.org/2024/06/24/exp
erimenting-with-ai-services-in-nightly/
… -
Enterprise AI Roadmap: Strategic Guide for Organizations
By
–
Great enterprise AI roadmap by @CBinsights
: https://
cbinsights.com/research/repor
t/enterprise-ai-roadmap/
… -
Cohere’s Aya-23 multilingual model performance review
By
–
https://
huggingface.co/spaces/CohereF
orAI/aya-23
… from @CohereForAI is supposed to excel in multi-lingual. Could you try and share what you think? -
Submit Your Favorite Research Papers for Community Feedback
By
–
Friday is for research paper reading! Can you submit your favorite ones here and I'll check them out: https://
huggingface.co/papers/submit? It will give extra visibility to them thanks to @_akhaliq (we badly need more visibility for open research papers) and feedback from the community! -
Five Myths About AI Impact on 2024 Elections
By
–
Great article from @IreneSolaiman in @techpolicypress
! https://
techpolicy.press/five-myths-abo
ut-how-ai-will-affect-2024-elections/
… -
Nvidia Becomes World’s Most Valuable Company Through AI Boom
By
–
Just a few short years after it started booming, AI has already created the most valuable company in the world (aka @nvidia
). Let that sink in for everyone who says there's no money in AI! -
Argilla Open Source Project Seeks Community Contributions
By
–
yes! Want to open issues/pull requests here: https://
github.com/argilla-io/arg
illa
…? We'll need the whole community help! -
Major AI Acquisitions: Who Acquires Whom in AI Landscape
By
–
Are you seeing the same thing? Who should acquire who? After @Gradio
, we just acquired @argilla_io -
Open weights models on Hugging Face for visibility
By
–
nice! would be super cool to get open weights or space on HF for additional visibility