It can be unintuitive why the Transformer-style MoE (in Mixtral/GPT4) has inference benefits.
Dima simplifies it with a clear explanation showcasing that MoE help inference once there's sufficient volume of requests (which hopefully are diverse enough that they don't hit the same
AI
-
MoE Inference Benefits: Why Mixture of Experts Improves Performance
By
–
-
torch2jax: Run PyTorch Models in JAX Framework
By
–
GitHub – samuela/torch2jax: Run PyTorch in JAX. https://
bit.ly/47Hy9vl #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Welcome to the World Thomas: Born in AI’s Most Interesting Era
By
–
Congrats! Welcome to the world Thomas. You’re being born in the most interesting time in human history. Enjoy.
-
Step App FitFi: Blockchain-Powered Fitness Metaverse Platform
By
–
#Metaverse https://
medium.com/@sales_wallet/
step-app-fitfi-a-fitness-metaverse-powered-by-blockchain-54756cc39065
… -
Speaking at NeurIPS Global South AI Workshop in New Orleans
By
–
Who else is at @neurIPS in New Orleans? I’m here for 20ish hours, speaking tomorrow for the @globalsouthinai workshop. Excited and was honored to be asked. @IEEESA
-
Automating Content Creation with Custom GPTs and AI Tools
By
–
Just a minute is all it takes to transform ideas into tweets: Voice commands for custom GPTs create the images on @ChatGPTapp
, @AdobeExpress for edits, and another GPT to craft the narrative. It’s also a fun approach to building in public -
Advanced Open Source Models and the Turing Test Challenge
By
–
No question about it. It will be interesting to see if some of the advanced open source models that have been released recently could also be fine-tuned to pass it. And I have no doubt that Turing Test has long ago been passed internally.
-
STEM Professors and Ideological Bias in Academia
By
–
I’m afraid you are wrong. Some of the most vicious ideologues I came across were all STEM professors.
-
Aspirational Futures Becoming Dystopian Reality for AI Researchers
By
–
We are rapidly approaching the point where many “aspirational” futures are becoming dystopian retro sci-if, but people who had labored their whole lives in their pursuit have not realized it yet.
-
Ideological Bias in American University Education Systems
By
–
American Universities were literally why I immigrated to America, and was fortunate enough to attend one of the most prestigious ones. Unfortunately once there I was shocked by the extreme ideological proselytizing that I encountered, which had only become even more pervasive… https://t.co/kn7yxwu6Uv
— Bojan Tunguz (@tunguz) 10 décembre 2023American Universities were literally why I immigrated to America, and was fortunate enough to attend one of the most prestigious ones. Unfortunately once there I was shocked by the extreme ideological proselytizing that I encountered, which had only become even more pervasive