Thought the same thing and was trying to reimplement ReMoE over the past days… Achieving the same level of utilization as the default codebase, and thus beating the wall-clock record, will not be trivial.
COMPUTING
-

Metis AI Platform Showcased at Major European Tech Events
By
–
Explore our Metis™ AI platform—a powerful hardware & software solution for edge #AI—in action at these events next week: @MEDICATradeFair #EICatMEDICA2024 | Nov 11-14, Düsseldorf @SEMIEurope | Nov 12-15, Munich
@spsmesse with @AdvantechEurope | Nov 12-14, Nuremberg -

Company exhibits at Electronica Fair Munich booth B5
By
–
Munich, come see us at @electronicaFair
, we will be in booth #B5 -
ZSpace Augmented Reality Laptop Transforms Education
By
–
The world's first augmented reality laptop.
— Pascal Bornet (@pascal_bornet) 7 novembre 2024
Invented by zSpace, this laptop combines augmented and virtual reality to bring education to the next level.
Students in medicine, engineering, or veterinary benefit significantly from this type of learning.
Here, innovation meets… pic.twitter.com/QvKeqaf9OoThe world's first augmented reality laptop. Invented by zSpace, this laptop combines augmented and virtual reality to bring education to the next level.
Students in medicine, engineering, or veterinary benefit significantly from this type of learning. Here, innovation meets -
Drupal Batch API Deep Dive: Item Processing Explained
By
–
@hashbangcode series illuminating @Drupal
's Batch API continues! In this 5th installation, take a deeper dive into how the batch system processes items https://
bit.ly/3YtIzuO #drupal #drupaldevs -

SN40L RDU Architecture Enables Fast Cost-Effective AI Inference
By
–
We're at @microarchconf 2024! And our very own @raghup17 is presenting details on the SN40L RDU architecture, and the differentiating technology enabling the fastest, cost-effective inference in the world with just 16 chips! Access the paper here: https://
bit.ly/3TKn8US -

China’s Tencent Hunyuan Beats Major AI Models Despite Sanctions
By
–
Competition is good, and China keeps the pressure high! "Tencent Hunyuan Large – 389B (Total) X 52B (Active) – beats Llama 3.1 405B, Mistral 8x22B, DeepSeek V2!" I just keep wondering how China, despite all the sanctions, gets so much compute to train such huge models. Be that
-
Databricks SQL: Materialized Views and Streaming Tables Now GA
By
–
Now GA: materialized views and streaming tables on Databricks SQL. Create efficient and scalable data pipelines – from ingestion to transformation – using just Databricks SQL. Available on AWS and Azure. Learn more
-
Japan Revitalizing Silicon Industry with Next Generation Engineers
By
–
“Not only are we getting the opportunity to nurture the next generation of Japan’s brightest engineers, but we are helping Japan revitalize their silicon industry and technology leadership.” said CCO @DavidBennett__
-

AI Development Challenges: Energy Infrastructure Investment Needs
By
–
This is a very interesting article. It once again clearly shows how challenging the path to AI will be. The question of electricity in particular is one that we are still facing and hundreds of billions need to be invested in the energy infrastructure to meet the demand and, in