BTW, Since Jamba supports a 256K context with high throughput, we also stumbled upon an issue where the fused_moe kernel didn’t work well in long contexts. Others seems to have had this too, according to some other open issues
COMPUTING
-
Anomaly Detection Fundamentals for IoT Network Security
By
–
Understanding anomaly detection is key to securing #IoTnetworks. Explore the fundamentals: https://
buff.ly/4evr0lk #sponsored #influxdata_iiot #InfluxDB #IoT #AnomalyDetection @TylerCohenWood @SecureIoTGuy via @fogoros -
Cloud Computing: From Sky Gazing to Tech Expertise
By
–
If you've ever lain on the grass, gazing at the sky and spotting animal shapes in the clouds, congratulations! You’re an original 'cloud computing' expert.
-
Unified Namespace Applications in Industrial IoT Manufacturing
By
–
Practical Applications of Unified Namespace for #IIoT Use Cases https://
buff.ly/4bOVrBr #sponsored #hivemq_iiot #Industry40 #SmartManufacturing @nerdyiotguy @FrRonconi via @fogoros -
Hyland’s Tech Outreach Program: Computer Science and Digital Innovation
By
–
Remarkable initiative, @Hyland ! Hyland’s Tech Outreach program #ComputerScience #Technology #AI #IoT #5G #DigitalTransformation
-
GSMA and China Mobile Launch Innovation Hub at MWC Shanghai 2024
By
–
The @GSMA and #ChinaMobile introduce the GSMA-China Mobile Innovation Hub at #MWC Shanghai 2024: https://
mwcshanghai.com/news/introduce
-the-gsma-china-mobile-innovation-hub
… #AI #IoT #5G @SpirosMargaris @pierrepinna @DeepLearn007 @GSMAi @enilev @gvalan @Analytics_699 @Hal_Good -
Dubai Hosts World’s First Jet Suit Race Over Water
By
–
Dubai just made history with the world's first jet suit race! Eight pilots raced a kilometer over water, competing in thrilling heats. @IntEngineering #AI #IoT #5G @mvollmer1 @PawlowskiMario @enilev @enricomolinari @FinMKTG @techpearce2 Watch
-
New Computing Paradigm: LLMs as CPUs with Token-Based Architecture
By
–
🚀 OpenAI Co-founder @karpathy recently shared a groundbreaking New Paradigm for the future of computing:
— Dr. Debashis Dutta (@debashis_dutta) 7 juillet 2024
"We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM.
This is… pic.twitter.com/HJt4HJFPlXOpenAI Co-founder @karpathy recently shared a groundbreaking New Paradigm for the future of computing: "We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM. This is
-
LLMs as CPUs: New Computing Paradigm with Tokens and Context
By
–
🚀 OpenAI Co-founder @karpathy recently shared a groundbreaking New Paradigm for the future of computing:
— Dr. Debashis Dutta (@debashis_dutta) 7 juillet 2024
"We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM.
This is… pic.twitter.com/vf2hgzmdnsOpenAI Co-founder @karpathy recently shared a groundbreaking New Paradigm for the future of computing: "We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM. This is
-
AI Datacenters May Finally Unlock Nuclear Energy Adoption
By
–
It's grim that fueling AI datacenters may be the thing that finally breaks the logjam on nuclear energy. Seems Earth is a place that can't give the go to nuclear energy, until somebody finds a way to actually make that bad; and it really took some reaching to find it.