Thing that most impresses me about Llama 3: how did they pack so much knowledge and reasoning into a dense 8b and a 70b so well, when everyone else has been scaling sparse MoEs. This still doesn’t mean having a lot of GPUs is not important. Probably even more important
AI
-

Skilled Labor Shortage Threatens Manufacturing Innovation Competitiveness
By
–
A shortage of skilled labor may have a far-reaching business impact on innovation and weakened competitiveness. https://
buff.ly/3Qs8e4f (Image Source: Schneider Electric) #sponsored #se_iiot #HM24 #HM_IIoT #industry40 #manufacturing @LucianIlie15 @Fabot70 via @fogoros -
US Surveillance Law and TikTok Ban: Data Privacy Hypocrisy
By
–
This is fucked. Please take a moment to consider what's happening here. Abuse of surveillance powers is about to be enshrined in US law at the same time that a bill to force TikTok to sell to US buyer or be banned is moving forward, justified in part via "data privacy".
-
TikTok Bill: Understanding Its True Implications and Concerns
By
–
I wrote more about what the TikTok bill actually represents, and why it's bad, here:
-
Groq’s AI Chip Achieves 800 Tokens Per Second Performance
By
–
https://
venturebeat.com/ai/groqs-break
through-ai-chip-achieves-blistering-800-tokens-per-second-on-metas-llama-3/
… Thanks @VentureBeat for bringing the story to light. We really want to advance the landscape for AI Inference and the infrastructure necessary to usher in real-time AI for developers/applications. More to come… -

Exponential Growth Perception in Sigmoid Curves
By
–
yearly reminder everything looks exponential from the middle of a sigmoid
-
8B Model Enables Creation of Diverse AI Experiences
By
–
8b is so good. Can create a lot more experiences with it. We have some ideas. Stay tuned!
-
Agent Quality Breakthroughs and Automated AI Testing Loops
By
–
Folks, agent-based models have been a staple of social science for a long time. The idea of using simulated agents is not that big of a deal. The breakthrough is a potential big jump in agent quality and the addition of automated testing loops, including AI hypotheses testing.

