one exciting observation about transformers (and most modern deep learning) is that you can understand them using high school math. really just multiplication, division, sums, and exponentiation, many times, and in a strange and initially hard-to-grok order
AI
-
ML Research and Applied ML Require Different Skill Sets
By
–
The skills needed for developing new ML techniques have little overlap with the skills needed for applying ML effectively. A bit like how chip design has little overlap with software engineering.
-

Company Executives Ensure Ethical Generative AI Implementation
By
–
Company executives can ensure generative #AI is ethical with these steps https://
zurl.co/Ch5W @TechCrunch #CES #CES2024 #AI #MWC24 #IoT #5G #GenerativeAI #AIethics @SpirosMargaris @DeepLearn007 @pierrepinna @kkruse @TerriKlass -
Knowledge Distillation Paper Achieves 17k Citations Despite Skeptical Review
By
–
Fun game. Clocking 17973 citations: "Distilling the knowledge in a neural network" @geoffreyhinton
, @OriolVinyalsML
, @JeffDean Reviewer 38 (NeurIPS 2014): "This work is incremental and unlikely to have much impact even though it may be technically correct and well executed." -
Digital Innovation Drives Operational Excellence in Industry
By
–
Explore how industries achieve operational excellence through digital innovation and tech integration at the 28th Annual ARC Industry Forum. Register: https://t.co/d7y0Za3AWV #arc_iiot #ARCForum #DigitalInnovation #OperationalExcellence #digitaltransformation @andi_staub pic.twitter.com/r8X1nL9f5n
— Lucian Fogoros (@fogoros) 27 janvier 2024Explore how industries achieve operational excellence through digital innovation and tech integration at the 28th Annual ARC Industry Forum. Register: https://
ow.ly/2x3f50QqvE0 #arc_iiot #ARCForum #DigitalInnovation #OperationalExcellence #digitaltransformation @andi_staub -
Utility Function Terminology and Human Evolutionary Misalignment
By
–
I think that "utility function" in retrospect is a mathematical word of power that I should not have expected lay computer scientists to understand, so let's drop that. With humanity, the outer optimization criterion was inclusive fitness; our inner preference was not aligned.
-

Top 5 Finance and Economy Stories from 2023
By
–
Finance and the economy: 5 top stories from 2023 https://
zurl.co/ayiT via @wef #WEF #CES #CES2024 #AI #MWC24 @CES #IoT #5G #GenerativeAI @SpirosMargaris @DeepLearn007 @JimMarous @JimHarris @Paula_Piccard @pierrepinna -
Impressive AI Simulation and Rendering Technology Stack
By
–
Impressive simulation and rendering stack
-
Intelligence and Outcome Matching: The Core Problem Beyond Utility Functions
By
–
It isn't about "simple" utility functions or "monomania". The problem is just any sufficiently smart system whose work, on some level, can be viewed as matching up outputs and results, and learning.
-
Learning Reality and Selecting Outputs for Desired Outcomes
By
–
The problem that 'learn how reality works' and 'select outputs which, when they interact with reality, lead to X happening' is a simple great way of doing Y for a lot of possible Y. For example, with humans, Y is inclusive genetic fitness and X is all the stuff that humans want.