Language model optimization report I did 18 years ago at Google to fulfill Waterloo coop requirements. Dusted it off after all these years. Written as a 19 year old intern with the incredible SMT team. Have been working on Machine Learning since then.
@reza_zadeh
-
Pope Francis Addresses G7 Leaders on AI Opportunities and Risks
By
–
It was an honor to meet Pope Francis at the G7 summit sidelines in Italy on Saturday. His Holiness is the first pontiff to visit the G7. He came to give a specially prepared message of optimism about AI and also of concern for its applications to CEOs of major companies. I was
-
Vibrations Help Unwinding Bolts: Matroid Ensures Aircraft Safety
By
–
Vibrations are surprisingly good at unwinding bolts. This is why spacecraft and aircraft manufacturers use Matroid to check their bolt safety wires, which tie bolts down. pic.twitter.com/WFFD6VtYzP
— Reza Zadeh (@Reza_Zadeh) 3 juin 2024Vibrations are surprisingly good at unwinding bolts. This is why spacecraft and aircraft manufacturers use Matroid to check their bolt safety wires, which tie bolts down.
-
Emotions: Ancestral Foundation Models Encoded in Our Genetics
By
–
Emotions: super distilled foundation models continuously trained & passed onto us by our ancestors, through genetics & evolution.
-
Adversarial Patches Can Fool Vision-Guided Missiles
By
–
Adversarial attacks can fool vision-guided missiles. Matroid can fool them with a patch.
-
Non-profits Tax-Free Status Should Require Open-Source Software
By
–
If a non-profit benefits from tax-free status, any software it produces must be open-source, since the software and IP was partially publicly funded. What's your opinion?
-
Maximizing Convex Functions: NP-Hard Problem in Machine Learning
By
–
Almost every ML personal gets confused you tell them that maximizing a convex function is NP-Hard for this reason
-
Machine Learning Replaces Polynomials as Primary Modeling Paradigm
By
–
It’s weird to think of “deprecating” polynomials. That’s what ML is doing. For around 3 centuries polynomials have ruled as the de-facto go-to model for modeling natural phenomena. Now, automatically generated models will reign supreme for a few centuries.
-
Reza Zadeh reflects on 18 years in Silicon Valley innovation
By
–
18 years ago tomorrow, I landed in Silicon Valley to work on Google Translate team (which created the Transformer), & trained the world's largest language models at the time. Today, I'm even more excited by what SV will invent as that LM knowledge has spread to all of SV.
-
Y2K Bug Hysteria Compared to Deceleration Concerns
By
–
Y2K bug hysteria approximates decel hysteria