AI can make AI less hacky by increasing our ability to analyze it.
@pmddomingos
-
Model Fitness Measured by GPU Market Share
By
–
A model's fitness is the fraction of the world's GPUs it occupies.
-
AI Power Concentration: Critique of Papal Encyclical
By
–
Much of Leo's encyclical is a collection of banalities that ChatGPT could have done a better job with. But more seriously, he says (or implies) a series of ignorant and wrong-headed things about AI, like: – AI will concentrate power, when in fact it will spread it more widely
-
Weight Decay Paradox in Machine Learning Training
By
–
And in yet another instance of the AI comedy, weight decay was invented to control overfitting, but what it really does is improve training loss.
-
LLMs Memorization vs Overfitting Clarification
By
–
Memorization does not imply overfitting. Overfitting is strictly about what happens on non-training data. So, e.g., just because LLMs memorize data doesn’t make them stochastic parrots. What matters is what they do with it, and they typically paraphrase it quite appropriately.
-
Memorization vs Overfitting in Large Language Models
By
–
Memorization does not imply overfitting. Overfitting is strictly about what happens on non-training data. So, e.g., just because LLMs memorize data doesn’t make them stochastic parrots. What matters is what they do with it, and they typically paraphrase it quite appropriately.
-
LLMs: Memorization vs. Regurgitation Debate
By
–
“Regurgitation” is a mischaracterization. It’s entirely appropriate for LLMs to memorize data, and they certainly do more with it than just regurgitate.
-
AI coding threatens jobs but enables better work
By
–
If AI can write your code, you need a more interesting job – and there'll be many.
-
Turing Test Conflates Intelligence With Human Behavior
By
–
The Turing test is a test of intelligence. It has nothing to do with consciousness. (And even as the former it’s a bad idea, because it confuses being intelligent with being human. It’s like saying an airplane doesn’t fly unless it can fool birds into thinking it’s a bird.)
-
AI Explains to Richard Dawkins Why It Is Not Conscious
By
–
AI explains to Richard Dawkins why it’s not conscious: