The evolving definition of reality:
1980s: Reality.
2000s: Search engine results.
2020s: Chatbot output.
@pmddomingos
-
The Evolution of Reality: From Physical to Digital Definitions
By
–
-
Essential innovations beyond scaling in modern machine learning
By
–
Anyone who claims that the successes of modern machine learning are just due to scaling up needs to explain away each of these essential pieces:
– Adam
– Batch norm
– Resnets
– Contextual embeddings
– Transformers -
Backpropagation: Simple Optimization from Psychological Perspective
By
–
It's remarkable both that backprop is just a simple optimization scheme and that it took a psychologist to come up with it.
-
Fusion Power May Arrive Before Self-Driving Cars
By
–
We might even get fusion power before self-driving cars.
-
Google’s ChatGPT Alternative Will Use Personal Data for Fine-Tuning
By
–
Google’s version of ChatGPT will be fine-tuned on all the data it has about you. Then the real fun begins.
-
Intelligence as Expensive Backup When Knowledge is Absent
By
–
Intelligence is an expensive backup for when you don’t have knowledge.
-
Knowledge as Power: AI’s Timeless and Modern Truth
By
–
Knowledge is power: the oldest AI truism and the newest.
-
ChatGPT as Automated Labor Without Human Workers
By
–
ChatGPT is a mechanical turk without the turk.
-
Deep Learning Progress Continues Across Multiple Dimensions
By
–
Deep learning is making fast progress in some dimensions and not so in others. It's premature to say it has it a wall. E.g., look at what's happened since your article.
-
Early ML Extraction Story: Manager Unhappy with 95% Accuracy
By
–
Story from the early days of ML in information extraction:
Manager: So how good is your ML-based extractor?
Engineer: 95% accurate.
Manager: How dare you? Don't come back until you've debugged it.