Wrong lesson from GPT paradigm — text is all you need. Other modalities will be incredibly stunning. Can feel it already from DALL-E, which can do something quite useful despite its nascent language ability.
@gdb
-
Text as Complete Human Experience Description in GPT Models
By
–
Big takeaway from the GPT paradigm is that the world of text is a far more complete description of the human experience than almost anyone anticipated.
-
The Joy of Shipping Code and Impacting Real Users
By
–
Writing code for is not very fun for its own sake. What makes it insanely addictive is the feeling upon shipping — that actual people are doing something useful with what started as a figment of your imagination. Never gets old.
-
Fundamental vs Accidental Complexity in Software Engineering
By
–
Software complexity comes in two forms — fundamental & accidental. The task of a software engineer is to discover & write down the fundamental complexity of a solution to a problem, while inventing the minimal amount of accidental complexity.
-
Designing Software: Balancing Optimization with Future Flexibility
By
–
Hardest part about designing good software is pricing in potential future needs. Easy to optimize a piece of code while making it impossible to change the spec, or design clean abstractions that will be circumvented once you add a new concept. Anticipating possible futures is key
-
Zoom Plugin Creates Personalized Backgrounds Using DALL-E
By
–
Zoom plugin to create personalized background images using DALL-E — very high usefulness to complexity ratio.
-
AI Model Predicts Car Price Make Model From Photo
By
–
Predicting price/make/model/etc from a photo of a car. Pretty cool that these days you can do this kind of thing as a side project.
-
2023 Will Accelerate AI Advancement and Adoption Significantly
By
–
Prediction: 2023 will make 2022 look like a sleepy year for AI advancement & adoption.
-
ML Development: Prioritize Quality-of-Life Code Improvements
By
–
When editing an ML codebase, I recommend constantly taking small detours to make quality-of-life tweaks as you notice them, rather than send them off to languish in a bug tracker. Highest order bit in ML in iteration speed, and these small pains add up faster than you know.
-
Experiment-Based Goals Over Outcome Targets in Tech
By
–
A management lesson we learned early on in Dota. We'd initially set goals of the form "beating X player by Y date", but when we fell behind, wasn't clear to anyone how to speed it up since we didn't know what would work. Great results from instead "try X experiment by Y date".