I'm still intuitively adjusting to the new world where gradient-based learning is less common/desirable. But the trend increases my confidence in an earlier prediction in my earlier "33 years from now" blog post https://
karpathy.github.io/2022/03/14/lec
un1989/
…
INNOVATION
-
Gradient-based Learning Becoming Less Common in AI
By
–
-
Base LLMs as Strong Few-Shot Classifiers Without Fine-tuning
By
–
Base LLMs (non-finetuned) make very strong few-shot classifiers. Describe task in English, give few examples, read off the label probabilities on test example. No gradient-based optimization necessary. It brings a cannon to a knife fight but is fast, convenient, strong baseline.
-
Lombard Voice Technology Integration Smart Volume Adjustment
By
–
Exactly! Glad to spread the info about Lombard voice. Let me know if you find it useful (maybe plug it into smart volume adjuster?)
-
Evaluating World Model Capabilities Across GPT Versions
By
–
The debate over questions like “does GPT have a world model” continues. No real need to argue about it based on individual anecdotes — better to just write an OpenAI Eval, and check the trendline of performance across different GPTs: https://
github.com/openai/evals -
KerasNLP Reaches 30,000 Monthly Downloads Milestone
By
–
KerasNLP adoption is still early days, but doing ok! We just crossed 30,000 downloads / month. https://
keras.io/api/keras_nlp/ -
Zed Platform Adoption Timeline and Feature Parity Question
By
–
My money is on @zeddotdev Q is how long they need to get to core feature needs parity.
-
Optimizing Pepper Voice Parameters in Noisy Environments
By
–
@EmileAndHisBots A quick and dirty takeaway for you is to consider increasing Pepper's pitch in loud environments. Joyful style works, although if saying something negative you can consider using a Lombard voice with didactic (to slow down speed) and increasing pitch by +130.
-
Rising Stars Win Best Demo Award at HRI 2023
By
–
Congratulations to rising stars Paige Tuttösí and Emma Hughson for their Best Demo Award at #hri2023!
-
Software Engineering Career Advice: Staying Relevant in Tech
By
–
An undergrad CS major similarly came to me, asking if software engineering was a dead end. John has much more relevant experience than me, but I advised similarly: there will always be a need for technical folks, as long as you keep your skills sharp and don't fall behind.
