LLM customization ecosystem is heating up – Remarkable that prompt engineering works at all, but stagnates
– Retrieval can help few-shot prompts, but still…
– Finetuning (BC/RL) is the cannon. But is much more involved
Congrats @realSharonZhou & @GregoryDiamos on the launch!
@karpathy
-
LLM Customization Ecosystem: From Prompting to Finetuning
By
–
-
LLM Hallucinations: Origins, Mitigation Strategies, and Open Problems
By
–
Great tech talk on subtleties of LLM hallucinations by @johnschulman2 : where they come from, how to mitigate them, remaining open problems. https://
youtube.com/watch?v=hhiLw5
Q_UFg
… -
FaceTime with ChatGPT: Voice Interaction Experience Enhancement
By
–
FaceTime with ChatGPT https://t.co/52qfpzChrX
— Andrej Karpathy (@karpathy) 27 avril 2023
Fun, qualitatively different experience over "texting"
Ty @CallAnnieAI for shoutout to my tweet a ~year ago pitching this as an idea https://t.co/LE6dYcDsxZ
With improvements to personality, latency, ASR/TTS could be magical ✨ https://t.co/eMeYzyum5TFaceTime with ChatGPT https://
callannie.ai
Fun, qualitatively different experience over "texting" Ty @CallAnnieAI for shoutout to my tweet a ~year ago pitching this as an idea https://
x.com/CallAnnieAI/st
atus/1651379993413558272
… With improvements to personality, latency, ASR/TTS could be magical -
Gen2 Video Generation and ControlNet Advances Impress Karpathy
By
–
wow. coming from @runwayml #Gen2 https://t.co/P1xedllGbV
— Andrej Karpathy (@karpathy) 21 avril 2023
While on the topic of video generation I was also mildy mind-blown a few days ago by multiControlNet and friends: https://t.co/EJyjDi7wNS
And the earlier, bit more professional take, "anime rock paper scissors":… https://t.co/JJhIiucyDnwow. coming from @runwayml #Gen2 https://
research.runwayml.com/gen2 While on the topic of video generation I was also mildy mind-blown a few days ago by multiControlNet and friends: https://
reddit.com/r/StableDiffus
ion/comments/12i9qr7/i_transform_real_person_dancing_to_animation/
… And the earlier, bit more professional take, "anime rock paper scissors": -
LoRA Finetuning: Shifting the Balance in LLM Adaptation
By
–
There's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic in favor of the former for many applications.
— Andrej Karpathy (@karpathy) 20 avril 2023
PEFT (Parameter Efficient Finetuning, LoRA included) are emerging techniques that make it… https://t.co/u3Udqpk3dzThere's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic in favor of the former for many applications. PEFT (Parameter Efficient Finetuning, LoRA included) are emerging techniques that make it
-
Embedding and Ranker Choices: Ada and kNN Performance Comparison
By
–
For science I also added:
– Choice of Embedding: simple tfidf bigrams or the OpenAI API embeddings ada-002 (ada should work better (?), tfidf is much much simpler)
– Choice of Ranker: kNN (much faster/simpler) or SVM
Default that seems to be both good & fast is ada+knn -
Search Limitations and Embedding-Based Content Search Extension Possibilities
By
–
Sorry right now you can only search for specific movies. It's possible to search by content because you can embed the query and search by it, this could be a good extension. I tested it just in console briefly but didn't incorporate into UI, felt a little bit flaky
-
Copilot and ChatGPT accelerate project development by 2-3X
By
–
heavy use of copilot and chatgpt, if i had to guess probably sped up the project somewhere around 2-3X or so. "old fashioned way" has become nonsensical
-
Weekend Hack: Movie Search Engine Using OpenAI Embeddings
By
–
Fun weekend hack: https://
awesome-movies.life
Took all 11,768 movies since 1970
Took each movie's Summary+Plot from Wikipedia, embedded it with OpenAI API (ada-002) Wrapped it up into a movie search/recommendation engine site 🙂
it works ~okay hah, have to tune it a bit more. -
Linear Model Training with Sample Weights for Class Balance
By
–
didn't follow but sounds interesting. "train a linear model with sample weights to class balance"…?