Want to learn how to program a game with ChatGPT and Replit? Great article from @_buildspace on how to start:
LLMS
-
Flan-T5 vs GPT-3.5: Fine-tuning and Zero-shot Comparison
By
–
Great post! Just a clarification, was Flan-T5 further finetuned on any data or was it both few/zero shot for gpt3.5 and Flan-T5?
-
AI Leaders Share Insights on ChatGPT and NLP Transformation
By
–
Insights from 7 AI leaders reveal the tremendous potential and challenges of this cutting-edge technology. Learn how ChatGPT is transforming natural language processing and paving the way for exciting new applications: http://
bit.ly/3Eohz6W @karpathy @AndrewYNg @GaryMarcus -
Few Organizations Can Train 100B+ Parameter Models Estimate
By
–
Definitely way less than 200. A wide spectrum on what it means to "train 100B+ parameter models". But I would estimate this number to be <50 optimistically.
-
Instruction Tuning as a Form of Data Improvement
By
–
Yeah, instruction tuning is kinda like "better data"
-
Finetuning vs Emergence: Different Paths to Model Abilities
By
–
Finetuning is a great way to bring an ability to a smaller model. Emergence often occurs for an ability that is *not* explicitly trained for, just by increasing scale (compute/ model size).
-
ChatGPT Next Stage: From Text-to-Image Generation Evolution
By
–
Yeah, I think this is the way. First stage was txt-to-image, next stage is ChatGPT for image generation.
-
Inductive Bias and Data Shape Emergence of AI Abilities
By
–
Inductive bias, data and other changes does influence the point where emergent abilities emerge. We showed this in UL2R paper: https://
arxiv.org/abs/2210.11399 I also wrote a blogpost: -
ChatGPT app generates entire Google Slides presentations using your OpenAI key
By
–
ChatGPT for generating slides:
— AI Breakfast (@AiBreakfast) 21 février 2023
Slick app that uses your OpenAI key to integrate into Google Slides – builds the entire presentation.https://t.co/65cXRlgKtk pic.twitter.com/7YkrGnCepdChatGPT for generating slides: Slick app that uses your OpenAI key to integrate into Google Slides – builds the entire presentation. https://
gptforslides.app -
ChatGPT’s Attention Problem: Irony of Focus in AI Era
By
–
#ChatGPT and #GPT3 are awesome. But the are distracting. How cosmically ironic that the paper that started all this transformer stuff was titled "Attention Is All You Need". Yes it is true, after #GPT has robbed us of our ability to focus, attention is all we need. Funny, right?