Great list to get started with Deep Learning.
RESEARCH
-
Flan-T5 vs GPT-3.5: Fine-tuning and Zero-shot Comparison
By
–
Great post! Just a clarification, was Flan-T5 further finetuned on any data or was it both few/zero shot for gpt3.5 and Flan-T5?
-
Joy Buolamwini: AI Ethics Pioneer Detecting Bias
By
–
Celebrating the contributions of Joy Buolamwini, a leading computer scientist and #AI ethicist. Joy's work on using #AI to detect bias & promote accountability has been groundbreaking & is a shining example of what can be achieved with technology for good. #BlackHistoryMonth
-
SpeechT5 Deep Dive Workshop on Hugging Face Discord
By
–
We're going to be taking SpeechT5 apart with @juancopi81 in the Hugging Face discord at 17:00CET. Come be a part of the fun! o/ https://
discord.com/events/8795489
62464493619/1074631980232228885
… -
AI Leaders Share Insights on ChatGPT and NLP Transformation
By
–
Insights from 7 AI leaders reveal the tremendous potential and challenges of this cutting-edge technology. Learn how ChatGPT is transforming natural language processing and paving the way for exciting new applications: http://
bit.ly/3Eohz6W @karpathy @AndrewYNg @GaryMarcus -
Few Organizations Can Train 100B+ Parameter Models Estimate
By
–
Definitely way less than 200. A wide spectrum on what it means to "train 100B+ parameter models". But I would estimate this number to be <50 optimistically.
-
Instruction Tuning as a Form of Data Improvement
By
–
Yeah, instruction tuning is kinda like "better data"
-
Finetuning vs Emergence: Different Paths to Model Abilities
By
–
Finetuning is a great way to bring an ability to a smaller model. Emergence often occurs for an ability that is *not* explicitly trained for, just by increasing scale (compute/ model size).
-
Inductive Bias and Data Shape Emergence of AI Abilities
By
–
Inductive bias, data and other changes does influence the point where emergent abilities emerge. We showed this in UL2R paper: https://
arxiv.org/abs/2210.11399 I also wrote a blogpost: -
AI’s potential to transform our understanding and experience of death
By
–
Recent developments in #artificial #intelligence (#AI) suggest that it may be possible to change the way we think about and experience #death. Here, we explore some of the options that may be available to those who wish to avoid death.