Yeah. And we still don't know why OpenAI models are better: 1. More and better data?
2. Larger pretrained base model?
3. RLHF instead of supervised finetuning? My guess is it's probably all of these above.
MACHINE LEARNING
-
Reasons Behind OpenAI Models’ Superior Performance Remain Unknown
By
–
-
Dataset Importance for LLM Fine-tuning: Camels Paper Insights
By
–
And the recent "How Far Can Camels Go" paper (
https://
arxiv.org/abs/2306.04751) is a nice example of how important the dataset for LLM finetuning is. -
Survey Shows 73% Pressure for AI Adoption in Enterprises
By
–
According to a global survey of 1,000 HR, finance, and IT decision-makers, 73% are feeling the pressure to increase AI adoption, but many don’t know how to best utilize the technologies. The report gives guidance on #AI #MachineLearning adoption
-
Avoid Data Fallacies to Unlock Full Potential in Data Science
By
–
Stop making assumptions about data and unlock its full potential! Avoid common #DataFallacies and use the right strategies for successful #DataScience projects. By @ingliguori #AI #BigData #CloudComputing #Fintech #Python #Cybersecurity #100DaysOfCode #JavaScript #IoT #innovation
-
OpenFlamingo v2: Enhanced Multimodal AI Model Released
By
–
Our friends @anas_awadalla (U of Washington) and @irena_gao (Stanford) released this cool project with our compute support: OpenFlamingo v2: New Models and Enhanced Training Setup. Pls check it out on our AI blog and provide feedback!
-
Python: A Versatile Language for Development and Data Science
By
–
Python is a versatile programming language that can be used for web development, data analysis, artificial intelligence, automation, scientific computing, and much more! By @ingliguori #Python #Programming #AI #DataScience #DEVCommunity
-
Following 70000 AI Accounts: Inside an AI Enthusiast’s Feed
By
–
I am the only human to follow 70,000 in AI. On vacation now but check out my like feed.
-
Digital Data Guardrails: First Step in AI Regulation
By
–
Digital data guardrails are the first step in regulating AI
#AI #AIio #BigData #ML #NLU #Futureofwork http://
ow.ly/wlm830svSeE -
Digital Data Guardrails: First Step in AI Regulation
By
–
Digital data guardrails are the first step in regulating AI
#AI #AIio #BigData #ML #NLU #Futureofwork @ahier @guzmand
@DavidBrin @denisegarth @dez_blanchfield @diioannid @DioFavatas @gerald_bader http://
ow.ly/hsBU30svSt1 -
Why Train Models on Multiple Languages Instead of Single Language
By
–
Why do we need to train a model on 30 different languages? Why can't we train a model on just 1 language say python or JS ? Is it because there isn't enough training data ? – @lazyiitian