transformers came out in 2017, just as i was coming onto the scene (maybe slightly before)
RESEARCH
-
AI Hype and Journalism Discussion with Expert Panelists
By
–
Mystery AI Hype Theater 3000 fans, get ready for our next episode! @alexhanna and I will be joined by the inimitable @_KarenHao to talk about AI hype and journalism! Live stream Monday March 25, 5pm Pacific
-
Proprietary Data Less Useful Than Expected for Pre-trained Models
By
–
After years of AI meaning building your own models trained on proprietary data, one of the hardest things for firms to grasp is that their own data is much less immediately useful for pre-trained models The value in adding data in a use case will require experimentation to learn
-
Three Major ML Breakthroughs: What Comes Next?
By
–
since i got into ML in 2017 or so there have been exactly three major advancements: 1. web-scale language model pretraining (OpenAI, 2020)
2. diffusion models (OpenAI, 2020)
3. language model refinement via human feedback (OpenAI, 2022) what’s next? it’s been a while -
GPT-5 Expected in Summer 2024
By
–
I announced it in a video two days ago: #GPT5 will indeed be released in 2024, and it’s even expected during the summer! Source:
@BusinessInsider Some people very close to OpenAI are already testing it. And according to them, it’s incredibly powerful! https://archive.is/20240320141522/https://www.businessinsider.com/openai-launch-better-gpt-5-chatbot-2024-3
… -
Book Publication: Code Dependent on AI Giants and Power
By
–
IT’S PUBLICATION DAY! To celebrate, (1) my kids are taking in Code Dependent for show-and-tell (all publicity is good publicity..) and (2) I am spending all day writing about AI giants and power, which is perfect. Here it is, in amongst my bookshelf chaos. https://
tinyurl.com/3x3jdb4z -
NotBadAI Reflective AI, Greenly’s Record Funding, Saudi Arabia AI Investment
By
–
NotBadAI, l'IA qui réfléchit, la levée record de Greenly, l'Arabie Saoudite met le paquet sur l'Intelligence Artificielle NotbadAI : l’IA qui réfléchit avant de parler
Des chercheurs de Stanford et un groupe qui se fait appeler "Notbad AI" ont fait équipe pour créer un -
Hinton argues intelligent machines possess understanding and subjective experience
By
–
An important take on intelligent machines today, arguing that they already have understanding and subjective experience , by Geoffrey Hinton | https://
youtu.be/iHCeAotHZa4?si
=xOljp9ngspiela_v
… via @YouTube