Language modelling has wildly succeeded due to current objective functions(most notably, next token prediction) and evidently powerful, efficient and scalable models(ie. Transformer) . With next token prediction, you have both input text and labels from same text(input is 1 word
RESEARCH
-
AI Community Fragmentation Over LLM Understanding Debate
By
–
"I've never seen the AI community become fragmented….with different camps shouting at each other"
— Eric Topol (@EricTopol) 11 juin 2023
on the risks and whether LLMs "understand" https://t.co/U1XUXmyXUK"I've never seen the AI community become fragmented….with different camps shouting at each other" on the risks and whether LLMs "understand"
-
ACM Fellow Recognition Celebrates AI Research Excellence
By
–
What an amazing evening at @TheOfficialACM awards reception yesterday! Honored to be selected as an ACM Fellow and privileged to be working with phenomenal students and colleagues! Wonderful to have @bjenik by my side and cheering me!
-
Advanced Machine Learning and Deep Learning Resource Release Announcement
By
–
I am really excited with how it turned out. Finally a resource for those who are interested in a bit more advanced machine learning, deep learning, and AI topics. PS: I also partnered with a publisher to also release print version later this summer. Stay tuned! 3/3
-
New Book Machine Learning Q and AI Released Today
By
–
Today is the day! My new book Machine Learning Q and AI is now complete! https://
leanpub.com/machine-learni
ng-q-and-ai/
… Covering – Explanations of multi-GPU training paradigms.
– Using and finetuning transformers.
– Differences between encoder- and decoder-style LLMs.
– And many more! 1/3 -
AI Risks Consensus Among Researchers and Policymakers
By
–
I used to talk to Andrew a lot and it was great to catch up again and get his take on the various risks posed by recent developments in AI. We agreed on a lot of things, especially on the need for the researchers to arrive at a consensus view of the risks to inform policy makers.
-
Sequencing Replaces Blood Cultures for Sepsis Pathogen Diagnosis
By
–
For the diagnosis of sepsis pathogen, our culture of blood cultures and resistance to adapting to the era of sequencing
New head-to-head study https://
nature.com/articles/s4159
8-023-36681-5
…
Reviewed here https://
erictopol.substack.com/p/a-culture-of
-blood-cultures
… -
Do AI Models Understand and Develop Worldviews?
By
–
Do current AI models understand, and are they developing a world view? Two critical questions to consider when trying to build consensus within the AI community about potential threats of advanced AI. https://t.co/Xq4lOs0E3q
— Paul Roetzer (@paulroetzer) 11 juin 2023Do current AI models understand, and are they developing a world view? Two critical questions to consider when trying to build consensus within the AI community about potential threats of advanced AI.
-
AI Scientists Must Build Consensus on Catastrophic Risk
By
–
Had an insightful conversation with @geoffreyhinton about AI and catastrophic risks. Two thoughts we want to share:
— Andrew Ng (@AndrewYNg) 11 juin 2023
(i) It's important that AI scientists reach consensus on risks-similar to climate scientists, who have rough consensus on climate change-to shape good policy.… pic.twitter.com/TXT9wgv2TRHad an insightful conversation with @geoffreyhinton about AI and catastrophic risks. Two thoughts we want to share: (i) It's important that AI scientists reach consensus on risks-similar to climate scientists, who have rough consensus on climate change-to shape good policy.
-
How to Train Your Own Large Language Models
By
–
How to train your own Large Language Models https://
bit.ly/3WnauuY #AI #MachineLearning #DeepLearning #LLMs #DataScience