To generate a sequence of 1000 tokens requires an insane 100K^1000 = 10^5000 choices. That’s a lot more than the estimated number of atoms in the universe, 10^82! With the chain rule the number of possible choices is "only" 100K * 1000 = 100M, a much more manageable number.
RESEARCH
-
Chain Rules: Probability and Calculus in Machine Learning
By
–
Chain Rule(s) rules! Appreciation thread of one of the most interesting coincidences in machine learning. Two rules, both named "Chain Rule", happen to be absolutely critical to recent advances in ML & AI. A on the Chain Rule of Probability & the Chain Rule of Calculus
-
Chain Rule of Probability Powers Large Language Models
By
–
The Chain Rule of Probability is a powerful tool behind recent advances in Large Language Models. By multiplying together the probabilities of many smaller events, we can compute the probability of a complex event made up of those smaller events.
p(abc) = p(c|ab) * p(b|a) * p(a) -
AI Progress Accelerates: Balancing Innovation with Responsible Deployment
By
–
Most amazing fact about AI is that even though it’s starting to feel impressive, a year from now we’ll look back fondly on the AI that exists today as quaint & antiquated. Equal cause for excitement and deliberative caution — important to get the tech and its deployment right.
-
Ghost Cites and ChatGPT: Academic Citation Crisis Worsens
By
–
This is a classic story about an article that was never written yet became widely cited. "Ghost cites" were always problem in academia. But it's about to get much, much worse. This is how Chat GPT summarizes this famously non-existent article:
-
Current AI Limitations: Human Performance Remains the Benchmark
By
–
So does humans, it’s the best that AI can do as of now!!
-
Andrej Karpathy: Learning AI Concepts from Scratch
By
–
4. Andrej Karparthy: There are a lot of innovations happening in the field of AI. But what if you can understand the concepts behind that from Scratch? Andrej helps you with that. https://
youtube.com/@AndrejKarpathy -
3Blue1Brown: Essential ML Channel with Great Animations
By
–
3. 3 Blue 1 Brown: If you are into ML, you should have known this Channel. But if you are not go check this out. Top-level content with easy-to-understand Animations. https://
youtube.com/channel/UCYO_j
ab_esuFRV4b17AJtAw
… -
7 YouTube Channels for Learning Python and Data Science
By
–
7 YouTube channels from which you can learn Python, Machine Learning, Deep Learning, Data Science & much much more. Get started with these:
-
Pattern Recognition in AI: Fundamentals and Importance Explained
By
–
In this @Cognilytica #AIToday #podcast AI Glossary Series episode 'Pattern Recognition' hosts @rschmelzer & @kath0134 define the term #PatternRecognition, explain how it relates to #AI, and why it’s important to know about. Full episode: https://
aidatatoday.com/ai-today-podca
st-ai-glossary-series-pattern-recognition/?utm_source=dlvr.it&utm_medium=twitter
…
#tech #data #ML