Implementing self-attention using PyTorch, doesn't get easier! It's very intuitive! Check this out
@akshay_pachaar
-
Input Embeddings Keys Queries Values Attention Mechanism
By
–
Now here's a broader picture of how input embeddings are combined with Keys, Queries & Values to obtain the actual attention scores. After acquiring keys, queries, and values, we merge them to create a new set of context-aware embeddings. Check this out
-
Python ML and LLM tutorials daily learning path
By
–
That's a wrap! If you interested in: – Python – ML/MLOps – CV/NLP – LLMs – AI Engineering Find me → @akshay_pachaar Everyday, I share tutorials on above topics! Cheers!!
-
Pandas vs NumPy: Bessel’s Correction in Statistical Computing
By
–
Pandas considers data to be a sample of a larger population, so to obtain an unbiased result, it uses n-1 instead of n as the divisor. This is referred to as Bessel's correction in statistics. On the other hand, NumPy makes no such correction Read more:
-
Pandas vs NumPy Standard Deviation Calculation Differences
By
–
Pandas & NumPy return different values of standard deviation! Wondering why Read more…
-
Python ML/MLOps CV/NLP LLMs AI Engineering Tutorials
By
–
That's a wrap! If you interested in: – Python – ML/MLOps – CV/NLP – LLMs – AI Engineering Find me → @akshay_pachaar Everyday, I share tutorials on above topics! Cheers!
-
Lit-GPT: Open-Source LLM Implementation with Advanced Features
By
–
5️⃣ Lit-GPT
— Akshay 🚀 (@akshay_pachaar) 6 janvier 2024
Lit-GPT is a fully open-source & hackable implementation of SOTA LLMs, it provides everything you need as an LLM Developer.
Key features include:
– Flash attention
– 4 & 8-bit quantization
– Finetuning using LoRA & LLaMA-adapter
Check this👇https://t.co/CVIb8IlJO5 pic.twitter.com/igAAS2FL7jLit-GPT Lit-GPT is a fully open-source & hackable implementation of SOTA LLMs, it provides everything you need as an LLM Developer. Key features include: – Flash attention
– 4 & 8-bit quantization
– Finetuning using LoRA & LLaMA-adapter Check this https://
github.com/Lightning-AI/l
it-gpt
… -
3Blue1Brown: Mathematics Education Through Animation
By
–
3Blue1Brown 3Blue1Brown, by Grant Sanderson, is some combination of math and entertainment. Explanations are driven by animations & difficult problems made simple with changes in perspective One of my favourite! Check this out
-
Python ML and AI Engineering Tutorials Daily
By
–
That's a wrap! If you interested in: • Python • ML/MLOps • CV/NLP • LLMs • AI Engineering Find me → @akshay_pachaar Everyday, I share tutorials on above topics! Cheers!!