Haha fun fact: I used to”delve” 2x in my 2014 Python Machine Learning book 10 years as well. ChatGPT must have learned that habit from my older books
@rasbt
-
Manual Feature Extraction and Count Vector Representations in ML
By
–
Oh I see what you mean. Here human experts don’t necessarily extract the features. What I meant was more like humans came up with the idea that count vectors are a good representation (vs inputting the raw sentence). Ie here with manual feature extraction I mean the
-
Naive Bayes Spam Filtering Feature Extraction Discussion
By
–
This is actually a fun discussion! Regarding naive Bayes for spam filtering, in my view, that's definitely manual feature extraction as you have to construct term frequency vectors as input to the model (i.e., bag of words). Alternatively, you could use embeddings like from
-
BERT masked token prediction and LLM next-word prediction clarification
By
–
Hope you are enjoying the book! And thanks for sharing your notes! Btw regarding your nits, I introduced the masked token prediction task of BERT in Fig 1.5 and even refer to BERT-like "LLMs", but you are right, I mostly equate LLMs with "next-word prediction" for simplicity's
-
2024 AI Research Papers Compilation and Recovery Update
By
–
Thanks for all the warm wishes, everyone! I couldn’t write my yearly AI research review, but here’s my list of bookmarked papers you might find useful: https://
magazine.sebastianraschka.com/p/llm-research
-papers-the-2024-list
… And no worries, I’m slowly but steadily recovering & already starting to feel bit better every day -
12 Years of Python, ML, and AI Content Journey
By
–
Hey everyone!
I just wanted to say how incredible this journey here has been over the past 12 years, when I started sharing and creating Python, ML, and AI content. The positive feedback I’ve received from you all has been such a powerful motivator. I had some exciting plans -
Contribution guidance: Referencing Alpaca and LIMA code implementations
By
–
Thanks for your interest in contributing. I unfortunately currently don’t have access to a computer until likely next week (long story) but off the top of my head and as far as I can tell right now, I think you can copy most code from the Alpaca or LIMA (
https://
github.com/Lightning-AI/l
itgpt/blob/main/litgpt/data/lima.py
…) -
Understanding Multimodal LLMs Latest Papers Overview
By
–
I covered the latest multimodal LLM papers lately (but not the evals, as this would be a different beast): https://
magazine.sebastianraschka.com/p/understandin
g-multimodal-llms
… -
ML Students and CI Pipelines Using Common Practices
By
–
Every student of every ML class but also many CI pipelines, research baselines,…
-
Token Caching Challenges in Large Language Models
By
–
Not a dumb question at all. I think caching is the trickiest one here (obvious ones like kv-caching aside). Caching token embeddings of common words probably don’t really help much. And prompts are probably often diverse enough that caching those would be too expensive. Session