Remember when we were arguing about the term "foundation models"? It feels like ages ago! With those base models culminating in DeepSeek v3 in Dec 2024, 2025 will likely be the year of LLM specialization! 1. Multimodal LLMs: It was my big prediction for 2024. Most products
@rasbt
-
Best ArXiv Papers Read Throughout 2024
By
–
Ha, yeah, it's basically the "best of" of the arxiv slice I read in ~365 days in 2024 😛
-
Noteworthy AI Research Papers of 2024 Compiled Mega-Post
By
–
But before I get to the reasoning model space… if you are looking to do some focused offline reading this weekend, I just re-compiled my take on the "noteworthy AI research papers of 2024" into one PDF-export-friendly 47-page mega-post with TOC and all:
-
Fast models replacing personal notes and reasoning for writing assistance
By
–
Fast/cheap models are replacing my personal notes… Even things like "bash one-liner to do X". And yes. Reasoning models are my go to when I am writing something: "Does {text} make sense, can you find any flaws?"
Btw I don't like the term "agents" either, but hey there's also -
Different Evaluation Stages: Internal Development vs Public Real-World Assessment
By
–
There are different stages. The evaluation you mention happens usually during the development stages internally. The "evaluation" that is publicly shared is an evaluation on a different level, the real-world use case task that most users would find relevant.
-
Planning to Write About Reasoning Models with Quality Focus
By
–
Yup, I was planning to eventually write about reasoning models. But as my thing for 2025, I prefer to do it well over doing it quick!
-
Multiple Levels of LLM Evaluation Methods and Approaches
By
–
Wasn't talking about evaluation here. But in general, there's not one way to evaluate LLMs. There are evaluations on multiple levels of course!
-
PyTorch as a Tool: Teaching and Implementation Philosophy
By
–
Small world! I love using PyTorch, but ultimately, it's "just" the tool to get your models implemented :). I taught a lot of PyTorch back then (kind of as a a side project) to help get people started! (Unfortunately, I am currently not mentoring PhD students anymore as I left
-
2025: The Year of Reasoning Models and Agents
By
–
2024 was a great year for building general-purpose LLMs (with some special-purpose finetunes for math & code etc). Looks like 2025 is the year of diverging more into (1) reasoning models (for math and code) and (2) agents (for workflow automation). Exciting times!
-
Upcoming Chapter Content and Bonus Multi-Head Attention Materials
By
–
Yes, stay tuned! (And there's also the "Comparing Efficient Multi-Head Attention Implementations" bonus content if you are still bored after completing the chapter :))