Thanks! I'm glad to hear the step-by-step process of building up the attention mechanism is useful! I remember this chapter almost hit the page limit, and I had to do a bit of convincing to avoid shortening it. Happy to know it's helpful!

→ View original post on X — @rasbt