I usually read the experimental details and then straight up dive into the code.
Pick it apart till I’m down to bare metal. Create dummy tensors and then play around with individual modules to understand what is happening. Colabs are helpful here too, to isolate the code.

→ View original post on X — @reach_vb