– build an autograd engine from scratch
– write a mini-GPT from scratch
– implement LoRA and fine-tune a model on real data
– hate CUDA at least once
– cry
– keep going the roadmap – 5 phases
– if you already know something? skip
– if you're lost? rewatch
– if you’re stuck? use
Build Autograd Engine, Mini-GPT, and LoRA Fine-tuning From Scratch
By
–
Leave a Reply