I often get requests to dispel some of the jargon behind transformers and LLMs! So here we go, my new article on "Understanding Encoder and Decoder LLMs":
@rasbt
-
Transformers in Diffusion Models for Image Processing Since 2022
By
–
Plus, since ~2022, Diffusion models also use transformers for the image processing. E.g.,
-
Text-to-Image Diffusion Models Use Transformers
By
–
Fun fact: common text-to-image Diffusion models actually use Transformers
-
DeepSpeed Issue Resolution in Finetuning Script
By
–
Btw it's not a DeepSpeed bug, more like something to address in the finetuning script! Sry for the confusion!
-
DeepSpeed Stage 3 LoRA Bug and FSDP Migration Plans
By
–
Theoretically, you can get it to work if you use deepspeed stage 3 with offloading. But I see there is currently a little bug for stage 3 and LoRA. I think we watned to switch from DeepSpeed to FSDP anyway though. PS: Glad you like my book!
-
Deep Learning Course Completion Badge and Final Exam Released
By
–
Am so glad about all the nice feedback about my Deep Learning course — happy to hear that it was useful to tens of thousands of people! Just added a final exam & completion badge for LinkedIn! So, if you'd like to test your knowledge with 25 questions: https://
lightning.ai/pages/ai-educa
tion/deep-learning-fundamentals/certification/
… -
Agreement on Twitter Algorithm Open Source Release
By
–
Totally agree! https://
github.com/twitter/the-al
gorithm
… -
Custom LLMs Essential for Specialized Domain Applications
By
–
If you want to develop/use a generalist chatbot, I totally agree. But there are countless problems where a custom LLM makes 100% sense. From spam classification to working with financial, law or medical data to protein sequence modeling.
-
Batch Size Analogy for Precision Selection in Hardware
By
–
It makes sense though since it’s kind of like batch size: make it as large as your hardware permits (… < bfloat 16 < bfloat 16/32 mixed < float 32)
-
Clarification on supervised instruction-finetuning versus RLHF methods
By
–
Btw. was supervised instruction-finetuning vs RLHF instruction-finetuning what you had in mind, or were you more curious about supervised finetuning as in classification vs supervised instruction-finetuning?