TinyML and Efficient Deep Learning Computing, MIT 2023 A course that covers efficient AI techniques used for deploying deep learning models on resource-constrained devices. The topics covered include model compression, pruning, quantization, neural architecture search,
@jeande_d
-
AI Advances Toward Generalized Operating System with Multimodal Interface
By
–
All advances in AI algorithms, training approaches, and datasets were a mean to an end: A generalized Operating System(OS) that is promptable, multimodal I/O, human friendly(as opposed to classical OSs), has different levels of applications in app store(where most apps are great
-
Stanford CS224N: New 2023 Deep Learning NLP Lectures Available
By
–
[New Lectures] Stanford CS224N: Natural Language Processing with Deep Learning Stanford NLP course is arguably one of the best Deep NLP courses on the web. The new lectures from 2023 iteration are public now. The course covers fundamental techniques and topics related to deep
-
Remarkable text understanding capability, even reading codes
By
–
The text understanding is pretty remarkable. Even codes on screen
-
Xformers terminology: transformer variants and efficiency improvements
By
–
In the article, I used "xformers" referring to zillions variants of transformers that claim to improve the efficiency of transformer(
@YiTayML et al., https://
arxiv.org/abs/2009.06732). I am not aware of xformers in SD. -
LoRA, PEFT, and ChatGPT Backend Architecture Discussion
By
–
I am glad you enjoyed the article. I plan to write about LoRA and PEFT(parameter-efficient fine-tuning) in general in a separate article. Yeah, ChatGPT uses GPT-3.5/4 in the backend, all of which are decoder models trained to predict the next token autoregressively.
-
Transformer Blueprint Blog Reaches 20K Views Unexpectedly
By
–
Very much surprised that my latest research blog "Transformer Blueprint" has reached 20K views! This is way beyond my expectations!! Here is the blog if you have not seen it: https://
deeprevision.github.io/posts/001-tran
sformer/
…. -
Google Research Accra Offices: Impactful Problems in Healthcare and Weather
By
–
I had a fortune of visiting Google Research Accra offices to day. Really decent offices, the teams there are working on interesting problems, the kind of problems that directly impacts people lives: healthcare, weather, to name a few.
