Second, there are already several multimodal models out there; GPT-4 is still a pure text model. Here’s where open-source innovated first.
@rasbt
-
Open-Source Model Finetuning Outperforms Generalist Models
By
–
Disagree. You can finetune open-source models. And if done right, finetuned models outperform generalist models. You can’t finetune GPT-4 w/o access.
-
Advanced Machine Learning and Deep Learning Resource Release Announcement
By
–
I am really excited with how it turned out. Finally a resource for those who are interested in a bit more advanced machine learning, deep learning, and AI topics. PS: I also partnered with a publisher to also release print version later this summer. Stay tuned! 3/3
-
New Book Machine Learning Q and AI Released Today
By
–
Today is the day! My new book Machine Learning Q and AI is now complete! https://
leanpub.com/machine-learni
ng-q-and-ai/
… Covering – Explanations of multi-GPU training paradigms.
– Using and finetuning transformers.
– Differences between encoder- and decoder-style LLMs.
– And many more! 1/3 -
ViT and MobileViT Computational Performance Benchmark for CVPR
By
–
just the original ViT and MobileViT via timm. It was for a computational performance benchmark (preparing sth for CVPR)
-
Fine-tuning Vision Transformers shows promising results
By
–
I'd say so! Recently finetuned a couple of ViTs and it worked pretty well actually.
-
AI Research Highlights: LLM Optimizers and Vision Transformer Scaling Laws
By
–
It's been a another wild month in AI & Deep Learning research. I curated and summarized noteworthy papers here: https://
magazine.sebastianraschka.com/p/ai-research-
highlights-in-3-sentences-2a1/
… Ranging from new optimizers for LLMs to new scaling laws for vision transformers. -
LLaMA’s Simplicity and Growing Ecosystem Appeal
By
–
I wouldn't mind it staying on the top for longer, haha. I do like the relative simplicity of LLaMA, and it's grown on me thanks to all the awesome projects built on top of it.
-
LIMA Dataset Now Available on Hugging Face
By
–
Just saw that the LIMA dataset is now available! https://
huggingface.co/datasets/GAIR/
lima
… -
LoRA Implementation in Lit-Parrot with Analysis Coming Soon
By
–
Just implemented LoRA (
https://
github.com/Lightning-AI/l
it-parrot/pull/128
…) and may be able to tell more soon. (Stay tuned for more info next week. Have to get all my analyses organized and write that up properly before mixing up some numbers there. Probably no qlora, but some info on LoRA at least)