Last but not the least! This guide also walks you through the process of fine-tuning a Whisper checkpoint with Common Voice 13!
OPEN SOURCE
-
PEFT enables Whisper large fine-tuning on consumer GPUs efficiently
By
–
For a full fine-tuning run, on a @GoogleColab T4 GPU, Whisper large model throws an OOM. Through PEFT, we are not just able to fine-tune the Whisper large checkpoint but also squeeze in a batch size of 24 in < 8GB VRAM on a consumer GPU
-
PEFT Enables Sub-60MB Model Checkpoints for Portability
By
–
It gets better, thanks to the magic of PEFT, the resultant checkpoints are less than 60MB in size! Thereby, making a strong case for model weights portability! Learn more about it here:
-
5x Faster Whisper Fine-tuning with LoRA and PEFT
By
–
After 70x faster Whisper, we present to you – 5x faster Whisper fine-tuning! Powered by LoRA and PEFT – Squeeze in 5x larger batch sizes, fit Whisper-large checkpoint < 8GB VRAM! Best part? With almost no degradation in WER! Check it out: https://
github.com/Vaibhavs10/fas
t-whisper-finetuning
… -
Hugging Face Competitions Platform Announcement
By
–
Hugging Face Competitions: http://
hf.co/competitions -
Models Released on Hugging Face Community
By
–
Very cool, congrats and thanks for releasing the models on HF!
-
OpenAI Planning Release of Open-Source Model
By
–
OpenAI has plans to release an open-source model soon. The model will likely be signify smaller than GPT-3.5/4. One step closer to running secure, local, offline models. The vast majority of tasks do not require 100 billion+ parameters.
-
H2O AI Meetup: Build Your Own GPT in Mountain View
By
–
Curious about #OpenSource #LLMs and #GPT and want to learn more? Join the @h2oai team for a #meetup on Thurs, May 18, from 7-8:30 PM PST in Mountain View. Register here: https://
h2o.ai/events/live/ma
ke-your-own-gpt-mv2/
… See you there! #h2ogpt #llmstudio #democratizeai #generativeai #machinelearning -
New KerasCV Image Classification Guide with State-of-the-Art Augmentation
By
–
We have a new image classification guide for KerasCV — check it out! Featuring state-of-the-art image augmentation layers. https://
keras.io/guides/keras_c
v/classification_with_keras_cv/
… -
Open-Source AI Meetup with Stability AI Founder NYC
By
–
This week, come celebrate the power of open-source AI in our meetup with @lightningai and founder of Stability AI @EMostaque May 19th | 6 PM
NYC | Secret Location More than 700+ are joining! RSVP here https://
partiful.com/e/AqsGTfRFmbCg
IlMMnbEk?fbclid=PAAaZWisFhYYilUdLwfY5xhyuDYpaxfG3m6HB7mn4AacS6umhKtxn-8Qs_Wpk
…