For a full fine-tuning run, on a @GoogleColab T4 GPU, Whisper large model throws an OOM. Through PEFT, we are not just able to fine-tune the Whisper large checkpoint but also squeeze in a batch size of 24 in < 8GB VRAM on a consumer GPU
TOOLS
-
PEFT Enables Sub-60MB Model Checkpoints for Portability
By
–
It gets better, thanks to the magic of PEFT, the resultant checkpoints are less than 60MB in size! Thereby, making a strong case for model weights portability! Learn more about it here:
-
5x Faster Whisper Fine-tuning with LoRA and PEFT
By
–
After 70x faster Whisper, we present to you – 5x faster Whisper fine-tuning! Powered by LoRA and PEFT – Squeeze in 5x larger batch sizes, fit Whisper-large checkpoint < 8GB VRAM! Best part? With almost no degradation in WER! Check it out: https://
github.com/Vaibhavs10/fas
t-whisper-finetuning
… -
ChatGPT Plugins Test: Activation, Installation and Usage
By
–
I TEST CHATGPT PLUGINS… IT'S CRAZY How to activate them? How to install a plugin? And above all, what to do with them? I tell you everything in my latest video → https://youtu.be/ogp65Dk880g
-
Hugging Face Competitions Platform Announcement
By
–
Hugging Face Competitions: http://
hf.co/competitions -
Databricks Terraform Registry Modules Launch for Lakehouse
By
–
ICYMI: We recently launched the experimental #Terraform Registry modules for Databricks, a set of 30+ reusable Terraform modules and examples to provision your #Lakehouse! See how you can easily get started using and contributing to this project
-
New KerasCV Image Classification Guide with State-of-the-Art Augmentation
By
–
We have a new image classification guide for KerasCV — check it out! Featuring state-of-the-art image augmentation layers. https://
keras.io/guides/keras_c
v/classification_with_keras_cv/
… -
Python Tools for Scientists: Anaconda, JupyterLab, Scientific Libraries Guide
By
–
#Python Tools for Scientists: An Introduction to Using Anaconda, JupyterLab, and Python's Scientific Libraries => Get it at http://
amzn.to/3WrBmZf [700+ page book from @NoStarch Press]
—————
#Coding #BigData #DataScience #DataScientists #ComputationalScience #MachineLearning #AI -
Four Essential Books for Data Science and AI Professionals
By
–
4 essential books for #DataScience #AI #DataScientists
****
• Designing #ML Systems: https://
amzn.to/3V1IOex • #DeepLearning with #Python: https://
amzn.to/3H8xkAe • Transformers for #NLProc: https://
amzn.to/3LriRC2 • #MachineLearning with PyTorch… https://
amzn.to/41YhksJ -
Microsoft’s Bing Chatbot Integration: Ads and Accuracy Improvements
By
–
How Microsoft's Bing Chatbot Came to Be—and Where It's Going Next The AI-powered chat interface transformed the second-place search engine into a trendsetter. Now the company is integrating ads and working on accuracy. https://
bit.ly/3BrZ7Zd