Bonus: Use the new dataset to train your own Whisper or Wav2Vec2 models with Transformers on Common Voice 12 https://
github.com/huggingface/tr
ansformers/tree/main/examples/pytorch/speech-recognition
…
MACHINE LEARNING
-
Train Whisper Wav2Vec2 Models Common Voice Dataset Transformers
By
–
-
Common Voice 12 Dataset Released with Expanded Languages
By
–
Common Voice 12 has successfully landed on the Hub! CV 12 comes with new languages and tons more data for low-resource languages, and much more! With Datasets, you can load, stream, and create a data loader with just a few lines of code https://
huggingface.co/datasets/mozil
la-foundation/common_voice_12_0
… -
AI and ML enhance meteorological observations and solar wind tracking
By
–
AI and ML today can facilitate auto-corrections, track complex structures inside solar winds, and facilitate the replacement of multiple filters fitted on payloads for observations. #WorldMeteorologicalDay #WorldMeteorologicalDay2023
-
AI and ML Revolutionizing Space Exploration and Meteorology
By
–
AI has played a pivotal role in opening a new portal to understanding our universe and helping make newer leaps in the meteorological sector. Tap to read how the use of Al and ML is helping in space exploration: https://
bit.ly/3ls3bo8 @isro @Indiametdept @WMO @__anjali__raja -
Rodney Brooks Shares Thoughts on GPT Models and Transformers
By
–
Lots of people have been asking for my thoughts on Generative Pre-trained Transformer (GPT) models. I have now written them down. https://
rodneybrooks.com/what-will-tran
sformers-transform/
… -
NVIDIA GTC Spring 2023 Day 3: Deep Learning and Semiconductors
By
–
NVIDIA Spring 2023 GTC Day 3 covers a lot in deep learning and semiconductors. https://
learnopencv.com/nvidia-spring-
gtc-2023-day-3-digging-deeper-into-deep-learning-semiconductors-more/
… Get an overview of FP8 for Deep Learning, Accelerated Computational Lithography, advancements in Supply Chains and Operations, and much more with our https://
learnopencv.com/win-a-free-nvi
dia-4080-gpu/
… -
RLHF’s Impact on Understanding Pre-trained LLM Behavior
By
–
RLHF has gotten so good we no longer develop an intuition about how pre-trained LLMs behave. To the surviving flashes of old behavior we wrongly ascribe meaning — humanity, madness.
-
Microsoft UPRISE Boosts LLM Zero-Shot Performance via Prompt Retrieval
By
–
Microsoft’s UPRISE Automatically Retrieves Prompts to Boost the Zero-Shot Performance of Large Language Models https://
syncedreview.com/2023/03/22/mic
rosofts-uprise-automatically-retrieves-prompts-to-boost-the-zero-shot-performance-of-large-language-models/
… -
Sparsity Improves AI Model Accuracy Through Sparse Transformations
By
–
This is the first work (that we know of!) to demonstrate the use of #sparsity for improving the accuracy of models via a set of sparse transformations. If you're interested in learning more about SIFT, check out our blog – https://
cerebras.net/blog/can-spars
ity-make-ai-models-more-accurate
… (4/4) -
ResNet and GPT-3 achieve efficiency gains matching larger models
By
–
Some of the highlights of this work include ResNet-18 on ImageNet achieving a 3.5% accuracy improvement, and #GPT-3 Small on WikiText-103 reducing perplexity by 0.4, both matching larger dense model variants that have 2x or more FLOPs. (3/4)