5 / 5 We've integrated MMS into Transformers making the models very easy to use for both inference and fine-tuning. Demo https://
huggingface.co/spaces/faceboo
k/MMS
…
Docs https://
huggingface.co/docs/transform
ers/main/en/model_doc/mms
…
Fine-Tuning
@reach_vb
-
MMS Integration in Transformers: Easy Inference and Fine-Tuning
By
–
-
MMS Adapters: Training Efficient Multilingual Language Models
By
–
4 / 5 To adapt to 1000+ different vocabularies, MMS uses Adapters – a training method where only a small fraction of model weights are trained Adapter layers act like linguistic bridges, enabling the model to leverage knowledge from one language when deciphering another.
-
MMS AI Transcribes 1000+ Languages Including Endangered Tongues
By
–
3 / 5 MMS is capable of transcribing 1,000+ languages, many of which are endangered, such as Ari or Kaivi. In the future, MMS can play a vital role in keeping languages alive by helping the remaining speakers to create written records and communicating in their native tongue.
-
3000 Living Languages Endangered by Globalization Trends
By
–
2 / 5 According to https://
ethnologue.com around 3000, or 40% of all "living" languages, are endangered due to fewer and fewer native speakers.
This trend will only continue in an increasingly globalized world. -
Meta’s Multilingual Speech Model Democratizes AI Access Globally
By
–
Meta AI's recently released "Massively Multilingual Speech" (MMS) model is a huge step forward towards democratizing
Speech to every corner of the globe. In addition, it might also play a significant role in preserving global linguistic diversity. https://
huggingface.co/papers/2305.13
516
… -
Open Source Status Clarification and Correction
By
–
Hmm. Really? Is it Open Source. Thanks for correcting me, I pretty much only look at open source releases so could be mistaken!
-
Descript’s Audio Codec Beats Encodec: TTS Pipeline Implications
By
–
Ha! I’m assuming you considering Descript’s Audio Codec (DAC) as the current SoTA. It deffo does beat Encodec, however, I haven’t seen any OS TTS pipeline using it, hence the doubt! That said, stay tuned for more on this.. we’ve got some interesting things with DAC lined up!
-
SoTA Audio Encoding for TTS/TTA Language Modeling Pipeline
By
–
Yep! It’s SoTA/ near-SoTA atm! This serves as the key piece in a TTS/ TTA pipeline. As it allows us to encode an audio into discrete representations and then perform language modelling on it!
-
Next Generation Audio Models Development Mission
By
–
Stay tuned for more!! We’re on the mission to enable the next gen audio models!
-
Encodec: The Key Technology Behind MusicGen Audio Processing
By
–
Not quite, Encodec is part of the pipeline for MusicGen. Encodec helps with converting the audio into discrete codebook representation and back! Not as glamorous but it is the key piece behind making MusicGen as effective as it is