Not quite, Encodec is part of the pipeline for MusicGen. Encodec helps with converting the audio into discrete codebook representation and back! Not as glamorous but it is the key piece behind making MusicGen as effective as it is
@reach_vb
-
Team Adds Encodec Model in Record Time
By
–
Massive kudos to @mhollemans
, @art_zucker and patrickvonplaten for sprinting and adding this model in record time Special thanks to @honualx for all his help and support! ref: https://
github.com/facebookresear
ch/encodec
… -
Transformers Integration Enables Large-Scale Text-to-Speech Music Models
By
–
Okay, but why is it a big deal!? Transformers integration allows us to use any LM and dataset from the ecosystem seamlessly to train Text-to-Speech and Text-to-Music models at scale! More exciting announcements on this front soon! https://
github.com/Vaibhavs10/not
ebooks/blob/main/use_encodec_w_transformers.ipynb
… -
EnCodec Model Now Available in Transformers Library
By
–
Want to train your own Bark/MusicGen-like TTS/TTA models? 👀
— Vaibhav (VB) Srivastav (@reach_vb) 20 juin 2023
The SoTA Encodec model by @MetaAI has now landed in 🤗Transformers!
It supports compression up to 1.5KHz and produces discrete audio representations. ⚡️
Model: https://t.co/Hq8rDHBfjw
Colab: https://t.co/MaWVEAMCXs pic.twitter.com/tDpPAdlYHUWant to train your own Bark/MusicGen-like TTS/TTA models? The SoTA Encodec model by @MetaAI has now landed in Transformers! It supports compression up to 1.5KHz and produces discrete audio representations. Model: https://
huggingface.co/docs/transform
ers/main/en/model_doc/encodec#overview
…
Colab: https://
github.com/Vaibhavs10/not
ebooks/blob/main/use_encodec_w_transformers.ipynb
… -
Setting Up Model Repositories on Hugging Face Hub
By
–
Happy to help y’all setup your model repos on Hugging Face Hub I think the community will really benefit from this!
-
One More Fine-Tuning Run in Progress
By
–
Okay, one more fine-tuning run! https://
wandb.ai/vaibhavs10/IMS
-Toucan/runs/1pwzx4t7?workspace=user-vaibhavs10
… -
Compute Optimal Fine-Tuning Experiments: Peer-Reviewed Guides
By
–
Any guide/ resources for designing compute optimal experiments? Modality doesn't matter, essentially looking for a peer-reviewed way of running compute optimal, knockout style fine-tuning experiments.
-
Research Challenges in Software Development and Code Experimentation
By
–
ffs, research do be a lil hard. *creates yet another branch in the main codebase to implement yet another idea*
-
HuggingFace Transformers Integration Strategy with Descript
By
–
Hey Ishaan, saw that your DM's are closed, can you DM me, I'd love to discuss potential HF transformers integrations and a deeper strategy with Descript and HF.
Given how much both orgs love open source, it sounds like a good next step! -
Free Audio Machine Learning Course with Hugging Face Transformers
By
–
Are you ready to upskill your Machine Learning skills with Audio? Tune in at 18:00 CEST today and participate in our 100% free and fully-open source @huggingface Transformers Audio course! https://
youtube.com/live/wqkKResXW
B8?feature=share
…