The 300k+ hours of audio clips were used to train a "generator model" that turns the text into an intermediate representation, and a "cascader model" that uses this intermediate representation to produce high-quality audio.
GENERATIVE AI
-
Homework Should Be Joyful to Compete with ChatGPT
By
–
I wish schools could make homework so joyful that students want to do it themselves, rather than let ChatGPT have all the fun.
-
Coders Using AI as 10x Stack Overflow with RLHF
By
–
ok I will now admit that coders are using it everyday as 10x stackoverflow good thing they did all that coding RLHF!
-
Hope for Better Open-Source Large Language Models
By
–
Finally, with models like OPT and BLOOM at 175B params, I'm hopeful that better open-source models will be soon be trained, given the pace of innovation in the space.
-
Unlocking emergent abilities in smaller language models like Flan-T5
By
–
(2) One key question of emergence is how to unlock such abilities at smaller scales, and I don't think there has been much work on flan-T5, which often beats PaLM 62B as shown in this paper: https://
arxiv.org/abs/2210.11416 -
WIRED Fast Forward: AI Search Wars Begin
By
–
I am now writing the @WIRED Fast Forward newsletter. (I'm only a few years late to the trend). The first issue is about the AI search wars. You can see a preview and subscribe here:
-
AI Field Sees Realistic Optimism About Future Opportunities
By
–
Thing that stands out about current AI buzz is an unfamiliar realistic optimism, about the field specifically and tech generally. Still very early days (and plenty of concerns!) for AI, but seems like people are sensing tremendous opportunities personally and for society.
-
LangChain Adds Data Loaders for Cloud Storage and Popular Platforms
By
–
We added a lot of data loaders over the past few days: Cloud Storage: s3, GCS
Prosumer: Roam, Obsidian
Fun Websites: YouTube, AZLyrics, College Confidential https://
langchain.readthedocs.io/en/latest/modu
les/document_loaders/how_to_guides.html
… Which ones are you favorites? -
Open Assistant: Community-Driven Open Source ChatGPT Alternative
By
–
NEW VIDEO! Can you imagine an Open Source ChatGPT? Created by and for the community, available to create, research, and use freely. That's the idea behind Open Assistant! And we need your help to make it speak good SPANISH well https://
youtu.be/XYT1TxINbuM
—