RESEARCH

Noise2Music: Transforming Random Noise into Music with AI

By

–

09 February 2023 21h41

—
Link to project: https://
google-research.github.io/noise2music/ Link to paper: https://
google-research.github.io/noise2music/no
ise2music.pdf
… Authors: Qingqing Huang, Daniel S. Park, Tao Wang, Timo I. Denk, Andy Ly, Nanxin Chen, Zhengdong Zhang, Zhishuai Zhang, Jiahui Yu, Christian Frank, Jesse Engel, Quoc V. Le, William Chan, Wei Han
—

Zero-shot classification matches text to music without training

By

–

09 February 2023 21h41

The model knows how to connect text and music to match each of these sentences with a specific music clip, without having to specifically train the model for each clip.

This process is called zero-shot classification. pic.twitter.com/KWerrsnMWj
— AI Breakfast (@AiBreakfast) 9 février 2023

The model knows how to connect text and music to match each of these sentences with a specific music clip, without having to specifically train the model for each clip. This process is called zero-shot classification.

Creation of a training set for Noise2Music with LaMDA

By

–

09 February 2023 21h41

The researchers created a training set for Noise2Music by using two models to label a collection of 6.8M music source files. They used a large language model (LaMDA in this case) to come up with sentences that describe music in a general way.

Future of music creation via text prompts using diffusion models

By

–

09 February 2023 21h41

In the not-too-distant future, anyone will be able to create any type of music they want via text prompts.

Here's a look into recent research on diffusion models for generating high quality music audio from text prompts:

(more examples below) pic.twitter.com/ywgJRVoxLx
— AI Breakfast (@AiBreakfast) 9 février 2023

In the not-too-distant future, anyone will be able to create any type of music they want via text prompts. Here's a look into recent research on diffusion models for generating high quality music audio from text prompts: (more examples below)

Noice2Music generates 30-second music from text inputs

By

–

09 February 2023 21h41

"Noice2Music" is a project from Google Research that generates a short 30 second piece of music based on text inputs.

Training generator and cascader models on 300k+ hours of audio

By

–

09 February 2023 21h41

The 300k+ hours of audio clips were used to train a "generator model" that turns the text into an intermediate representation, and a "cascader model" that uses this intermediate representation to produce high-quality audio.

→ View original post on X — @thegautamkamath

Adversarial Robustness: Fundamental Problem Underpinning AI Safety

By

@thegautamkamath

–

09 February 2023 20h53

I sadly missed @zicokolter
's talk, but I really vibed w/ one of his punchlines he shared w/ me today: adversarial robustness may be a basic and toy problem, but we still haven't solved it. Inability to do this indicates gaps in our knowledge, which underlie more complex settings. https://
x.com/NicolasPaperno
/NicolasPapernot/status/1623324869000667137
…