@thom_wolf - AI Dynamics

Famous NLP Summarization Benchmark Dataset Overview

By

–

12 April 2023 15h53

This dataset is a very famous NLP summarization benchmark which has a long history being originally created by DeepMind researchers, adapted by MILA and IBM and in its latest version by a PhD student from Stanford. We host the same access to it as the one in the tensorflow

→ View original post on X — @thom_wolf

12 April 2023

High Quality Corpus Training Efficiency for Language Models

By

@thom_wolf

–

09 April 2023 21h10

There seems to be some growing hints that a few epochs of training on a high quality (and well deduplicated corpus) is just fine

→ View original post on X — @thom_wolf

9 April 2023

Training Smaller Models Longer Challenges Chinchilla Predictions

By

@thom_wolf

–

09 April 2023 12h11

There is a fascinating recent trend of training *smaller models for longer* w.r.t. Chinchilla optimal predictions Best explanation I've seen of this? This new blog post by @harm_devries (with collaborators of the @BigCodeProject
): https://
harmdevries.com/post/model-siz
e-vs-compute-overhead/
… Clearly these are only

→ View original post on X — @thom_wolf

9 April 2023

Funny AI Model with RLHF Tutorial on Hub

By

@thom_wolf

–

06 April 2023 19h02

possibly one of the funniest model on the hub (the RLHF tutorial that was the reason of its creation is also awesome – check it out)

→ View original post on X — @thom_wolf

6 April 2023

First Open-Source AI Riot Sparked 2023 Revolution

By

@thom_wolf

–

29 March 2023 18h30

[Narrator] "…and the first open-source riot that lead to the revolution we all know started in spring 2023, from what came to be known as the largest AI meetup ever…"

→ View original post on X — @thom_wolf

29 March 2023

GPT-4 Sparks of AGI Study Reveals Mind-Blowing Examples

By

@thom_wolf

–

23 March 2023 15h30

There are completely mind-blowing examples in the GPT4 "sparks of AGI" study

→ View original post on X — @thom_wolf

23 March 2023

Tech Company Stops Knowledge Sharing Platform Hosting Model

By

@thom_wolf

–

21 March 2023 19h33

Not really since we are a hosting/sharing platform. I’m more a bit annoyed that they’ve stopped sharing knowledge but it’s fair game in their position I guess

→ View original post on X — @thom_wolf

21 March 2023