When I was optimising ULMFiT, I came up with a trick where I ran lots of ablations and fed all the hyperparams and results to a random forest. That told me which were most important. I told @l2k about it, and @wandb added it to their product! 😀 https://
youtu.be/2QX6jjMt1Eg?si
=icbhCYqFpt4WEhjP&t=1217
…

→ View original post on X — @jeremyphoward