Distillation is one of the greatest tricks in the neural networks toolbox. https://t.co/VJPPTkWbq9
— Nando de Freitas (@NandoDF) 15 novembre 2023
Distillation is one of the greatest tricks in the neural networks toolbox.
@nandodf
-
Distillation: A Powerful Neural Networks Technique
By
–
-
Diversity in AI: Addressing Distorted Representation in Tech
By
–
This is what we get if we search for aimodel pretty much on any search tool on the web. It’s a distorted view of reality that for me just accentuates the need to increase diversity in tech and AI. DE&I has to be prioritised more than ever.
@wimlds
-
AI Responsibility Pioneer Recognized for Years of Work
By
–
Wise words from a pioneer who has been working on AI Responsibility behind the scenes for many years. Thank you Helen! https://t.co/OIFOR11Xzo
— Nando de Freitas (@NandoDF) 11 novembre 2023Wise words from a pioneer who has been working on AI Responsibility behind the scenes for many years. Thank you Helen!
-
Machine Learning Restores Lost Beatles Song Now and Then
By
–
This is so powerful. Happy to see Machine Learning, the thing I’ve worked on for 29 years, helping a bit with something I’ve always loved. The Beatles – Now And Then – The Last Beatles Song (Short Film) https://
youtu.be/APJAQoSCwuA?si
=5rlkccSmhV4b238D
… via @YouTube -
Deep Learning Advances Molecular Biology: Isomorphic Labs and DeepMind Progress
By
–
It is both awesome and inspiring to witness the progress in molecular biology thanks to developments in deep learning and AI. Well done @IsomorphicLabs and @GoogleDeepMind ! These are important steps toward great advances in Science https://t.co/wcZzx7cwNS
— Nando de Freitas (@NandoDF) 1 novembre 2023It is both awesome and inspiring to witness the progress in molecular biology thanks to developments in deep learning and AI. Well done @IsomorphicLabs and @GoogleDeepMind ! These are important steps toward great advances in Science
-
RLHF Limitations and Ethical Alignment in AI Systems
By
–
Happy to see researchers questioning whether RLHF is sufficient for “alignment”. I like this perspective: https://
researchgate.net/publication/22
8764857_That_special_something_Dennett_on_the_making_of_minds_and_selves
… of @danieldennett
. But ethical questions abound as it involves ego, TOM, morality, compassion, empathy… -
David Guetta: Generative AI is the Future of Music
By
–
David Guetta says the future of music is in AI. In the creative industries, where imagination is needed, generative models are likely to be very impactful. Many expected creativity and imagination to be one of the last AI achievements, but maybe not so.
-
Vision Model Scaling for Autonomous Vehicles and Robotics
By
–
This is a fantastic scaling effort to solve computer vision tasks. Better vision models will help us engineer better safe self-driving cars, and other types of robots
-
Combining Three Transformers Achieves Strong Multimodal Image-Text Results
By
–
I love the modelling simplicity in this paper: combine 3 transformers into a big transformer and, voilà! amazing results for mapping images+text to text.
-
LLMs and Chatbots Understanding Human Intelligence Aspects
By
–
This is nice thread on LLMs and chatbots by @fchollet
. This is as much about understanding LLMs as it is about understanding different aspects of what we think of as human intelligence