Note that Llama and Mistral have parameterised norm layers, so weight decay has no regularizing effect
RESEARCH
-
Critique of Computer Vision Field’s Military and Surveillance Applications
By
–
I finally have this book, written by James E. Dobson, professor of creative writing & English. Good thing we're getting rid of the humanities am I right? Explains my aversion to the computer vision field in which I got my PhD. All military & surveillance.
-
Neural Networks Inherit Cold War Era Biases and Worldviews
By
–
"Today’s most advanced neural networks & sophisticated image-analysis methods come from 1950s and ’60s Cold War culture—& many biases & ways of understanding the world from that era persist along with them."
-
Privacy Violations in Large Language Models Through Inference
By
–
Beyond Memorization: Violating Privacy Via Inference with Large Language Models Staab et al.: https://
arxiv.org/abs/2310.07298
v1
… #ArtificialIntelligence #LargeLanguageModels #MachineLearning -
AI Assistants: Better Knowledge Interface and Cultural Vehicles
By
–
Chatting with @timoreilly today he said: "books are a user interface to knowledge."
That's what AI assistants are poised to become: "AI assistants will be a better user interface to knowledge." But the same way books carry culture, AI will also become vehicles for culture. -
How Do We Know What’s Real Anymore? AI Reality Crisis
By
–
How do we know what’s real anymore?
— Linus ✦ Ekenstam (@LinusEkenstam) 20 octobre 2023
I’ll let @rpnickson explain, things are about to become wild.
pic.twitter.com/BBoa5JksyGHow do we know what’s real anymore? I’ll let @rpnickson explain, things are about to become wild.
-
T2I-Adapters Enable Efficient Controllable SDXL Image Generation
By
–
Efficient Controllable Generation for SDXL with T2I-Adapters https://
bit.ly/3t5cMEt #AI #MachineLearning #DeepLearning #LLMs #DataScience -
70 Professors Selected for 2023 Inclusion Research Award
By
–
After receiving applications from over 300+ institutions globally, 70 professors were selected for the 2023 Award for Inclusion Research! Please help us congratulate them and learn more here: http://
goo.gle/AIR-2023 -
Habitat 3.0 Virtual Environment Released with Open-Source Code
By
–
Habitat 3.0 is released!
— Yann LeCun (@ylecun) 20 octobre 2023
Virtual environment with humanoid sims under human control, robots, realistic indoor environments, physics, …
Paper, open-source code, and datasets. https://t.co/GBu4HtFRrFHabitat 3.0 is released!
Virtual environment with humanoid sims under human control, robots, realistic indoor environments, physics, …
Paper, open-source code, and datasets. -
Model Distillation Safety Concerns in AI Development
By
–
Are there any other models being distilled? The Dreamshaper one is, uh, very unsafe for work.