It’s that time of the year – first lecture of @cs231n !! It’s the 9th year since @karpathy and I started this journey in 2015, what an incredible decade of AI and computer vision! Am so excited to this new crop of students in CS231n! (Co-instructing with @eadeli this year )
RESEARCH
-
AI21 and Databricks Slim Down LLMs with Open Source Models
By
–
AI21 and Databricks show open source can radically slim down AI Two new large language models, Jamba and DBRX, dramatically reduce the compute and memory needed for predictions, while meeting or beating the performance of top models such as GPT-3.5 and Llama 2.
-
Meta Prunes Llama 2 Model for Slimmer More Efficient AI
By
–
Meta's 'pruning' of Llama 2 model shows path to slimmer AI Half a neural network can be ripped away without affecting performance, thereby saving on memory needs. But there's bad news, too. https://
zdnet.com/article/metas-
pruning-of-llama-2-model-shows-path-to-slimmer-ai/
… @Meta @AIatMeta -
Types of Data Roles in Big Data and AI
By
–
Types of #Data Roles
by @KirkDBorne #BigData #ArtificialIntelligence #ML #MI #DataScience cc: @terenceleungsf @yvesmulkers @pascal_bornet -
IEEE Spectrum Robotics Website Nominated for Webby Award
By
–
Robotics friends: Please vote! The IEEE Spectrum http://
robots.ieee.org website (now http://
robotsguide.com) is up for a Webby Award in the Science category! An incredible resource for the community and for budding roboticists. https://
vote.webbyawards.com/PublicVoting#/
2024/websites-and-mobile-sites/general-desktop-mobile-sites/science
… -
Shoutout to advocates for low resource languages and NLP
By
–
seriously shoutout to @dwhitena for consistently being on the side of low resource languages and the good work of @MasakhaneNLP (
https://
latent.space/p/practical-ai
-trends
…) – if any similar groups in latam/africa please make me aware of them -
AI Impact Beyond Technology Advancement: Integration Over Innovation
By
–
These questions focus too much on technology. AI technology does not need to advance in order to be a big deal The early data on law, medicine & business use show impact. Even if development stopped on LLMs now, we would have 10 years of integrating GPT-4 class models with work.
-
Inclusive AI Data Practices Engaging Teachers Students
By
–
“By engaging teachers and students from the outset, our goal is to ensure that our data practices are inclusive and representative of diverse learner experiences and needs,” says HAI Faculty Fellow @HariSubramonyam about a recent preprint paper.
-
H100 vs A100: GPU Training Performance Challenges
By
–
Does anyone else always have tons of trouble using H100s for training? I always end up going back to A100s.
-
World possibilities with 1000x better AI technology
By
–
What does the world look like with 1000x better AI? What will become possible? We need to think more long-term.