Agreed! And there’s LIMA if you are looking for 1k high-quality examples for instruction finetuning:
RESEARCH
-
RAG Pipeline Technical Overview and Implementation Guide
By
–
A great overview of what's going on under the hood in a RAG pipeline Thanks for writing this @czue
! -
Python ecosystem shifting to Rust over C++ for performance
By
–
Or more like a competitor to Rust since the Python ecosystem is moving to that instead of C++ (eg see polars and some others)? And for GPU & AI stuff a competitor to Triton/CUDA?
-
Clarification between inference and training processes
By
–
Thanks for tagging me, but that’s only inference not training right?
-
Weekly AI News: Tools, Regulation, and Misinformation Research
By
–
I wrote a @Digiday recap with just a small sample of this week’s AI news including: -State legislative efforts
-Newly announced #GenAI tools for marketers
-Various research related to topics like misinformation & martech https://
digiday.com/media-buying/t
he-week-that-was-in-ai-the-latest-in-creating-using-and-regulating-generative-ai
… -
Google’s Perception Fairness Team Advances Multimodal AI Inclusion
By
–
Today we highlight the work of Google’s Perception Fairness team, which works to advance the frontiers of fairness and inclusion in multimodal #MachineLearning systems, especially related to foundation models and #GenerativeAI. Learn about this important work at… pic.twitter.com/tssgeA8Yrq
— Google AI (@GoogleAI) 25 août 2023Today we highlight the work of Google’s Perception Fairness team, which works to advance the frontiers of fairness and inclusion in multimodal #MachineLearning systems, especially related to foundation models and #GenerativeAI. Learn about this important work at
-
ML Engineering: Inventing New Design Patterns for Modern AI
By
–
One nice thing about machine learning engineering is that, because the field is so new, you get to constantly invent new design patterns. Classic software engineering wisdom is still quite useful, but there's often great value in figuring out how to apply it in novel ways.
-
Bioengineering Professor Explores AI Concepts at Stanford Symposium
By
–
Hear more about this concept from bioengineering professor @boahen_k at the upcoming Hoffman-Yee symposium on Sept 19: https://
hai.stanford.edu/events/join-us
-hoffman-yee-symposium-september-19
… -
Dendrites: A Novel Approach to Computer Chip Design
By
–
Could dendrites, the spindly protrusions that neurons use to detect signals, offer a novel way of thinking about computer chips?
-
Alignment Engineering: Bridging LLM and Human World Models
By
–
"Alignment engineering" might be a better term than "prompt engineering". It's not just about instructing LLM but about aligning your world model with LLM's world model. If LLM's response strays from your expectations, it means your world models differ, and the prompt needs