Despite the cold weather, we’re in the middle of a red hot AI summer. Read my thoughts — and a roundup of this year’s biggest AI news — in The Batch!
RESEARCH
-
Embeddings as Versioned Documentation for Machine-Readable Code
By
–
my take: Docs for humans, Embeddings for machines Write samples -> get embeddings -> ship with each API/SDK version composable give users 99% accurate codegen can't version foundation models, but can version embeddings If you liked @types
, you'll *LOVE* @embeddings! -
Beyond Copilot: The Next Evolution in AI Developer Experience
By
–
The Big Question in AI-driven developer experience: What's after Copilot? Everyone is convinced this is "just" the beginning but can't articulate what the next killer form factor will be. Increasingly convinced next step change won't be from optimal stuffing context windows
-
Mixed Precision Training: Complexity Beyond High Level Concepts
By
–
the high level picture is easy enough but keeping track of the mixed precision around the whole network, the dynamical behavior of the values and ranges, the support for them and their conversions across all the various kernels and library versions everywhere, is the nightmare
-
Top 2022 AI Videos: Data Centers, Digital Twins, Healthcare
By
–
Our most popular videos of 2022 put spotlights on photorealistically animated data centers, digital twins for climate science, AI for healthcare and more. https://
nvda.ws/3GibTg5 -
Searching for canonical references to the bitter lesson
By
–
was looking for more references to the "bitter lesson" – is this the canonical source? http://
incompleteideas.net/IncIdeas/Bitte
rLesson.html
… -
Splitting minGPT into educational and efficient versions
By
–
Context I realized I have to split up minGPT because I can't properly simultaneously satisfy both 1) educational and 2) efficient in one repo. So I'm separately writing 1) the maximally educational minGPT (+video etc.) and 2) a more efficient (still ~clean) version that has teeth
-
Thank You for Supporting AI Research and Innovation in 2022
By
–
From all of us to the entire community: Thank you for supporting AI research, innovation & open science in 2022 — we're excited to continue pushing this (and more) forward together in 2023.
-
Top 50 Public Datasets for Machine Learning
By
–
The 50 best public datasets for machine learning: http://
bit.ly/50datasets (v/
@dd_invest
) -
Language Models Achieve State of the Art on Medical QA
By
–
Language models achieve state of the art on medical QA, demonstrating the power of scaling + prompting. Excited to see the emergent use of language models in domain-specific applications in the next few years!