Programming is so fun because you get to go from lack of understanding to mastery time and time again, at a rate determined by your speed of iteratively writing & running code, and with real-world impact when you succeed.
@gdb
-
GPT-3.5 Turbo Fine-tuning Now Live for Early Customers
By
–
GPT-3.5 Turbo fine-tuning is now live. Early customers have had great results, sometimes reaching GPT-4-level performance or beyond on their specific task. Really excited to see what people will build:
-
Debugging Unfamiliar Codebases Using Symmetry Techniques
By
–
A nice technique for debugging unfamiliar codebases is to exploit the symmetries. That is, if you don’t know the correct output, find cases where the outputs should relate given certain related inputs. Then do more running the code than reading it to test your expectations.
-
Low-level debugging cognitive load and system complexity
By
–
Drained from a weekend of painstaking low-level debugging. Fixed the bugs, but takes a surprising amount of energy to sustain focus on nitty-gritty details while many keeping many potentially-interacting pieces of the system loaded into your head at once.
-
Machine Learning Magic: Mathematics Meets Engineering
By
–
At a low level, there is no magic in machine learning — just lots of straightforward mathematics and systems engineering. And somehow the end result is entirely magical.
-
Obsessing Over Details: A Machine Learning Virtue
By
–
Obsessing over the details is a great virtue in ML.
-
DARPA AI Challenge for Automated Security Vulnerability Detection
By
–
New @DARPA challenge for using AI to auto-find & patch security vulnerabilities, in collaboration with us & others:
-
Code Improvement: When Better Solutions Replace Initial Implementation
By
–
Always a proud moment when someone takes the time to replace your hacky code with something great.
-
Model Hallucination Bug: Document Separation Token Issue
By
–
Nope, that’s just the model “hallucinating” a fresh conversation. Under the hood, model generates as a string, which our software currently converts to a special token indicating a separation between documents. Still a bug, willfix!
-
ChatGPT Quality-of-Life Update: Persistent Login Feature
By
–
Quality-of-life updates to ChatGPT. No more constantly having to re-login!