A synthetic text extruding machine is not well-matched to any application where the accuracy of the content matters. This is clearly one such application. >>
RESEARCH
-
AI Hype Fatigue: Why Skepticism Matters in Tech
By
–
Just today, I was asked how I felt watching people fall for AI hype. Exasperated. Exasperated is how I feel. Can we just NOT?
-
Open-Source AI Models Released Rapidly in Spring 2024
By
–
DBRX, Mixtral 8x22B, Llama-3 all released within weeks. The open-source AI scene shows no sign of slowing down.
-
Jason Exploits Variant of Shunyua Yao’s Koala Architecture
By
–
and jason is exploiting a variant of the @ShunyuYao12 Koala architecture
-
Fine-tuning Models Before Release for Better Self-Description
By
–
I agree with Jeremy here: we know that people are going to ask models about themselves here whether or not that actually makes sense to do so, so we should be able to fine-tune the model after initial training but before release to help it provide more useful answers there
-
RLHF Annotation Bias and Model Vocabulary Development
By
–
I don't know that RLHF would bias that kind of thing – my mental model is that annotators are shown two answers to the same prompt and asked which is "best", so if none of the test prompts happened to touch on the concept of a roadside kiosk that vocabulary wouldn't be affected
-
Pre-training and Instruction-Tuning in Large Language Models
By
–
The pre-training stage is where the billions of words of training data come into play – the instruction-tuning / RLHF stage is where human labelers are asked to vote on which generations are "best" – that's the bit that might influence things like "delve" https://
openai.com/research/instr
uction-following
… -
RLHF and Instruction Tuning: Understanding Model Training Mechanisms
By
–
Yeah, what did it get wrong? It fitted my mental model of how the RLHF/instruction tuning stage works pretty closely
-
GPT-3 Ada Model: 2.7 Billion Parameters Breakdown
By
–
I learned today that GPT-3 Ada was a 2.7bn parameter model (Babbage was 6.7, Curie 13 and Davinci 175)