The pre-training stage is where the billions of words of training data come into play – the instruction-tuning / RLHF stage is where human labelers are asked to vote on which generations are "best" – that's the bit that might influence things like "delve" https://
openai.com/research/instr
uction-following
…
AI
-

Pre-training and Instruction-Tuning in Large Language Models
By
–
-
Meta Releases Live Preview and Animation Features for Image Generation
By
–
There's another quieter release from @AIatMeta today that's really cool.
* Live Preview: As you type your image prompt, you get a live preview, making iterating for a good image easier.
* Animate: now you can animate images for short bursts -
RLHF and Instruction Tuning: Understanding Model Training Mechanisms
By
–
Yeah, what did it get wrong? It fitted my mental model of how the RLHF/instruction tuning stage works pretty closely
-

HyperWrite Launches Fine-Tuned LLaMA 3 Model
By
–
An initial HyperWrite fine-tune of LLaMA 3 is working and we're evaluating it in the HyperWrite platform. Will iterate, then ship to users soon!
-
GPT-3 Ada Model: 2.7 Billion Parameters Breakdown
By
–
I learned today that GPT-3 Ada was a 2.7bn parameter model (Babbage was 6.7, Curie 13 and Davinci 175)
-
Prompt Injection vs Jailbreaking: Clarifying Key Security Concepts
By
–
That document has an incorrect definition of prompt injection: it says "Prompt injection attacks are attempts to circumvent content restrictions to produce particular outputs" – but that's not prompt injection, that's jailbreaking
-

Top 8 AI Search Engines to Replace Google
By
–
Top 8 AI Search Engine That You Should Replace With Google: GenAI has enabled new search engine platforms with unique features and advantages, challenging Google's dominance. https://
kdnuggets.com/top-8-ai-searc
h-engine-that-you-should-replace-with-google?utm_source=dlvr.it&utm_medium=twitter&utm_campaign=top-8-ai-search-engine-that-you-should-replace-with-google
… -
Meta’s Evasive Response to AI Technology Failures Criticized
By
–
The absolute obliviousness of Meta (the company)'s response in this article is astounding: "this is new technology and it may not always return the response we intend". The desired output here is actually easy to achieve: don't.