RAG stands for retrieval augmented generation, which enables companies to fetch important data relative to a query in a prompt in order to improve its results.
GENERATIVE AI
-
RAG Emerges as Developer Priority for Model Performance Optimization
By
–
Among all the developers, experts, and sources I talk to, no subject comes up more than RAG. Developers are increasingly working with it as a precursor to fine-tuning to squeeze more performance out of less-powerful models.
-
Pretraining Llama 2 with New Data: Tutorial and Approach
By
–
Instead of training from scratch, you could take the existing Llama 2 base model and pretrain it for a few more epochs on new data and see how it performs. I set up a tutorial here the other day (you may want to swap the dataset depending on your usecase): https://
github.com/Lightning-AI/l
it-gpt/blob/main/tutorials/pretrain_redpajama.md
… -
Microsoft CEO: AI Competition Reshaping Search Landscape
By
–
Microsoft & OpenAI CEOs: Dawn of the AI Wars https://
bit.ly/3qEjJvH Emily Chang sits down with Microsoft CEO Satya Nadella to hear how AI is shaking up the competition for search. Nadella argues that this new wave of technology is as big as the web browser or the iPhone. -
Google TextFX: Creative Writing Tools for Rappers and Writers
By
–
Playing around with @Google
’s TextFX this morning, a suite of 10 creative writing tools that are designed for “rappers, writers and wordsmiths.” It’s an experiment in Google Labs (
@GoogleAI
), so don’t expect a finished product, but it’s fun to explore and consider the -
Summer LLM Developments: Llama 2, CodeLlama, and GPT-4
By
–
Llama 2, CodeLlama, and leaked GPT-4 details. Here's my new write-up on the noteworthy developments around LLMs of this summer so far:
-
Implementing AI: accessibility and RLHF resources
By
–
Still a great list. Today I would add to dive as soon as possible in implementing something yourself since recent AI developments have become so accessible. We still need more good book/ressources on RLHF, maybe @natolambert or @_lewtun will fill this gap soon 🙂
-
ChatGPT Excludes Non-English Languages from AI Revolution
By
–
#ChatGPT Is Cutting Non-English Languages Out of the #AI Revolution https://
bit.ly/3C0Bdo2 via @WIRED #ethics -
GPT-3.5 vs GPT-4 exam results at Wharton School
By
–
Graph of GPT-3.5 vs. GPT-4 results in various exams from Wharton School
-
ChatGPT Ultimate Prompting Guide: Essential Elements
By
–
Here's the ChatGPT Ultimate Prompting Guide Important elements to include: 1. Tone
2. Format
3. Objective
4. Context
5. Examples If you don't get the right output, try again you will get it soon… It is because of the prompt, not the tech! #Genai #tech #skillsofthefuture