RAG From Scratch: Query Structuring Our RAG From Scratch video series walks through impt RAG concepts in short / focused videos w/ code. This is the 11th video in our series and focuses on query structuring. Problem: We interact w/ databases using domain-specific
CODE
-
Fine-tuning LLaMA 2 7B and Mistral models for practical applications
By
–
This was based off of an older project I did, so the model we train is LLaMA 2 7B. If you want, you can easily use a newer + better model like Mistral 7B.
-
Claude LLM Trainer: Open-Source Task-Specific Model Training
By
–
Introducing `claude-llm-trainer` ✍️
— Matt Shumer (@mattshumer_) 27 mars 2024
The world's simplest way to train a task-specific LLM.
Just write a sentence describing the model you want.
A chain of AI systems will generate a dataset and train a model for you.
And it's open-source. pic.twitter.com/k6NDkSMmcBIntroducing `claude-llm-trainer` The world's simplest way to train a task-specific LLM. Just write a sentence describing the model you want. A chain of AI systems will generate a dataset and train a model for you. And it's open-source.
-
claude-llm-trainer: AI Model Training Platform Using Claude 3
By
–
How it works: – The user describes the model they want
Ex: "A model that writes Python functions" – claude-llm-trainer leverages a chain of Claude 3 calls to create a great dataset for your task. – We process the dataset, and train a LLaMA model! -
PR Accepted by GCHQ: Government AI Development Progress
By
–
… I totally got a PR accepted by GCHQ this morning
-
Real Data Learning Doesn’t Look Like This Training
By
–
yeah i was thinking, learning from real data never looks like this …
-
JavaScript RAG Course: Build Full-Stack Web Apps with LlamaIndex
By
–
New JavaScript short course: Build a full-stack web application that uses RAG in JavaScript RAG Web Apps with LlamaIndex, taught by @seldo, VP of Developer Relations at @llama_index and npm co-founder.
— Andrew Ng (@AndrewYNg) 27 mars 2024
– Build a RAG application for querying your own data
– Develop tools to… pic.twitter.com/JB95PSQqtLNew JavaScript short course: Build a full-stack web application that uses RAG in JavaScript RAG Web Apps with LlamaIndex, taught by @seldo
, VP of Developer Relations at @llama_index and npm co-founder.
– Build a RAG application for querying your own data
– Develop tools to -
Off-by-One Error in Autoregressive Model Training
By
–
hahah I’ve made this mistake too; it’s pretty easy to do in autoregressive model-training. just an off-by-one error: predict token T from token T instead of T+1
-
Model Training Bug Resets AGI Performance to Baseline
By
–
yesterday my model was training and its performance was so good that twitter ppl threatened to blow up my house in case i was about to release AGI then, i fixed one line of code. now my model performance is exactly the same as the baseline ah, the ups and downs of science
-
Building Generative AI Applications with LangChain and OpenAI
By
–
3/ Building generative AI applications using LangChain and OpenAI APIs