Is there a demo anywhere where I can talk to one of these models that's had a "monthly update" LoRA and see the working end result?
LLMS
-
Deep Understanding of Fine-tuning in AI Models
By
–
Same here The best I've seen are loose explanations that fine-tuning is better for setting things like the tone of the response or teaching the model new styles of output – or helping with problems like questions-to-SQL I want deeper understanding than that
-
Fine-tuning vs RAG: Adding Knowledge to Language Models
By
–
The question here is about whether you can use fine-tuning to add small amounts of additional knowledge to an LLM – to solve the "chat about information in this documentation" problem RAG is the common solution to that problem. Can fine-tuning solve that problem too?
-
LoRA Fine-Tuning Chatbot Demo: Proof of Concept Needed
By
–
So far I haven't had a single reply that has linked me to a demo of a chatbot that has used LoRA fine-tuning to learn something new I want to believe it works! But I need to see it working
-
Vector Databases and RAG: Training Approaches
By
–
Training – a vector database is RAG and I know that works already
-
ML NLP LLMs RAG Tips Daily Newsletter
By
–
If you’re interested in:
– ML/NLP
– LLMs
– RAG Connect with me → @Saboo_Shubham_ My Newsletter → http://
unwindai.substack.com Everyday, I share tip & tutorials on above topics on X and my newsletter. -
MacBook M1 Pro achieves 20-25 tokens per second performance
By
–
Totally, depends on the usecase and the number of users you concurrently want to serve. I get 20-25 tokens/sec on my Macbook M1 pro 16 GB.
-
Fine-tuning Models: Can It Really Add New Knowledge?
By
–
This is why I want to see an example – just one – of a successful fine-tune that added specific extra knowledge to a model Until I've seen that I can't say for certain that it can be done
-
LLM Apps with RAG: Explore Awesome Demos in GitHub Repository
By
–
Find all the awesome LLM Apps demo with RAG in the following Github Repo. P.S: Don't forget to star the repo to get updates on the future tutorials
-
OpenAI-Compatible API for Local Llama-3 Deployment
By
–
Bonus 2: Create OpenAI like API for Llama-3 deployed locallyhttps://t.co/Edui3AXfI6
— Shubham Saboo (@Saboo_Shubham_) 3 mai 2024Bonus 2: Create OpenAI like API for Llama-3 deployed locally