4. LLM app with RAG using Llama-3 running locally on your computer (100% free and without internet)
TOOLS
-
ttok 0.3 releases new allow-special option for tokenization
By
–
New release of ttok (version 0.3) adds a "–allow-special" option that fixes that: https://
github.com/simonw/ttok/re
leases/tag/0.3
… -
OpenAI tiktoken library rejects special tokens by default
By
–
TIL the OpenAI tikoken library rejects text that includes special tokens by default, which affects my own "ttok" CLI tool – it raises an error if you call it like this: ttok '' –encode
-
RAG and Tool Usage for Business AI Customization
By
–
"Tailor Al to your business needs without an expensive custom model, using prompt templates and copilot actions that securely reference your business data" – sounds like that's RAG + tool usage, not a fine-tuned model
-
Cursor’s OpenAI Technology: RAG or GPT-3.5 Fine-tuning?
By
–
The smallprint says "Cursor uses artificial intelligence technology provided by OpenAI, LLC" – so presumably it's RAG? Or did they do a fine-tune of GPT-3.5?
-
Fine-tuned Chatbot Demo with Targeted Knowledge Addition
By
–
Does anyone have a link to a chatbot demo I can try out right now that's serving a model that has been fine-tuned to add additional targetted knowledge (not behavior – actual information that it can answer questions about) to that model?
-
Lamini Tutorial Announcement: Creating AI Applications
By
–
Congrats Sharon, Lamini is super cool. Planning to create a tutorial on that super soon.