Build a RAG system with Llama 3B-Instruct for your PDFs Uses API for partitioning & chunking, FAISS for vector store, huggingface for the model It's a collab notebook so it's easy to get started! Thanks @mariaKhalusova for a great resource! https://
colab.research.google.com/drive/1BJYYyrP
Ve0_9EGyXqeNyzmVZDrCRZwsg?usp=sharing#scrollTo=Y2m2l-vt_RSp
…
OPEN SOURCE
-
Build RAG System Llama 3B-Instruct PDFs FAISS
By
–
-
Embedchain Documentation Confirms Feature Support
By
–
I think it supports that, to confirm you can check the Embedchain documentation.
-
LLM Apps with RAG: Explore Awesome Demos in GitHub Repository
By
–
Find all the awesome LLM Apps demo with RAG in the following Github Repo. P.S: Don't forget to star the repo to get updates on the future tutorials
-
OpenAI-Compatible API for Local Llama-3 Deployment
By
–
Bonus 2: Create OpenAI like API for Llama-3 deployed locallyhttps://t.co/Edui3AXfI6
— Shubham Saboo (@Saboo_Shubham_) 3 mai 2024Bonus 2: Create OpenAI like API for Llama-3 deployed locally
-
Run Llama-3 locally on your computer for free
By
–
Bonus: 3 ways to run Llama-3 locally on your computer (100% free and without internet)
-
Local LLM App with RAG Using Llama-3 Offline
By
–
4. LLM app with RAG using Llama-3 running locally on your computer (100% free and without internet)
-
ttok 0.3 releases new allow-special option for tokenization
By
–
New release of ttok (version 0.3) adds a "–allow-special" option that fixes that: https://
github.com/simonw/ttok/re
leases/tag/0.3
… -
OpenAI tiktoken library rejects special tokens by default
By
–
TIL the OpenAI tikoken library rejects text that includes special tokens by default, which affects my own "ttok" CLI tool – it raises an error if you call it like this: ttok '' –encode
-
Llama-3 Memory Requirements: 5GB to 40GB Across Model Sizes
By
–
Nope. From 5 GB for llama-3 8B to 40GB for llama-3 70B. Check it out here at @ollama
: -
LLMs in Space: Hardening llm.c to NASA Safety Standards
By
–
Clearly LLMs must one day run in Space Step 1 we harden llm.c to pass the NASA code standards and style guides, certifying that the code is super safe, safe enough to run in Space. https://
en.wikipedia.org/wiki/The_Power
_of_10:_Rules_for_Developing_Safety-Critical_Code
… (see the linked PDF)
LLM training/inference in principle should be super