Anyone got a working recipe for running the 128,000 token variant on a Mac?
LLMS
-
Impressive Performance of Compact 2.2G Model File
By
–
First impressions: this thing is wildly impressive for a 2.2G model file
-
Phi-3 Language Model Released with 4K and 128K Context Options
By
–
Phi-3 is out – I just got the 4,000 token context model running using llamafile from the instructions in their README https://
huggingface.co/microsoft/Phi-
3-mini-4k-instruct-gguf
… They have a 128,000 model too! It's not available as a GGUF yet -
Chain of Thought in Foreign Languages for AI Reasoning
By
–
This idea of having the AI do Chain of Thought in foreign languages & tell you the results in English so as not to ruin the surprise of the game is fascinating.
-
Llama 3, AI Data Journalism, LLM Evaluation Tools
By
–
Weeknotes: Llama 3, AI for Data Journalism, llm-evals and datasette-secrets
-
Memory optimization strategies for model training
By
–
didn't realize it was that easy, will take a look at; you can also try decreasing the batch size all the way down to 1, or then also decreasing sequence length until it fits, but you're compromising on max context length that way.
-
Phi Models Performance Issues and User Experience Concerns
By
–
I've never had good results from Phi models. Something always feels really off/broken…
-
Microsoft Phi-3 Model Shows Impressive Results
By
–
nice work on Phi-3 @SebastienBubeck and team 🙂
— Soumith Chintala (@soumithchintala) 23 avril 2024
results look really impressive. https://t.co/6sLVl478G5nice work on Phi-3 @SebastienBubeck and team 🙂
results look really impressive. -
LangSmith RAG Evaluation Series: Answer Correctness Video
By
–
⚡ LangSmith Evaluations: RAG Evaluation (Answer Correctness) ⚡
— LangChain (@LangChain) 23 avril 2024
Evaluations can accelerate LLM app development, but it can be challenging to get started. We've kicked off a new video series focused on evaluations in LangSmith.
This is the 12th video in our series, focusing on… pic.twitter.com/0bnzyS8pjbLangSmith Evaluations: RAG Evaluation (Answer Correctness) Evaluations can accelerate LLM app development, but it can be challenging to get started. We've kicked off a new video series focused on evaluations in LangSmith. This is the 12th video in our series, focusing on