This ONNX one should run nicely on macOS if we can figure out the necessary incantations
CODE
-
Running 128K Token Model on Mac: Technical Setup Guide
By
–
Anyone got a working recipe for running the 128,000 token variant on a Mac?
-
Phi-3 Language Model Released with 4K and 128K Context Options
By
–
Phi-3 is out – I just got the 4,000 token context model running using llamafile from the instructions in their README https://
huggingface.co/microsoft/Phi-
3-mini-4k-instruct-gguf
… They have a 128,000 model too! It's not available as a GGUF yet -
Llama 3, AI Data Journalism, LLM Evaluation Tools
By
–
Weeknotes: Llama 3, AI for Data Journalism, llm-evals and datasette-secrets
-
Proprietary to Open Source: Why Users Never Return
By
–
"When people go from proprietary technology to open source they literally never go back."
– @jimkxa Thanks again @LinusTech -
Memory optimization strategies for model training
By
–
didn't realize it was that easy, will take a look at; you can also try decreasing the batch size all the way down to 1, or then also decreasing sequence length until it fits, but you're compromising on max context length that way.
-
Deliberate Terminology Confusion in Technology Industries
By
–
Sometimes I think the terms and abbreviations are deliberately designed to confuse others
-
LangSmith RAG Evaluation Series: Answer Correctness Video
By
–
⚡ LangSmith Evaluations: RAG Evaluation (Answer Correctness) ⚡
— LangChain (@LangChain) 23 avril 2024
Evaluations can accelerate LLM app development, but it can be challenging to get started. We've kicked off a new video series focused on evaluations in LangSmith.
This is the 12th video in our series, focusing on… pic.twitter.com/0bnzyS8pjbLangSmith Evaluations: RAG Evaluation (Answer Correctness) Evaluations can accelerate LLM app development, but it can be challenging to get started. We've kicked off a new video series focused on evaluations in LangSmith. This is the 12th video in our series, focusing on
-
YOLOv9 Instance Segmentation for Medical Image Analysis
By
–
🚀 Blog-tastic Tuesdays 🚀https://t.co/FxC8a04pof
— Satya Mallick (@LearnOpenCV) 23 avril 2024
In our latest blog post, we’ll explore how YOLOv9, the latest addition to the YOLO family, leverages the new Instance Segmentation models, taking medical image analysis to a whole new level.#computervision #objectdetection… pic.twitter.com/u47oUKZGFGBlog-tastic Tuesdays https://
learnopencv.com/yolov9-instanc
e-segmentation-on-medical-dataset/
… In our latest blog post, we’ll explore how YOLOv9, the latest addition to the YOLO family, leverages the new Instance Segmentation models, taking medical image analysis to a whole new level. #computervision #objectdetection