Phi-3 is out – I just got the 4,000 token context model running using llamafile from the instructions in their README https://
huggingface.co/microsoft/Phi-
3-mini-4k-instruct-gguf
… They have a 128,000 model too! It's not available as a GGUF yet
OPEN SOURCE
-
Phi-3 Language Model Released with 4K and 128K Context Options
By
–
-
Llama 3, AI Data Journalism, LLM Evaluation Tools
By
–
Weeknotes: Llama 3, AI for Data Journalism, llm-evals and datasette-secrets
-
Proprietary to Open Source: Why Users Never Return
By
–
"When people go from proprietary technology to open source they literally never go back."
– @jimkxa Thanks again @LinusTech -
Running Meta-Llama-3-8B-Instruct with LLM CLI Tool
By
–
Yes, you can run prompts like this: llm -m Meta-Llama-3-8B-Instruct -o temp 0.1 "3 names for a pet rhino" https://
github.com/simonw/llm-gpt
4all?tab=readme-ov-file#model-options
… -
Evaluating Speed Cost and Offline AI Performance Metrics
By
–
Speed, cost and the ability to run offline on a personal device are the things I care most about I still don't have a great answer for how to best evaluate these things but I'm researching that at the moment
-
Implementation Discovery of Speed Enhancement Through EvoSDXL-JP Model Merging
By
–
Wow, this is amazing! I tried to download a model from HuggingFace and run it, but CUDA ran out of memory. That's odd, so I looked at the contents of the .py file and found that it appears to be implemented as "Download 4 ingredient models and merge synthesize EvoSDXL-JP on your end"…! So you can actually achieve speed enhancement just by merging…! x.com/iwiwi/status/1…
-
LLaMA 3 Context Window Doubled to 16K Tokens Open-Source
By
–
I've doubled LLaMA 3's context window to 16K tokens. Fully open-source. Link in thread:
-
LLaMA 3 Context Window Extended to 16K Tokens Open-Source
By
–
I've doubled LLaMA 3's context window to 16K tokens. Fully open-source. Link in thread: