I'm on a 64GB MacBook Pro M2 with 2TB of disk and I'm already feeling constrained for both RAM and disk space, but wow these laptops are expensive these days! I have a Samsung external 4TB USB drive which helps
@simonw
-
Mixing API and Local Models for Terminal Usage
By
–
If you want to mix API model and local model usage together, or use API models from the terminal generally
-
Medical Chatbot Deployment Risks and WHO Brand Responsibility
By
–
Yeah, in that case I'd question the wisdom of even attempting to release a chatbot! The scope of medical-related questions people could ask that is effectively infinite, I can't even imagine a QA process that would be thorough enough to responsibly release that with the WHO brand
-
llm-gpt4all 0.4 Release Notes Published
By
–
Release notes for llm-gpt4all 0.4 are here: https://
github.com/simonw/llm-gpt
4all/releases/tag/0.4
… -
Llama 3 8B Now Available via llm-gpt4all Plugin
By
–
I upgraded the llm-gpt4all plugin to support running Llama 3 8B Instruct (thanks, @nomic_ai
) llm install –upgrade llm-gpt4all
llm -m Meta-Llama-3-8B-Instruct 'Write Python code to print 5 great names for a pet pelican' The quantized model is a 4.34GB download, needs 8GB RAM -
Handling Chatbot Self-Help Queries with RAG and Prompting
By
–
If you ship a chatbot, it's now indisputable that people are going to ask it questions about how to use it Handling this isn't trivial but it's not unsolvable either – use RAG, fine-tuning or a meticulous system prompt, it's important to anticipate this use-case
-
Anthropic increases Haiku tokens amid API provider competition
By
–
5-10x times more Haiku tokens per day from @AnthropicAI – hard not to assume this is in reaction to the flood of new API providers selling cheap access to Llama 3
-
Animators Need Better AI Tools Without Coding Requirements
By
–
Making it so animators have to write code in order to publish their work online is such a huge miss
-
Lack of Public Documentation in AI Implementation Practices
By
–
That sounds like it would work in theory, I'd love to see documented examples with live demos of people doing that in practice I get the impression that people who do this rarely share their results publicly, which is a shame
-
Meta AI vs ChatGPT: Internet Search Capabilities Compared
By
–
That's not an equal comparison, because Meta AI has the ability to search the internet and incorporate the search results into its responses – ChatGPT can do that too with Bing and GPT-4, but can't do that with 3.5