evolution of @huggingface iOS apps up to now…
TOOLS
-
Cursor AI Team Likely Developing Similar Features
By
–
I'm sure the @cursor_ai team is thinking about something similar
-
LangSmith Webhooks with Modal for Custom Automation
By
–
LangSmith Webhooks w/ Modal LangSmith automations help you build a data flywheel by taking actions on data. By default you can move data to datasets or annotation queue With @modal_labs you can set up a webhook to perform arbitrary actions https://
docs.smith.langchain.com/monitoring/faq
/webhooks#example-with-modal
… -
AI Agents Vertical Growing Fast with Dynamic RAG Support
By
–
Our AI Agents vertical is our fastest-growing vertical. It can help you crank out multiple bots to perform different tasks of varying complexity. Some of our customers even want to make 700+ agents! You will need support for:
•Dynamic RAG, information retrieval, and vector -
FlowTestAI: Bridging APIs and LLMs for Enhanced Testing
By
–
Empowering Development with FlowTestAI: Bridging APIs and LLMs for Enhanced Testing and Privacy Interacting with APIs is a big use case for LLMs. Excited to highlight a fun blog from @FlowTestAI showing how they built a prod platform for this https://
blog.langchain.dev/empowering-dev
elopment-with-flowtestai/
… -
Running 4GB LLM Models on CPU with GPT4All
By
–
I wonder if it can run the 4GB model? @nomic_ai gpt4all uses llama.cpp and can run on CPU so it might still work
-
Llama 3 Access Through Multiple API Providers and Plugins
By
–
And if you want to try Llama 3 through APIs from Perplexity, Anyscale Endpoints, Fireworks, Together AI or OpenRouter there are plugins for those too:
-
Running Llama 3 70B locally with llamafile and LLM
By
–
That starts a llamafile running Llama 3 70 B on localhost port 8080 – then talk to it from LLM like this: llm install llm-llamafile
llm -m llamafile "3 neat characteristics of a pelican" -
Groq Llama 3 70B API Setup Guide and Installation
By
–
For the ludicrously fast Llama 3 70B API from @GroqInc
, get an API key from https://
console.groq.com/keys and then: llm install 'https:''//github.com/lexh/llm-groq/archive/ba9d7de74b3057b074a85fe99fe873b75519bd78.zip'
llm keys set groq
# paste API key here
llm -m groq-llama3-70b 'hi' -
Running Meta-Llama-3-8B Local Model on Your Laptop
By
–
Here's the super-short version. For a ~4GB local model that should run on most laptops: brew install llm # or pipx install llm
llm install llm-gpt4all
llm -m Meta-Llama-3-8B-Instruct "Three great names for a pet emu"