LangSmith Webhooks w/ Modal LangSmith automations help you build a data flywheel by taking actions on data. By default you can move data to datasets or annotation queue With @modal_labs you can set up a webhook to perform arbitrary actions https://
docs.smith.langchain.com/monitoring/faq
/webhooks#example-with-modal
…
SOFTWARE
-
LangSmith Webhooks with Modal for Custom Automation
By
–
-
FlowTestAI: Bridging APIs and LLMs for Enhanced Testing
By
–
Empowering Development with FlowTestAI: Bridging APIs and LLMs for Enhanced Testing and Privacy Interacting with APIs is a big use case for LLMs. Excited to highlight a fun blog from @FlowTestAI showing how they built a prod platform for this https://
blog.langchain.dev/empowering-dev
elopment-with-flowtestai/
… -
Cool Experimentations with Generative UI
By
–
cool experimentations with generative ui https://t.co/2UO6jCm81P
— LangChain (@LangChain) 22 avril 2024cool experimentations with generative ui
-
Running Meta-Llama-3-70B Locally with 64GB RAM
By
–
If you have 64GB RAM:
curl -L -o Meta-Llama-3-70B-Instruct.Q4_0.llamafile 'https:''//huggingface.co/jartine/Meta-Llama-3-70B-Instruct-llamafile/resolve/main/Meta-Llama-3-70B-Instruct.Q4_0.llamafile?download=true'
chmod 755 Meta-Llama-*
./Meta-Llama-3-70B-Instruct.Q4_0.llamafile -
Running Meta-Llama-3-8B Local Model on Your Laptop
By
–
Here's the super-short version. For a ~4GB local model that should run on most laptops: brew install llm # or pipx install llm
llm install llm-gpt4all
llm -m Meta-Llama-3-8B-Instruct "Three great names for a pet emu" -
PandasAI: Generative AI for Natural Language Data Analysis
By
–
Python library that adds Generative AI capabilities to Pandas Introducing PandasAI, now you can analyze complex data frames and plot visualizations just by using natural language
-
Llama 3 LLM Plugins: Local Hosting and API Access Guide
By
–
I pulled together notes on all of the LLM plugins that have worked for me for Llama 3 – both for hosting locally (I've run 8B and 70B on my 64GB M2) and access via APIs (Groq is SO FAST for that)
— Simon Willison (@simonw) 22 avril 2024
Options for accessing Llama 3 from the terminal using LLMhttps://t.co/OuG7EqCI4F pic.twitter.com/xmBisMH7IoI pulled together notes on all of the LLM plugins that have worked for me for Llama 3 – both for hosting locally (I've run 8B and 70B on my 64GB M2) and access via APIs (Groq is SO FAST for that) Options for accessing Llama 3 from the terminal using LLM https://
simonwillison.net/2024/Apr/22/ll
ama-3/
… -
BLOB Columns: Embeddings Storage in LLM Datasette
By
–
BLOB columns: https://
llm.datasette.io/en/stable/embe
ddings/storage.html
… -
ChatGPT as Digital Sales Strategist for Product Pages
By
–
1. ChatGPT as Digital Sales Strategist Prompt: "You are a Digital Sales Strategist. Analyze our product pages [add your product URL] and suggest detailed improvements to increase sales for our digital products [specify product types]."
-
CUDA CuDNN Python Startup Costs and Compilation Overhead
By
–
its unclear to me even for code because compile-time and startup costs (even for a CUDA/CuDNN loading Python program) is 1 second.
If you strip out the binary blobs that need to load (say business logic filled program), then its quicker, but i'm not sure if there aren't other