I'm looking for stuff I can cleanly "pip install" without having to run an additional server – ollama is my backup plan if I can't solve it without
LLMS
-
Claude’s Million Token Context Enables 250+ Tool Support
By
–
Underrated outcome of @AnthropicAI Claude having up to 1m token context length with ~perfect recall: Claude can now confidently handle >250 tools!! When OpenAI fn calling first came out I think it was @simonw who called out that we needed "deep" functions bc of the context
-
Running LLaVA 1.6 Locally on Mac: Python Recipe Guide
By
–
Does anyone have a good Python recipe for running LLaVA 1.6 on a Mac? Any library you like is fine but I don't want to have to run a separate server process
-
Command R+ Achieves Better Token Efficiency Than GPT Models
By
–
Interesting finding from the Command R+ blog post. For many languages, Command R+ will use far fewer tokens than GPT models to represent the same text. This effectively reduces overall costs significantly.
-
Anthropic Adds Tool Use to Claude 3 APIs
By
–
Anthropic Tool Calling @AnthropicAI just added tool use to their Claude 3 APIs, which is extremely useful for structured outputs. Here's a short video explaining how to use it from the latest langchain-anthropic package! @rlancemartin also explains how to design
-
Claude 3 Function Calling Enables Structured Data Extraction
By
–
Function calling support in Claude means the structured data extraction trick I wrote about here now works with the Claude 3 models – including their vision models, notable because GPT-4 Vision doesn't support functions yet https://
til.simonwillison.net/gpt3/openai-py
thon-functions-data-extraction
… -
Claude Tool Use Now Available Beta Anthropic Messages API
By
–
Tool use is now available in beta to all customers in the Anthropic Messages API, enabling Claude to interact with external tools using structured outputs. pic.twitter.com/kJHhSvyLdK
— Anthropic (@AnthropicAI) 4 avril 2024Tool use is now available in beta to all customers in the Anthropic Messages API, enabling Claude to interact with external tools using structured outputs.
-
Anthropic Releases Tool Use Documentation for Claude API
By
–
We look forward to your feedback. Read more in our developer documentation: https://
docs.anthropic.com/claude/docs/to
ol-use
… -
Two Advanced Webinars: LLM Optimization and Flow Engineering
By
–
We've got two AMAZING webinars coming up on two advanced topics: "Optimization of LLM Systems" with Omar K. (author of DSPy) – TOMORROW at 9 am PT! https://
us06web.zoom.us/webinar/regist
er/WN_n4HUNqhFQFa4ax3kYrZW8g#/registration
… "Flow Engineering" with Itamar Friedman (author of Alpha Codium) https://
us06web.zoom.us/webinar/regist
er/WN_fVikSl9eQv68b3ZUdQgwzA#/registration
… -
Claude 3 Models Include Vision Capabilities Cheaper Than GPT-3.5
By
–
All three of the Claude 3 models do vision, including Haiku which is cheaper than gpt-3.5-turbo