4/ Task 2: Typewriter (26 tools) Agent has 26 tools, 1 for each English letter. It has to type the provided word. https://
langchain-ai.github.io/langchain-benc
hmarks/notebooks/tool_usage/typewriter_26.html
…
@langchain
-
Typewriter Task: Agent with 26 Letter Tools
By
–
-
LangChain Typewriter Task: Agent Tool Usage Benchmark
By
–
2/ Task 1: Typewriter (1 tool) Agent has 1 tool (a typewriter). It has to type the provided word. https://
langchain-ai.github.io/langchain-benc
hmarks/notebooks/tool_usage/typewriter_1.html
… -
GPT-4 Typewriter Task Performance Evaluation and Limitations
By
–
3/ Typewriter results None of the agents are perfect. GPT-4 had a hard time typing "keyboard" and "head" https://
smith.langchain.com/public/ff14ecb
2-3664-4c4a-b2dc-d8aa9fd2185d/d
… -
New Open-Source Tool Use Benchmarks for LLM Agents
By
–
Agents are the “killer” LLM app, but building and evaluating agents is hard. A huge part of agents is tool use, but there aren't enough open-source tool use benchmarks out there. Today, we are excited to release four new test environments for benchmarking LLMs’ ability to
-
LangChain Redis RAG Template Financial PDF Analysis
By
–
LangChain & Redis over Financial PDFs Excited to work with the @Redisinc team to create a RAG template for developers to chat with public financial PDF documents such as Nike’s 10k filings. The application uses: FastAPI and Uvicorn to serve client requests via HTTP
-
Personalizing Videos with LLMs Using LangChain
By
–
Personalizing videos with LLMs The talented folks @RubricLabs + @withgraphite wrote up a deep dive on using LangChain to generate personalized year-end "GitHub wrapped" videos for everyone! Generate your own: http://
year-in-code.com Blog: -
SQL Research Assistant: Complex Question Answering Over Data Tables
By
–
SQL Research Assistant Lots of data is locked in SQL tables Most text-to-SQL apps try to convert a user question to a single SQL statement – but that often isn't enough for complex questions So how we enable more complex question answering over SQL tables? We've
-
Question Answering Documents Using LangChain Vertex AI
By
–
Question Answering with Documents using LangChain and Vertex AI Matching Engine Learn how to use Vertex AI Matching Engine to ground your LLM in company documents Ingestion and generation powered by LangChain Code: https://
github.com/GoogleCloudPla
tform/generative-ai/blob/main/language/use-cases/document-qa/question_answering_documents_langchain_matching_engine.ipynb
… -
Open-Source AI Agent Automates Google Calendar Management
By
–
Open-Source Google Calendar Assistant Managing one's calendar can be a repetitive task – perfect for automation with an AI agent @jackgordley
's recent open source project tackles exactly that! Blog: https://
gordles.io/posts/calvin
Code: https://
github.com/jgordley/Googl
eCalendarAssistant
… -
Google Releases Seven LangChain Notebooks for Gemini Integration
By
–
LangChain x Google The official Google `generative-ai` repo has a ton of resources for getting started with Gemini This includes SEVEN different notebooks for using LangChain to orchestrate a Gemini-powered LLM app Dive into all the goodness: https://
github.com/GoogleCloudPla
tform/generative-ai/tree/main/language/orchestration/langchain
…