Full blog here: https://
blog.langchain.dev/benchmarking-q
uestion-answering-over-csv-data/
… And full code here: https://
github.com/langchain-ai/l
angchain-benchmarks
… Just benchmarking CSV question answering for now, but others up next
CODE
-
Benchmarking CSV Question Answering Systems with LangChain
By
–
-
Custom Agent with Python REPL and Retriever Tools
By
–
Then we could go about improving it! Our final solution was a custom agent with two tools: – Python REPL (for doing analysis)
– Retriever (for dealing with text data present) We're excited to see other's solutions for this as well! -
LangChain Benchmarking Question-Answering CSV Data Tasks
By
–
Recap of important links: Blog: https://
blog.langchain.dev/benchmarking-q
uestion-answering-over-csv-data/
… YouTube: https://
youtube.com/watch?v=jGnf4O
hptbA
… Code & data used: https://
github.com/langchain-ai/l
angchain-benchmarks
… We had a lot of fun doing this and learned a lot – we're going to do it for more tasks! Up next: SQL -
Improving AI Agents for CSV Question-Answering Applications
By
–
This started ~2 weeks ago, when I tweeted that we wanted to improve our chains/agents for doing question/answering over CSV data Why? Most QA applications focus on text data, but lots of real world data is in CSVs
-
LangChain Benchmarking Question Answering CSV Data
By
–
Blog: https://
blog.langchain.dev/benchmarking-q
uestion-answering-over-csv-data/
… YouTube: https://
youtube.com/watch?v=jGnf4O
hptbA
… Code & data used: https://
github.com/langchain-ai/l
angchain-benchmarks
… Now for a quick thread: -
Benchmarking Question Answering Over CSV Data
By
–
Benchmarking Question/Answering Over CSV Data Deep dive on improving an application that does question answering over CSV data: 3000 word blog post
30min video
Open sourced eval data
Open sourced code for gathering feedback
Open sourced final agent code -
GPT-3.5 Unreliable for Programming Tasks
By
–
3.5 is really not reliable for anything programming related in my experience
-
Agents with Multiple Retrievers for Conversational QA
By
–
this is pretty easily doable – you can give an agent access to multiple retrievers! https://
python.langchain.com/docs/use_cases
/question_answering/how_to/conversational_retrieval_agents
… -
Streaming Output with cURL and jq Programming Example
By
–
You can also receive streaming output using the programming language of your choice. Here's an example using cURL and jq: pic.twitter.com/6pLpTULCU9
— Replicate (@replicate) 14 août 2023You can also receive streaming output using the programming language of your choice. Here's an example using cURL and jq:
-
API now supports server-sent event streams for language models
By
–
Our API now supports server-sent event streams for language models, giving you live output as the model is running. Learn how to consume event streams to make your apps more responsive.