Batching of inputs Previously, the only interface for calling an LLM was to pass in a single string. With big motivation from @thepromptking, there is now an interface that takes in and returns results for multiple inputs
LangChain Introduces LLM Input Batch Processing
By
–
Leave a Reply