OPEN SOURCE

LangSmith Benchmarks: Evaluate LLM Performance on Your System

By

–

22 November 2023 18h27

More to come! Check out the blog post for more information on how to get started, or see the benchmark docs to run these on your own system. https://
blog.langchain.dev/public-langsmi
th-benchmarks/
… https://
langchain-ai.github.io/langchain-benc
hmarks/index.html
…

LangChain Benchmarks Package for LLM and Embedding Comparison

By

–

22 November 2023 18h27

Try it yourself We've published the new langchain-benchmarks package, which provides tooling to easily compare LLMs, embeddings, indexing techniques, and more across these datasets, so you can find the optimal solution for each task.
https://
langchain-ai.github.io/langchain-benc
hmarks/notebooks/retrieval/langchain_docs_qa.html
…

LangChain Q&A Dataset Tests RAG Functionality

By

–

22 November 2023 18h27

🤝 Shared Q&A Dataset
We hand-crafted a Q&A dataset from LangChain’s python docs. The questions help test important RAG functionality like the ability to synthesize multiple documents and know when to abstain from guessing.

🔗 https://t.co/UEuqpyb15Q pic.twitter.com/TfZLgFc0CJ
— LangChain (@LangChain) 22 novembre 2023

Shared Q&A Dataset
We hand-crafted a Q&A dataset from LangChain’s python docs. The questions help test important RAG functionality like the ability to synthesize multiple documents and know when to abstain from guessing.
https://
smith.langchain.com/public/452ccaf
c-18e1-4314-885b-edd735f17b9d/d
…

→ View original post on X — @ylecun

Open Source AI Infrastructure and Crowdsourced Training Importance

By

@ylecun

–

22 November 2023 18h26

One of the most important reason why AI infrastructure models must be open source, and their training/fine-tuning must be crowd-sourced.

Free OSS and Google Models Access in LangSmith Playground

By

–

22 November 2023 17h33

OSS models and Google models in LangSmith Playground for FREE Want to experiment with new models easily? No need for an API key! We've partnered with @thefireworksai and @GoogleAI to give you access to both OSS and Google models such as Mistral-7b, LLaMA2-70b or

→ View original post on X — @montreal_ai

Hyperspace: Decentralized P2P Network for Artificial Intelligence

By

@montreal_ai

–

22 November 2023 17h17

"Hyperspace: A Peer-to-Peer Artificial Intelligence Network" By @Varun_Mathur : https://
hyperspace.computer/bittorrent-for
-ai.pdf
… #ArtificialIntelligence #peer2peer #Network

→ View original post on X — @abacusai

Flexible LLM Options: Closed-Source and Custom Models

By

@abacusai

–

22 November 2023 17h00

LLMs: You can use closed-source (e.g. GPT-4) or your own custom LLM (Abacus-Giraffe or Llama2). You can compare and contrast whichever LLM works for you and pick the best one 11/13