There was always a balance between small enough chunks to allow the embeddings to capture the semantic meaning of a chunk, while at the same time wanting them to be long enough to have the full context This helps strike this balance Docs: https://
python.langchain.com/docs/modules/d
ata_connection/retrievers/parent_document_retriever
…
CODE
-
Balancing Chunk Size for Semantic Embeddings in RAG Systems
By
–
-
Exploring Retrieval Algorithms for LangChain Documentation
By
–
We'd been noodling on this concept for a bit, but spurred into action by @ChrisBoraTweets yesterday: https://
x.com/ChrisBoraTweet
s/status/1689018380584439808?s=20
… What other retrieval algorithms would be good to add? Docs: https://
python.langchain.com/docs/modules/d
ata_connection/retrievers/parent_document_retriever
… -
LangChainJS Text Splitters Available for Development
By
–
i think we have most of these splitters in langchainjs – @Hacubu can maybe help you out
-
Candle Torch Rust Framework Preview Released
By
–
like a candy store opening in town https://
reddit.com/r/rust/comment
s/15lidhr/early_preview_candle_torch_in_rust/
… -
Dataset Query and RoBERTa-Large Performance on IMDB Reviews
By
–
Which dataset have you used in this figure? If you want to boost it a few more percentage points, RoBERTa-Large is worth trying. Here are some results on the IMDB review dataset: https://
github.com/Lightning-AI/d
l-fundamentals/discussions/41
… -
Adding multilingual code evals to BigCode evaluation platform
By
–
Nice! Would be cool to add it to https://
huggingface.co/spaces/bigcode
/multilingual-code-evals
…! -
Code Improvement: When Better Solutions Replace Initial Implementation
By
–
Always a proud moment when someone takes the time to replace your hacky code with something great.
-
ParentDocumentRetriever Implementation in LangChain Framework
By
–
I ended up going a slightly different direction (in terms of implementation): https://
github.com/langchain-ai/l
angchain/pull/8941
… ParentDocumentRetriever – retrieves the parent document for a given chunk. not exactly the same but close?