Semantic Chunking Semantic chunking using embedding distances between sentences to figure out how to split a document. A key decision is what threshold to split at. We now support three methods: Percentile
Interquartile Range
Standard Deviation Big shout out to
Semantic Chunking: Three Methods for Document Splitting
By
–
