Contextual Indexing is another good technique. Essentially, before embedding a chunk, prepend a short description of where it sits in the document…something like "This chunk is from Section 3 of a whitepaper on authentication methods." This helps because chunks often lose
Contextual Indexing: Adding Document Context to Chunks Before Embedding
By
–
Leave a Reply