Deduplicate documents in retrieval automatically
Some indexes may contain multiple identical documents or documents with very similar content. To enhance search accuracy and streamline retrieval results, we'd like to introduce a feature that automatically identifies and deduplicates these documents.