#

text-deduplication

Here are 2 public repositories matching this topic...

tomventa / dedupe

Tool to deduplicate file contents

dedupe deduplication text-deduplication file-content-deduplication

Updated Jan 26, 2026
Go

Jihad-41 / fast-website-content-crawler

high-performance website content extractor

data-extraction content-analysis content-aggregation website-scraping competitive-research site-structure-analysis bulk-url-crawler text-deduplication parallel-crawling web-data-insights

Updated Nov 11, 2025
Python

Improve this page

Add a description, image, and links to the text-deduplication topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the text-deduplication topic, visit your repo's landing page and select "manage topics."