Fast Near-Duplicate Image Search and Delete using pHash, t-SNE and KDTree.
Advanced Duplicate File Finder for Python
🍰 A library for creating n-grams, skip-grams, bag of words, bag of n-grams, bag of skip-grams.
Command line utility to remove exact duplicate files.
File duplicate remover for Synology DSM 213j+
Program to scan and search for file duplicates. (~300MB/s)
Function that removes duplicate items and objects based on a key from an array of objects.
Command Line Interface for deplicate
Takes an input CSV and produces a CSV of duplicate records. Then the input CSV is cleansed to remove duplicates.
A Python package to monitor your downloads folder and remove duplicate files.
A no-nonsense .NET Core 2.1 CLI duplicate files remover
Sort, uniq, reverse, and randomize data
rm-dup is a script to remove duplicate files
A tool that deduplicates lines of a textfile with the speed of ram and scales nicely on all cores concurrently.
Searches for duplicates in two separate folders allowing removing duplicated files from one and keeping another intact.
powerful data preprocessing application that simplifies the task of preparing data for machine learning models.
Short php code to have sort array and remove duplicates numbers.
To associate your repository with the duplicates-removed topic, visit your repo's landing page and select "manage topics."