fclones
Efficient duplicate file finder and remover.
More information: https://github.com/pkolaczk/fclones.
- Search for duplicate files in the current directory:
fclones group .
- Search multiple directories for duplicate files and cache the results:
fclones group --cache path/to/directory1 path/to/directory2
- Search only the specified directory for duplicate files, skipping subdirectories and save the results into a file:
fclones group path/to/directory --depth 1 > path/to/file.txt
- Move the duplicate files in a TXT file to a different directory:
fclones move path/to/target_directory < path/to/file.txt
- Perform a dry run for soft links in a TXT file without actually linking:
fclones link --soft < path/to/file.txt --dry-run 2 > /dev/null
- Delete the newest duplicates from the current directory without storing them in a file:
fclones group . | fclones remove --priority newest
- Preprocess JPEG files in the current directory by using an external command to strip their EXIF data before matching for duplicates:
fclones group . --name '*.jpg' -i --transform 'exiv2 -d a $IN' --in-place