8

One thing I am really missing in KDE is a good, general-purpose program for finding duplicate files. There are a lot of really good ones that I found for windows, but no comparable for linux and none even worth mentioning for KDE.

Such a program should, at the very least, be able to do compare based on file name, file size, checksum, and byte-by-byte comparison. Better yet, it would have the option of doing any one of these, but when it checks by checksum it would first check by file size and then by checksum, and if it checks byte-by-byte it would first check by file size, then checksum, then byte-by-byte.

Additionally, it should have the options to compare all files in a folder recursively (navigating through subfolders). It should be able to exclude certain file name patterns and/or file types, as well as folders if searching recursively. It should also be able to compare all the file between two folders (including recursively, if desired), showing only those files that are present in both folders. It should have the option to select which file you want to remove based on different criteria such as which is newer, which folder each is in, which name is shorter, which name fits a certain pattern, and perhaps others, as well as manually. It should have the option to trash one of the duplicates, permanently delete one of the duplicates, convert one of the duplicates to a symlink, hard link, or shortcut, or archive the duplicates.

Additional features would be nice to have but are not as necessary:

One additional feature would be content-based image searching, that is comparing pictures based on the patterns of lines and colors rather than the sequence of bytes in the files. This would obviously require the ability to set the threshold for matches, as well as probably the option to exclude color information to allow you to compare color and black and white versions of the same pictures. These would require additional ways of selecting which file to delete, including which has a larger file size, which has larger dimensions, and removing a black and white picture while keeping a color version of the same picture and vice versus.

Another would be text comparisons, which compares the sequence of characters in a file ignore the format the file has. So a unicode and ASCII file with the same set of characters would be considered the same. Additional options would probably include excluding blank lines and excluding trailing whitespace at the ends of lines, even excluding whitespace entirely.

Another would be the option to find and remove zero-size files and empty folders. The empty folder search would probably also allow you to exclude certain files when determining whether a folder is empty. So for instance you could make it so a folder that only includes a .directory file would be counted as empty.

The final would be recursive full folder comparisons, seeing if two folders have the same files in the same places, and if not allowing you to move files from one folder to the other to make them the same.

Not a graphical app, but it exists (at least the first part you described)

http://netdial.caribe.net/~adrian2/fdupes.html

I used DuplicateFilesDeleter and I was extremely pleased with the result. really work very well for delete duplicate files

Hello Goodday, I use a software called Duplicate Files Deleter, it's very easy to use and after it finds the duplicate files it lets you chose what you want to do with them (copy/delete/move). You can even check network files and you can check multiple paths in the same scan. This helps me alot. I hope you too.