If you insert a pen drive or external drive while running the program, it will also be listed. The get_drives() function shown below returns the list of all drives. def all_duplicate(file_dict, path=””):Īll_file_list = It gives the output to a file named duplicate.txt in the current running folder.
Synology duplicate files finder code#
The all_duplicate() function in the following code is used to print all duplicate files in the drive. def md5(fname,size=4096):įor chunk in iter(lambda: f.read(size), b””): The md5() function calculates the MD5 hash of the file. Do not worry about creating MD5 hashes because there is a module hashlib which will do this for you. The following modules will be used in the program.
# email-id Figure 1: Code flow to create hashes of all files Finally, the create() function dumps the Python default dictionary into a pickle file. In this way, the search1() function creates a Python default dictionary, which contains hashes as keys and files with paths as values. The search1() function uses the md5() function to generate the MD5 hash for each file. It accesses all hard disk drives through the get_drive() function then, it creates threads for each drive and calls the search1() function. The function create() will be called by the user with arguments.
See the basic code flow in Figure 1, which signifies the functionality of generating a database file that contains hashes of all files. In the first step, let’s create and save the MD5 hash of all the files of all drives. In this article, I am going to use the MD5 hash to find the integrity of files. If two files have the same content, with the same or different names, then their MD5 hash (or other hash algorithm) must be the same. Before jumping to the source code, I want to explain the principle of the code, which is based upon the integrity of the file.
0 kommentar(er)
