Advanced Search

Find duplicate files recursively (bash4, assoc. arrays)

/ Published in: Bash
Save to your folder(s)

Expand | Embed | Plain Text

Copy this code and paste it in your HTML 
  1. # bash4 - Use Associative Arrays to find duplicate files.
  2. # Generate a file "rmdups" which contains rm commands to remove the duplicates.
  3. # Check this file and then source it from the current (!) directory
  4. # to actually remove the duplicates. Works equally with the (deprecated)
  5. # md5sum program instead of sha*sum.
  6. unset flist; declare -A flist
  7. while read -r sum fname; do
  8.     if [[ ${flist[$sum]} ]]; then
  9.         printf 'rm -- "%s" # Same as >%s<\n' "$fname" "${flist[$sum]}" 
  10.     else
  11.         flist[$sum]="$fname"
  12.     fi
  13. done <  <(find . -type f -exec sha256sum {} +)  >rmdups

Report this snippet


Comments

RSS Icon Subscribe to comments

You need to login to post a comment.