Welcome guest. Before posting on our computer help forum, you must register. Click here it's easy and free.

Author Topic: Cataloging/Removing Duplicate Photos  (Read 3703 times)

0 Members and 1 Guest are viewing this topic.

rjbinney

    Topic Starter


    Adviser
  • Disarmingly Good-looking
  • Experience: Familiar
  • OS: Windows 11
Cataloging/Removing Duplicate Photos
« on: December 07, 2016, 08:24:30 PM »
I need to clean up my hard drive - I have made copies of folders filled with pictures, as well as folders with compressed and cropped versions.

I'd like to build an archive of just the original, raw pics.

I know I can grunt through and compare folders, etc., by hand, but I'm lazy. I'd rather spend four hours researching an easy solution than three hours of work.

That said, I ran across this article:
http://www.howtogeek.com/200962/how-to-find-and-remove-duplicate-files-on-windows/

The "VisiPics" option looks interesting.

Has anyone ever used any software to do something like this? What tips or tricks might anyone have?
Dan: You're gonna need to get someone to fix my computer.                     Kim: What's wrong with it?                     Dan: It's in several pieces on my floor.

DaveLembke



    Sage
  • Thanked: 662
  • Certifications: List
  • Computer: Specs
  • Experience: Expert
  • OS: Windows 10
Re: Cataloging/Removing Duplicate Photos
« Reply #1 on: December 08, 2016, 08:22:16 AM »
Before using a tool that will clean up to remove duplicates, I would perform a backup of your data, just in case you have files named the same in different folders and same file size which are different photos. Its rare that a file will be different and be such a close match, but its safest to back up the data prior to putting the decision making into an automated program that does the cleanup.

I just run a batch script to run across my computer and grab all JPG images and store them to an external device such as USB stick at the E: drive. I run the following instructions which targets the C: drive and grabs a copy of only JPG files, and retains their directory structure so that if there are images of same file name, but images are different, images are then not lost to which file is newest or written last of the same file name.

Code: [Select]
c:
cd\.
xcopy *.jpg E:\*.* /s/d/y/h
@echo.
@echo. JPG Image Grab from C to E drive Complete
@echo.
@echo.
pause

Here is a list of what each switch does:

Quote
/S           Copies directories and subdirectories except empty ones.

 /D:m-d-y     Copies files changed on or after the specified date.
               If no date is given, copies only those files whose
               source time is newer than the destination time.

  /Y           Suppresses prompting to confirm you want to overwrite an
               existing destination file.

  /H           Copies hidden and system files also.

My problem with my photos is that my camera takes pictures such as Photo001, Photo002, Photo003 and so on. And each time the camera is erased of images and new pictures are taken, it starts back at Photo001 and names the pictures the same as others even though the pictures are completely different. So I went with this method of getting all pictures to a USB stick, I can then go through and collapse the folders to get all images into one folder, but I have to manually confirm that I wont be stomping a Photo001 that is in say E:\Data\Photo001.jpg with E:\Documents and Settings\Dave\Pictures\Photo001.jpg

I havent used any of the tools at that link yet.




rjbinney

    Topic Starter


    Adviser
  • Disarmingly Good-looking
  • Experience: Familiar
  • OS: Windows 11
Re: Cataloging/Removing Duplicate Photos
« Reply #2 on: December 08, 2016, 09:52:48 AM »
Thanks, Dave.

For a backup, I used SmartCopy to do basically what your xcopy script did. I will save that, though, because I've needed to run backups like that for work docs, etc.

I then made a ZIP copy of that backup - just to be safe!

I created a worksheet and I'm just going to catalog - subdirectory, number of files, starting file (akin to your Photo001 problem), and size of subdirectory. I'm hopeful I have entire subdirectories that are dupes, and I don't have too many intermingled.

I noticed ccleaner has a duplicate file finder, but it only works off name and size. Some of the ones in that link claim to be able to "read" the photo and determine dupes based off image. I suspect both would be a good scrub.

I'll take any other advice!

Dan: You're gonna need to get someone to fix my computer.                     Kim: What's wrong with it?                     Dan: It's in several pieces on my floor.

patio

  • Moderator


  • Genius
  • Maud' Dib
  • Thanked: 1769
    • Yes
  • Experience: Beginner
  • OS: Windows 7
Re: Cataloging/Removing Duplicate Photos
« Reply #3 on: December 08, 2016, 10:09:25 AM »
Just a word of advice...makin a zip is a good idea...i've seen dupe file finder apps completely bork a Win install waay too many times.
" Anyone who goes to a psychiatrist should have his head examined. "

rjbinney

    Topic Starter


    Adviser
  • Disarmingly Good-looking
  • Experience: Familiar
  • OS: Windows 11
Re: Cataloging/Removing Duplicate Photos
« Reply #4 on: December 08, 2016, 12:36:28 PM »
Yeah, I figure even though it doesn't save much space - it's a "Safe Space" from any utilities.
Dan: You're gonna need to get someone to fix my computer.                     Kim: What's wrong with it?                     Dan: It's in several pieces on my floor.

Salmon Trout

  • Guest
Re: Cataloging/Removing Duplicate Photos
« Reply #5 on: December 08, 2016, 01:01:51 PM »
Duplicate finders that compute an md5 hash will find duplicate images. The hashes will match only if the files are identical on the binary level. There is a free "Duplicate Files Finder" on Sourceforge

https://sourceforge.net/projects/doubles/?source=directory
« Last Edit: December 08, 2016, 01:40:07 PM by Salmon Trout »

Geek-9pm


    Mastermind
  • Geek After Dark
  • Thanked: 1026
    • Gekk9pm bnlog
  • Certifications: List
  • Computer: Specs
  • Experience: Expert
  • OS: Windows 10
Re: Cataloging/Removing Duplicate Photos
« Reply #6 on: December 08, 2016, 01:34:46 PM »
Instead of doing a hash, there is an old utility in DOS that compares two files.
File Compare or FC as we will refer to is from here on out, is a simple program that will compare the contents of text or binary files and is capable of comparing both ASCII and Unicode text. You can use this tool to display any lines from two files or two sets of files that do not match up with the others.
- from Google search.

rjbinney

    Topic Starter


    Adviser
  • Disarmingly Good-looking
  • Experience: Familiar
  • OS: Windows 11
Re: Cataloging/Removing Duplicate Photos
« Reply #7 on: December 09, 2016, 02:56:13 PM »
Duplicate finders that compute an md5 hash will find duplicate images. The hashes will match only if the files are identical on the binary level. There is a free "Duplicate Files Finder" on Sourceforge
This sez it does NOT computer a hash... Running it now, we'll see.

I've squirreled away partial archives here and there, I want to make sure I build One Archive to Rule Them All.
Dan: You're gonna need to get someone to fix my computer.                     Kim: What's wrong with it?                     Dan: It's in several pieces on my floor.

Salmon Trout

  • Guest
Re: Cataloging/Removing Duplicate Photos
« Reply #8 on: April 21, 2017, 05:04:22 PM »
try this program Duplicate Files Deleter
Steer clear! Not even a proper link.

patio

  • Moderator


  • Genius
  • Maud' Dib
  • Thanked: 1769
    • Yes
  • Experience: Beginner
  • OS: Windows 7
Re: Cataloging/Removing Duplicate Photos
« Reply #9 on: April 21, 2017, 07:54:32 PM »
Post removed...thanx for the heads up Salmon...
" Anyone who goes to a psychiatrist should have his head examined. "