It is currently Thu Jul 25, 2024 3:15 pm


All times are UTC - 5 hours [ DST ]



Post new topic Reply to topic  [ 8 posts ] 
Author Message
 Post subject: Search and delete image clones
PostPosted: Mon Dec 03, 2012 5:50 pm  (#1) 
Offline
GimpChat Member

Joined: Apr 12, 2010
Posts: 5870
I need
1 to check 2 folders full of images for clones, intending here for clones identical images present in the in the same folder but with different name
2 done that i need to confront the 2 folders, to eliminate from the folder 2 or clone of images already in 1
2 to eliminate from folder 2 all images already present in folder 1
(

The problem here is that files names are not relevant (in both folders files names are just randomly assigned progressive numbers with no relation with the content )



so only way to detect the clones is confront the images
are 1300 in the first folder and about 1800 in the other folder, more or less 50% of folder 2 is composed by clones already in 1 to be deleted

well how to do it ?

Clones must have same image same also for image size,
in case have different extension (possible are jpg and png) to be eliminated should be the jpg

_________________
My 3D Gallery on Deviantart http://photocomix2.deviantart.com/
Main gallery http://www.flickriver.com/photos/photocomix-mandala/
Mandala and simmetry http://www.flickriver.com/photos/photocomix_mandala/

Image

Mrs Wilbress


Share on Facebook Share on Twitter Share on Orkut Share on Digg Share on MySpace Share on Delicious Share on Technorati
Top
 Post subject: Re: Search and delete image clones
PostPosted: Mon Dec 03, 2012 6:21 pm  (#2) 
Offline
GimpChat Member

Joined: Dec 20, 2010
Posts: 174
Location: Wherever the voices in my head tell me I am.
PhotoComix:

I think I remember that you are able to use a GNU/Linux OS. My first thought was that as long as the images you want to delete are clones with no difference in processing, then a nice little script comparing md5sum values should be able to find clones and then allow you to delete them. I did a search and found this site with two command-line scripts that you can run in a terminal window:

http://ajayfromiiit.wordpress.com/2009/10/16/one-liner-to-find-and-remove-duplicate-files-in-linux/

What you will have to do is place one folder inside the other folder since the script gets run on the folder of your choice and all folders inside that folder to make the comparison. I tested the scripts on a small set of images where I made a copy of the original. It found the duplicates.

The second script on there allows you to search for the duplicates and will then ask your permission to delete all of the files before doing so.

I only use GNU/Linux so I do not know what may be available for users of Windows.


Top
 Post subject: Re: Search and delete image clones
PostPosted: Mon Dec 03, 2012 6:34 pm  (#3) 
Offline
GimpChat Member

Joined: Apr 12, 2010
Posts: 5870
No problem to use Linux i just updated kubuntu

The md5sum seems a good idea, but i am not sure would be sufficent:

many different images there may have the same size because all variants of the same original
(but as example mirrored along different axes )

I don't want delete the variants on the contrary i need them , i only need to eliminate the perfect clones (same luminosity, same colors , same shapes,same image size...again file names in this cases are not relevant )

_________________
My 3D Gallery on Deviantart http://photocomix2.deviantart.com/
Main gallery http://www.flickriver.com/photos/photocomix-mandala/
Mandala and simmetry http://www.flickriver.com/photos/photocomix_mandala/

Image

Mrs Wilbress


Top
 Post subject: Re: Search and delete image clones
PostPosted: Mon Dec 03, 2012 7:22 pm  (#4) 
Offline
GimpChat Member

Joined: Dec 20, 2010
Posts: 174
Location: Wherever the voices in my head tell me I am.
Another program that I found is called fdupes. I installed it in Debian and it also can find and delete duplicate image files. I tested it here and it found duplicate image files. Easier to use than the script I found above.


Top
 Post subject: Re: Search and delete image clones
PostPosted: Mon Dec 03, 2012 7:49 pm  (#5) 
Offline
GimpChat Member

Joined: Apr 12, 2010
Posts: 5870
oh this seems perfect going to try now

_________________
My 3D Gallery on Deviantart http://photocomix2.deviantart.com/
Main gallery http://www.flickriver.com/photos/photocomix-mandala/
Mandala and simmetry http://www.flickriver.com/photos/photocomix_mandala/

Image

Mrs Wilbress


Top
 Post subject: Re: Search and delete image clones
PostPosted: Tue Dec 04, 2012 5:47 am  (#6) 
Offline
Script Coder
User avatar

Joined: Nov 06, 2012
Posts: 239
Location: Italy
PhotoComix, if you have the possibility of using Windows or running Wine from within Kubuntu, I suggest you installing VisiPics, a free application that permits to detect not only the real duplicates, but also to find the similiarity between images, as it can occur with pics differing only for level of compression or size.

http://www.visipics.info/index.php?title=Main_Page

The check is performed by comparing the contents of the images, hence regardless of their possibly different names and/or extensions.

_________________
Gino D's GIMP scripts: https://sites.google.com/site/ginodonig/gimp-scripts


Top
 Post subject: Re: Search and delete image clones
PostPosted: Tue Dec 04, 2012 6:11 pm  (#7) 
Offline
Global Moderator
User avatar

Joined: Nov 16, 2011
Posts: 5128
Location: Metro Vancouver, BC
For Windows have a look at Anti-Twin. It will do pixel matching.
http://www.joerg-rosenthal.com/en/antitwin/

_________________
Image
Gimp 2.8.18, Linux, median user
Gimp Chat Tutorials Index
Spirit Bear (Kermode)


Top
 Post subject: Re: Search and delete image clones
PostPosted: Wed Dec 05, 2012 5:04 pm  (#8) 
Offline
GimpChat Member

Joined: Apr 12, 2010
Posts: 5870
Antitwin and vispics were both good solution i believe i get rid out of all clones

_________________
My 3D Gallery on Deviantart http://photocomix2.deviantart.com/
Main gallery http://www.flickriver.com/photos/photocomix-mandala/
Mandala and simmetry http://www.flickriver.com/photos/photocomix_mandala/

Image

Mrs Wilbress


Top
Post new topic Reply to topic  [ 8 posts ] 

All times are UTC - 5 hours [ DST ]


   Similar Topics   Replies 
No new posts Internet image search

9

No new posts How to delete account

2

No new posts Attachment(s) HELP - SEARCH AND RUN A COMMAND

6

No new posts IN SEARCH OF TUTORIAL

2



* Login  



Powered by phpBB3 © phpBB Group