I have a directory containing a ton of photos, some of which are duplicates but just with different names. Is there any way in linux to find all the duplicates and remove all of them except the most recent version? I know on Windows there are utilities that will do this through a GUI, but I'm using Linux through the CLI only.
View 6 RepliesI'm using a mac, and just transferred a bunch o photos from another computer, and as it turns out, there is a bunch of duplicates.I'm not too familiar with the mac terminal, but if there is a solution for linux, it will probably work for the mac.Just need to be able to recursively scan all folders in my Pictures folder and then Delete them.
View 1 Replies View RelatedWe have a huge amount of duplicate files in a folder and I would like some pointers on to writing a bash script to create a list of the duplicate files. I've seen examples that check for the md5 sum of files... but I dont need that, the file name is enough.
View 4 Replies View RelatedWhat kind of method to find the duplicates files on linux,
1.how to find just using the file name, sometimes i figure out people often to copy their files to another directory and i want to find out if there any same file name in the linux box.
2. what about if i want to find the duplicate files based on contents of the file, example is in picture file if users store picture files from digital camera first they just save the file name in default but when they want to give that picture to others they will rename it, i've been used method md5 for this situation in python script but it takes long time
I'm asking this question just to know to use bash script a lot in work and i want to test out fdupes at home, is fdupes use similar md5 scan to find duplicate files?
I am looking for a bash script which is compatible with Mac, to find duplicate files in a directory.
View 2 Replies View RelatedIs there a way to remove duplicate files from a specific folder through SSH? I've uploaded a lot of flash games on my server and I can see in the Webmin's file manager that I have many duplicates. Their names are different, of course.
View 2 Replies View RelatedI am using my Ubuntu machine to serve as a media server and network storage. The problem I have is iTunes on my desktop managed to make 2 copies of every song on the machine so instead of the 30GB I have its up to almost 100gb. I was wondering if there was a way to write a script to go through and delete the duplicates. The duplicates are the same filename as the original except a 1 or 2 following. Wasn't looking forward to deleting 12,000 files by hand.
View 1 Replies View RelatedI have found some duplicate files in my folders. Is there a way to clean them out?
View 2 Replies View RelatedI have a 1TB drive that has MANY duplicate files all over it. a good linux tool that can find duplicate files on such a large drive (almost full) drive?
View 1 Replies View RelatedI would like to check two folders for duplicate files (two pretty old backup instances).
MY folders are quite alike so I would like to stop the NON-duplicated files for that I want to be able to do some checks not only for the filename but alsofor the filesize (might be the case that two files have same name but not size).
The ideal would be to suggest me such a program with gui but if not I will try run any script code that is available outhere.
I am looking for an application (better kde one) that can search two external hard disks I have and find any duplicate files. I did some backups before to one disk which i copied few years ago to the other disk. Right now I would like some program to check files and tell me if there are the same.
View 9 Replies View RelatedI have a file "test.txt" with following data
#1
aaa
#2
bbb
#3
aaa
#4
ddd
I wanted it to be displayed as
#1
aaa
#2
bbb
#4
ddd
I used awk "'!x[$0]++' test.txt > file.new"
,but it deleted #1 also.I tried using uniq command but i didn't work.
Can anyone Please let me know is there any way to do this using shell script.
Unable to delete dupliucate DNS records using bcupdate tool
View 1 Replies View Related1. I'm trying out ratpoison (a windows manager). It's cool, but a few commands weren't working - I now think that it's because Debian delivered ratpoison 1.4.3 (Feb 2008), while development has issued two more releases (the latest being 1.4.5). Should I (or should I not) install the later release?
2. IF I do, I need to figure out how to convert the tar.gz to a debian package
I am looking for a Linux app that can find and remove duplicate images (with different filenames if that's at all possible).
View 5 Replies View RelatedI want to use the shell to find .zip files in my music directory and all sub directories and then delete only these files. The following will find the files I want to delete
Code:find /home/me/Music/ -name *.zip -lsWhat is the next step to delete *only* these files.Would it be a good idea to move them to another directory before doing the final rm - how would I do this
I would like to find a command which automatically finds and removes phrases which appear more than once in a text file. I still want to keep one of these phrases, but I only want to see one of them.
View 9 Replies View RelatedI want find a bunch of log files and delete ones that are older than say 5 days. Ideally I would then like to add this my crontab to run once a day.
The log files are in /var/log and are owned by root. They have a standard naming convention which is [date]RootCronRsync-backupHOME.log An example file is 20100621RootCronRsync-backupHOME.log Trying to put together a bash script to do this I think I need something like
Code: find /var/log/ -name *RootCronRsync-backupHOME.log -mtime +5 -exec rm {} ; However if I try this without the -exec rm (ie to see if I can find the right files first) I get the following error find: paths must precede expression: 20090405RootCronRsync-backupHOME.log Usage: find [-H] [-L] [-P] [-Olevel] [-D help|tree|search|stat|rates|opt|exec] [path...] [expression]
I have some big files of logs that contain errors printed by an app. They are most of the time relevant, however most of them are similar. So i figured i could check what happened between a time interval with a find.
Im using this one
Code:
And I get an output similar to this one.
Code:
Is there a way to condensate the output lines to get only one or two, indicating the start and last occurrence of a block? Or I need to create a program to do so?
Because right now I get thousands of similar lines, but when I'm scrolling through them i sometimes miss relevant information that i would've otherwise noted if it wasn't all that spammy.
I have a series of file names in a text file that I generated by running
Code:
bash-4.1# ls -alt *.txz | awk '{print $8}'
and then copy pasting the output. All of these file names have the version number
Quote:
-4.4.1-x86_64-1alien.txz
I just want a method to remove that version number from all the filenames so that I can then add all the packages without version numbers to a blacklist file.
I've tried kwrite and mousepad and both have a search feature and a replace feature but I haven't been able to just have the text removed successfully.
How do you delete duplicate posts? Clicking on the edit button doesn't allow one to delete, just edit.
View 1 Replies View RelatedI couldn't find my previous posting about udev at booting, so I created a new posting with the same material. Subsequently my earlier post showed up again----or I managed to find it. I can't seem to find any information about how I go about deleting the earlier post. Supposedly we are supposed to be able to notify the managers of abusive posts. I thought I might use that to ask them to delete the earlier post, so I will try that..
View 6 Replies View RelatedWhat i am trying is to check the file duplication in a folder and remove a file if it is a duplicate of another file ie the contents are duplicate; but names may be same.
Basically i am using md5sum to calculate the md5sum values of each file and redirecting to a file. And i am thinking of comparing the md5sum values.But i am finding it hard to decide how to complete the code after redirecting the output of calculation of md5sum to a file.
I have two folders - Folder abc and Folder xyz which contains 1000's of files with few of them having the same file names. How can I remove the duplicates from Folder abc?
View 14 Replies View RelatedIs there any way to delete duplicate photos from a folder? Not the names are duplicated , but de photos inside.
View 1 Replies View RelatedIs there a GUI method to copy files or is this always done with the Bash terminal.
View 6 Replies View RelatedI copied a back up of my windows 'my documents' fold and all of its' sub folders into my linux (Mint Debian) Documents directory. I found that many of my files can be found in more that one directory so, what I want to do is to find all the dups and deal with them. Is there a good linux application to resolve this 'duplicates' problem. (I don't want to touch the linux system files.)
View 2 Replies View RelatedI am quite new to linux. I would like to install more recent version of a certain software, but before that, I have to remove the old version. This software is not obtained through repositories (well, you know, you download the package, ./configure, ./make etc.), so I'm not sure how to remove it.
View 3 Replies View RelatedI have been trying for the last couple of days to upgrade a Xen guest running on Xen Server 5.5 from 11.0 to a more recent version. I have tried both 11.3 and 11.1. The upgrade seems to take, but it fails on the initial boot. It seems that it is expecting the root partition to be on /dev/sda2 - however I believe it is supposed to be /dev/xvda2. Initially when fstab had /dev/xvda2 I had a warning, so I changed fstab through yast to use the drives uuid. I've also tried zypper dup - but that gave all sorts of dependency errors. For kicks, I thought I might try 11.4 next. Am I out of luck and should just go with a fresh install?
View 1 Replies View RelatedI'd read there was some work being done on cairo-dock this weekend (and noticed it absent from the Package Manager) and upon installing earlier today, I didn't find any of the previously available dock themes.
Were they removed for some reason or am I doing something wrong?
(Oh, and I'm looking within the 'Manage Themes' submenu within cairo-dock for reference.)