I am looking for an application (better kde one) that can search two external hard disks I have and find any duplicate files. I did some backups before to one disk which i copied few years ago to the other disk. Right now I would like some program to check files and tell me if there are the same.
View 9 RepliesWe have a huge amount of duplicate files in a folder and I would like some pointers on to writing a bash script to create a list of the duplicate files. I've seen examples that check for the md5 sum of files... but I dont need that, the file name is enough.
View 4 Replies View RelatedI have found some duplicate files in my folders. Is there a way to clean them out?
View 2 Replies View RelatedI have a 1TB drive that has MANY duplicate files all over it. a good linux tool that can find duplicate files on such a large drive (almost full) drive?
View 1 Replies View RelatedI would like to check two folders for duplicate files (two pretty old backup instances).
MY folders are quite alike so I would like to stop the NON-duplicated files for that I want to be able to do some checks not only for the filename but alsofor the filesize (might be the case that two files have same name but not size).
The ideal would be to suggest me such a program with gui but if not I will try run any script code that is available outhere.
What kind of method to find the duplicates files on linux,
1.how to find just using the file name, sometimes i figure out people often to copy their files to another directory and i want to find out if there any same file name in the linux box.
2. what about if i want to find the duplicate files based on contents of the file, example is in picture file if users store picture files from digital camera first they just save the file name in default but when they want to give that picture to others they will rename it, i've been used method md5 for this situation in python script but it takes long time
I'm asking this question just to know to use bash script a lot in work and i want to test out fdupes at home, is fdupes use similar md5 scan to find duplicate files?
I am looking for a bash script which is compatible with Mac, to find duplicate files in a directory.
View 2 Replies View RelatedI have a directory containing a ton of photos, some of which are duplicates but just with different names. Is there any way in linux to find all the duplicates and remove all of them except the most recent version? I know on Windows there are utilities that will do this through a GUI, but I'm using Linux through the CLI only.
View 6 Replies View RelatedI am running Debian 3.2.0-0.bpo.2-amd64 on hyper-v, my / volume ran out of space and is sitting at 100%, I have extended the disk size on hyper-v, however when I go to Fdisk I see duplicates of each disk.
I have total of 2 vhds on the vm, so I see 4 disks under fdisk. Here is the output of fdisk
root@apachevm:~# fdisk -l
Disk /dev/sda: 107.4 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x0009bfe8
[CODE]....
I would like to find all the files that contains the strings I'm searching.
For example (it's just an example), I would like to search all the files in "/etc" that contains "eth0" and "us", whatever where are located those 2 strings, the important is that the 2 strings are in the files listed.
It would be something like a "grep -lr 'eth0' *" and "grep -lr 'us' *" but in one time/command, so that I don't have to make a comparison of the 2 list of files resulting from the 2 "grep" commands given higher.
Find and replace in multiple files in ssh?
View 1 Replies View Relatedcommand line, I have a server for work that I ssh into and I need to be able to find multiple files (they have the leading text just the date identifier changes) and then zip the files (with bzip) them and then finally scp(Secure copy) them to another server.
These files are always in the same directory and this is a daily task and just want to make into a script that I run once I am logged into the remote server.
After hours (literally) of searching the web and reading man pages, I think I've come up with the following:Code:find . -exec grep 'path/to/file' -print | xargs -0 -I new_path mv {this is where I get confused}So my code above is incomplete, obviously. In order to finish replacing the string, I need to mv the new file into the old file's spot. How do I do this, by incorporating it into my line of code?
View 14 Replies View RelatedI'm pretty sure this is doable from the command line, but my CLI skills have degraded a lot since my pre-Y2K admin days. The goal is to search all the files in the directory for a very long string of text and replace it with another string of text. The text being searched for is my Google Adsense code (which will be stripped from my website) and it will be replaced with a placeholder so I can easily tack something else in there in the future.
Seeing how I have that long snip of code on about 100 pages, automating the process would make life easier.
If I was searching for a single word, I can see ways to do this.
If I paste the code I'm searching for into a text file, is there a way to:
find (contents of oldstring.txt) and replace with (contents of newstring.txt)?
My server is really slow. When I did a top -c or ps aux, below shows up. Shouldn't there be only one? Shall I kill all those processes and leave only one?
3135 nobody 15 0 15900 5232 1860 S 0.0 0.1 0:00.17 /usr/local/apache/bin/httpd -k restart -DSSL
3173 nobody 16 0 15900 5244 1848 S 0.0 0.1 0:00.05 /usr/local/apache/bin/httpd -k restart -DSSL
3174 nobody 15 0 15900 5232 1860 S 0.0 0.1 0:00.15 /usr/local/apache/bin/httpd -k restart -DSSL
5153 nobody 15 0 15900 5228 1860 S 0.0 0.1 0:00.04 /usr/local/apache/bin/httpd -k restart -DSSL
7598 nobody 16 0 15900 5228 1872 S 0.0 0.1 0:00.20 /usr/local/apache/bin/httpd -k restart -DSSL .....
I want to remove duplicate or multiple similar lines from multiple files. I.e. if I have four files file1.txt file2.txt file3.txt and file4.txt and would like to find and remove similar lines from all these files keeping only one line from these similar lines. I only that uniq can be used to remove similar lines from a sorted file.
View 9 Replies View RelatedI want to take a graphics file and make 10 copies of it to the same directory, each with 001, 002, or some such designation at the end of each file name so they have discrete files names. Is this possible using cp?
View 12 Replies View RelatedI am looking for a Linux app that can find and remove duplicate images (with different filenames if that's at all possible).
View 5 Replies View RelatedI have a folder that over 70,000 images (within it is a complex hierarchy of subfolders). Of these 70,000 images I assume that I only have ~10,000 unique images; the rest are copies that have been resized. I would like to somehow delete all of the resized copies of the larger originals and remove them, keeping only the original image.
Is there a way to use imagemagick (or any other application) to scan this folder recursively and determine which files may be (resized) copies?
I have given up (for now, at least) the idea of a raid solution but I will still have 2-3 hard disks available for my workstation. If I choose to reinstall from scratch,can I have essentially two different homes?
View 5 Replies View RelatedThis question has been bugging me for a few days now: How do you mount, say, 3 HDDs to a single partition. From what I've heard, it's possible, but I'd like to know how. I'm running Crunchbang! Linux, based on Ubuntu, in case you're wondering.
View 11 Replies View RelatedI've downloaded 7 ISO images in order to install CentOS as a Virtual Machine on Fusion. First disk goes through successfully, but when I try to "insert" 2nd disk, I get an error message "unable to access the cdrom". I've ejected 1st disk, mounted second. I tried all possible scenarios I could think of, but still getting an error message.
I see the disk mounted in a terminal:
/dev/disk1 600600 600600 0 100% /Volumes/CentOS_5.5_Final
I would like to find a command which automatically finds and removes phrases which appear more than once in a text file. I still want to keep one of these phrases, but I only want to see one of them.
View 9 Replies View RelatedI recently tried installing Lucid x86 on my system beside Windows 7 and managed to screw it up.
My disk setup is this;
Disk A = 3 partitions (1st partition=Windows 2&3 partitions=Data)
Disk B = 1 partition
Disk C = 3 partitions (1st partition=Data 2&3 partitions=Ubuntu & Swap)
Disk A = SATA and internal
Disk B = SATA to USB external
Disk C = SATA to USB external
I want to install Lucid on the 2nd partition on Disk C. And dual boot it with Windows on Disk A.
During Lucid setup i specified the partition for installation (C2) and asked for GRUB to install on Disk A (no partition specified) so GRUB is always used as the dual-boot manager even if the Lucid disk (Disk C) is ejected. Once installed and rebooted i was taken to the GRUB rescue prompt as no installation drive could be found (a long string of numbers (looked like a Disk ID number???) was also shown). Obvviiusly, i could not access either OS on my system at this point. I had my W7 DVD handy so it was just a case of recovering the windows boot manager and i could use my PC but how do i go about installing Lucid with this setup? Should i specify a partition for GRUB to install to? I have a hunch this is where i am going wrong but am too scared to try again and potentially balls things up.
First and foremost, I really appreciate this newer release of Ubuntu 10.10. My boss wanted to use SLAX, but I had great experience with 8.10 and I have installed 10.10 on laptops and netbooks. on with the challenge for the day: I have configured a user's profile on 10.10 to startup Firefox in kiosk to go to our secure portal. The problem is I don't particularly care to REDO configure a user's profile session over and over.
So, if any of you whiz kids out there can come up with a better way to copy a user's profile...particularly the files that are used for Mozilla Firefox so that I can just copy and paste the files onto another hard drive with a fresh 10.10 that would be great.
The ONLY issue I have working with Linux is that I can not rapidly deploy my settings I have set for 'user' as I can with Windows. I am sure if there was a way to do this, deployment of Ubuntu 10.10 would go MUCH faster. As it stands, if I am able to pull this off...there will be a potential of removing Windows desktops. Which is fine for me because I can manage desktops a little easier on this platform than Windows.
This is what I have installed in Ubuntu:
IcedTea (for Java plugin for Firefox)
Profile Editor
R-Kiosk
All those work great with Firefox, but getting those installed on a new system is a bit daunting.especially when some users suggest doing cloning when in reality...I plan to do the install via LiveCD and THEN hopefully create the user on the fly in Terminal and copy the user files needed off a flash drive into the home/user folder
I have some big files of logs that contain errors printed by an app. They are most of the time relevant, however most of them are similar. So i figured i could check what happened between a time interval with a find.
Im using this one
Code:
And I get an output similar to this one.
Code:
Is there a way to condensate the output lines to get only one or two, indicating the start and last occurrence of a block? Or I need to create a program to do so?
Because right now I get thousands of similar lines, but when I'm scrolling through them i sometimes miss relevant information that i would've otherwise noted if it wasn't all that spammy.
Alright, I have this issue on both SystemRescueCD and Debian Squeeze. I have an ASUS P5Q Turbo board that supports hardware RAID. If I configure an array and then start the Linux installer or boot the rescue CD, I get /dev/sda and /dev/sdb instead of an array. What gives? I need to start installing within the hour so I am desperate for an answer!
View 1 Replies View RelatedI have a PC with 4 harddisks and one ssd drive, presently PC boots from the 1st harddisk and other harddisks (sometimes 1, 2 or 3, depends upon the requirement) are used for the storage. Now i want to boot the PC from SSD and use the other harddisks for the storage only. My problem is that when system boots it takes 1st harddisk as sda and SSD as sdb, if i am using only one harddisk, and if i use 2 harddisk it takes sdc as SSD. So i am not able to give fix boot point in menu.lst file, if i wish to use root filesystem from SSD.I am using 2.6.33.7 kernel and grub bootloader. I have tried using initrd with udev but not able to include and start udev properly in initrd. I am trying to boot from UUID or LABEL, but no success. Am i missing something in kernel to get the UUID or LABEL.
View 6 Replies View RelatedIs there a way to find the wwn id of disks mounted on a centos server. I am using san disks via iscsi connection.
View 2 Replies View RelatedBy fiat I must distribute my homedirs across multiple physical disks/partitions. Unfortunately this is not open to discussion so obvious solutions like a lvm home partition are not available to me. The issue: Users created with homedirs on the main home partition (the one created as home during the f13 install) behave as expected, but if I create them on a different partition (home9 for the sake of this example) the users are not able to login (dropped back to login screen), nor run x-apps if su -'d to in a konsole.
If I 'su - <user-on-home9>' in a konsole, I get delivered to the /home9/<user-on-home9> as expected, but x-apps fail with the error: 'cannot open display: :0'. This can be temporarily fixed with the command 'xhost +SI:localhost:<user-on-home9>', but I would rather fix it permanently at the source.
This appears to be an selinux problem from the following.The contexts of the the two rootdirs are the same
% ls -Zd /home /home9
drwxr-xr-x. root root system_u:object_r:home_root_t:s0 /home
drwxr-xr-x. root root system_u:object_r:home_root_t:s0 /home9
but when I create the users (using useradd or the gui) their respective contexts differ:
% ls -Zd /home/user5 /home9/user6
[Code]...
So, my questions for you selinux experts are 1) is it possible to have homedirs spread across multiple partitions with selinux, and if so, how, 2) Why, even when I manually set the dir/file contexts to match a properly functioning user5 from /home, do users from /home9 still not work (as far as login and x-apps).