Ubuntu :: Delete Duplicate Files Command Line?

Apr 14, 2010

Is there a way to remove duplicate files from a specific folder through SSH? I've uploaded a lot of flash games on my server and I can see in the Webmin's file manager that I have many duplicates. Their names are different, of course.

View 2 Replies


ADVERTISEMENT

Programming :: Perl - Delete Line From Text File With Duplicate Match At Beginning Of Line

Apr 1, 2009

Was wondering if any perl guru's could help me with a quick log file adjustment. I have a text file that looks like so (tabs and newlines are revealed so you can see what separates the data):

There are maybe 100 lines of text in this file at any given time. I need to delete all duplicate lines only looking at the first bit of text prior to the first tab. It doesn't matter which one gets deleted as long as there are no two lines that begin with that same text at the beginning before the first tab. So in this example, either the fist line "1234" or the last line "1234" would need to be deleted. I already have code in my script that opens the files - I just need the code to read the text into an array and the part that would find matches based on the above criteria, and make the deletions.

If it would be easier, I can even do a system call and use SED (v4.1.5) and/or AWK (3.1.5) instead.

View 7 Replies View Related

General :: Delete Files On The Command Line With Regular Expressions?

May 6, 2010

Lets say I have 20 files named FOOXX, where XX is the number of the file, eg 01, 02 etc. At the moment, if I want to delete all files lower than the number 10, this is easy and I just use a wildcard, eg rm FOO0* However, if I want to delete specific files ina range, eg 13-15, this becomes more difficult. rm FPP[13-15] does not work, and asks me if I wish to delete all files. Likewse rm FOO1[3-5] wishes to delete all files that begin with FOO1 So, what is the best way to delete ranges of files like this? I have tried with both bash and zsh, and I don't think they differ so much for such a basic task?

View 2 Replies View Related

General :: Delete Duplicate Lines Without Removing First Instance Of That Line?

Feb 7, 2011

I have a file "test.txt" with following data

#1
aaa
#2
bbb
#3
aaa
#4
ddd

I wanted it to be displayed as

#1
aaa
#2
bbb
#4
ddd

I used awk "'!x[$0]++' test.txt > file.new"
,but it deleted #1 also.I tried using uniq command but i didn't work.
Can anyone Please let me know is there any way to do this using shell script.

View 2 Replies View Related

Ubuntu :: Write A Script To Go Through And Delete Bulk Duplicate Files?

Jul 7, 2010

I am using my Ubuntu machine to serve as a media server and network storage. The problem I have is iTunes on my desktop managed to make 2 copies of every song on the machine so instead of the 30GB I have its up to almost 100gb. I was wondering if there was a way to write a script to go through and delete the duplicates. The duplicates are the same filename as the original except a 1 or 2 following. Wasn't looking forward to deleting 12,000 files by hand.

View 1 Replies View Related

General :: How Do I Recursively Delete Duplicate Files Using Terminal

Mar 1, 2011

I'm using a mac, and just transferred a bunch o photos from another computer, and as it turns out, there is a bunch of duplicates.I'm not too familiar with the mac terminal, but if there is a solution for linux, it will probably work for the mac.Just need to be able to recursively scan all folders in my Pictures folder and then Delete them.

View 1 Replies View Related

General :: Find Duplicate Files And Delete All Except Most Recent Version

Aug 17, 2010

I have a directory containing a ton of photos, some of which are duplicates but just with different names. Is there any way in linux to find all the duplicates and remove all of them except the most recent version? I know on Windows there are utilities that will do this through a GUI, but I'm using Linux through the CLI only.

View 6 Replies View Related

General :: Messy Filesystem - Duplicate File Removal From Command Line

Jan 17, 2011

In debian/ubuntu I want to:
a) Create a list of all the files in one directory tree
b) Do the same for a second directory tree
c) Compare the two lists such that, only the file NAMES are compared (i.e. just comparing the "file.txt" part so that "/home/folder/file.txt" == "/home/secondfolder/folder/file.txt)
d) Output a list of all the duplicates
How to do this using scripting languages or regex or something?

View 2 Replies View Related

General :: Making Multiple Duplicate File Copies Using Cp On Command Line?

Jul 21, 2011

I want to take a graphics file and make 10 copies of it to the same directory, each with 001, 002, or some such designation at the end of each file name so they have discrete files names. Is this possible using cp?

View 12 Replies View Related

Fedora :: Command Line To Recurse And Delete Filename-1.jpg?

Oct 26, 2010

I just installed Picasa from google and it has corrupted my picture database. The good thing is that it has done it in an organized manner. It appended -1 -2 -3 and so on to the copies file name. They look like (filename.jpg filename-1.jpg filename-2.jpg) the original having no numerical suffix just (filename.jpg)How do i write a command line to remove all of the undesirables without deleting the origionals?

View 7 Replies View Related

General :: One Line Command To Delete All But The Last N Revisions Of A File

Mar 31, 2011

What's a Unix/Linux one-liner that will let me delete all but the most recent N revisions of each file?

I've got a bunch of files with revision numbers as part of a legacy asset-management system:

bar.r7.js
bar.r8.js
bar.r9.js
bar.r10.js
bar.r11.js

[Code]....

I want to keep the last three of each, so in the above list the command would delete bar.r7.js, bar.r8.js and foo.r1.js.

View 1 Replies View Related

General :: Delete Mail Root In Command Line

Jul 1, 2010

I want to delete all may mail root in command line and i don't find this... the command mail + "d" work fine but i want use it in a .sh

I explain too : I use fetchmail to have mail from a gmail box, and use RIPMIME to save the attachment in a folder... these work fine, but the i want delete these mails.

View 3 Replies View Related

General :: Delete A Line With Certain Format From Files In A Directory?

Sep 21, 2010

I need a PHP script to delete a line with certain pattern from all filesin a directory. The Directory contain files with extensions .js,.html and.php. Do any body give a working code snippet to Read all files in a directory with above extension and delete that line from the files.

View 1 Replies View Related

Ubuntu :: Command Line To Copy Files From One Location To Another / Retain Source Files Group / User?

Feb 20, 2011

Is there a method at the command line to copy files from one location to another and retain the source files group and user?I'm migrating some MySQL files from one machine to another.I want to back-up the original files in the directory presently. They have owner:group of mysql, some have owner:group root:mysql and so on. To copy them under cli or Nautilus everything changes to root for I execute sudo cp or gksudo nautilus and copy via gui.

Since it is MySQL data I could simply do a dump of the database and restore it on the other machine. But there's about 20 db's and I want to do this via a copy for it will be faster - at least that is what I think.

View 5 Replies View Related

Ubuntu :: How To Delete Duplicate Post

Aug 19, 2010

How do you delete duplicate posts? Clicking on the edit button doesn't allow one to delete, just edit.

View 1 Replies View Related

Ubuntu Multimedia :: Delete Duplicate Photos From A Folder?

Apr 22, 2011

Is there any way to delete duplicate photos from a folder? Not the names are duplicated , but de photos inside.

View 1 Replies View Related

Fedora :: Delete A Made Duplicate Post?

Oct 27, 2010

I couldn't find my previous posting about udev at booting, so I created a new posting with the same material. Subsequently my earlier post showed up again----or I managed to find it. I can't seem to find any information about how I go about deleting the earlier post. Supposedly we are supposed to be able to notify the managers of abusive posts. I thought I might use that to ask them to delete the earlier post, so I will try that..

View 6 Replies View Related

General :: Rm Non-interactive Command - Delete A Directory With Its Files

Sep 28, 2010

I wanna delete a directory with its files and I wanna do that as follows: rm -r dirToDelete Unfortunately, I always get asked for EACH single file if I wanna delete this because it is write protected.... Is there a way to suppress this feedback message so that just the whole directory with its contents disappears?

View 5 Replies View Related

Ubuntu :: Command Not Found \ Edit The 2 Files And Delete The Insert Lines?

Mar 10, 2010

i try do modify BASHRC and ENVIRONMENT files on directory ETCthen all the command don't work, such as:SUDO, GEDIT, NAUTILUS, NANO and some others!now i want to edit the 2 files and delete the insert lines

View 9 Replies View Related

Ubuntu :: Delete Files In Trash That Is Older Than 10 Days With A Terminal Command?

Sep 27, 2010

Can I delete files in trash that is older than 10 days with a terminal command?

View 3 Replies View Related

General :: Search Word And Delete Only The Word And The Line Using Sed Command?

Jun 28, 2011

Want to search for ~ and delete it as well as to append the entire line to the above line. For Ex:

1111xxxx date Sandy area is ~around this area.3222xxx date There seems to ~left side of map, the colours are accurate (showing green areas)Even if I ~zoom in, the green parks, xxx3258 date The dammed up
~away, the "other" body of water varies ~blackNatural gas leaching.

IT MUST LOOK LIKE:

1111xxxx date Sandy area is around this area. 3222xxx date There seems to left side of map, the colours are accurate (showing green areas)Even if I zoom in, the green parks, xxx3258 date The dammed up away, the "other" body of water varies blackNatural gas leaching.

View 4 Replies View Related

General :: Unable To Delete Duplicate DNS Records Using Bcupdate Tool

Oct 30, 2010

Unable to delete dupliucate DNS records using bcupdate tool

View 1 Replies View Related

Ubuntu :: Creating PDF Files From A Command Line In 10.04?

Sep 15, 2010

rying to find a way to generate a PDF file from a text file in a command mode (X is not installed). Is there a simple way to do that?I don't need anything fancy - no special formatting and no images to include, just simple text converted to a PDF format

View 3 Replies View Related

Ubuntu :: Command Line Tag Editor For Ogg Files?

Oct 8, 2010

I had a great system going with a bash script to update all of my mp3 files' genre tags. Now that my music collection is ogg, id3v2 doesn't work.

Can anyone recommend a command line tool to edit tags for ogg files please?

View 6 Replies View Related

Ubuntu :: Copy Files Via Command Line?

Dec 14, 2010

I'm looking for a way to copy files with a certain file extension over to another folder. For exampleSource Folder: /home/user/downloadsFile Type: *.epubDestination Folder: /home/user/epubs/The downloads folder has several folders that may go as deep as 2 or 3 levels.I tried this but it didn't seem to work (and I'm not really sure what to do to modify it to get it to work).Quote:find . -maxdepth 1 -type f -exec grep -q "pattern" '{}' ';' -exec cp '{}' /path/to/destination

View 4 Replies View Related

Ubuntu :: Rescuing Files By Command Line Only?

Jan 4, 2011

I have a laptop with Ubuntu 10.04 which appears to be completely wrecked. Even in recovery mode I can't get any GUI. The only access I can get is via command line, which with my limited knowledge of cd and ls commands shows me that the home directory is OK and all the data files present.

How can I get the data files off this machine, eg by copying them to a usb stick, or maybe by copying them to the Windows partition (which still works OK)?

View 9 Replies View Related

Debian :: Getting Files With The Command Line?

Dec 28, 2010

how to download or upload files to a Debian machine using only the command line. I well aware of how to do it in GNOME, but seeing as how this is for a web server, I won't be using GNOME. I have a zip file on my personal machine that contains the website files that need to go on the Debian machine that is to be the web server, but I have no how to get it to that Debian machine without GNOME.

View 14 Replies View Related

Ubuntu Servers :: Execute .php Files From The Command-line?

Jan 26, 2010

Some time ago I installed LAMP in my server, but now I need to execute .php files from the command-line (in order to execute some manteinance scripts for mediawiki). Seems that the PHP files running in the server are run thru some kind of "module" in apache2. Can I tell apache2 to run a .php file in command-line mode using that php module? Or should I install a fresh copy of php-5? Won't that interfere with apache or mangle the system?

View 4 Replies View Related

Ubuntu :: Find Multiple Files In The Command Line?

Mar 2, 2010

command line, I have a server for work that I ssh into and I need to be able to find multiple files (they have the leading text just the date identifier changes) and then zip the files (with bzip) them and then finally scp(Secure copy) them to another server.

These files are always in the same directory and this is a daily task and just want to make into a script that I run once I am logged into the remote server.

View 4 Replies View Related

Ubuntu :: Move Multiple Files Via Command Line?

Sep 15, 2010

I liked the idea of the "cosmos" screensaver/desktop, but wanted to add my own pictures to the application. I navigated to /usr/share/backgrounds/cosmos and tried to drag and drop. I quickly found that I did not have permission to do this.

I googled my problem and found some command line tutorials telling me to sudo cp. My problem is that I have about 30 pics that I want to move in there, and I don't think I can just move the directory, they have to be in that folder as the pictures themselves.

I don't really feel like typing the cp line multiple times with multiple randomly named image files.

Is there a way to have the command line cp all of my files from one directory to another?

View 4 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved