Is there a program for linux which can show me a list of all duplicate music files in a directory? This will allow me to delete all duplicate files without searching for them manually.
View 9 RepliesIs there any free application to search duplicate images based on visual similarity? By visual similarity I mean the same picture ( or almost the same ), but different resolution, aspect ration, quality, etc. The only programs I found yet are for windows and aren't free.
View 1 Replies View RelatedI recently upgraded to Ubuntu 11 and a few days later my ecryptfs filesystem began misbehaving in a weird way. In my home directory, many subdirectory names are duplicated verbatim. Here's an ls -F excerpt:
Desktop/
Desktop/
Documents/
Documents/
Downloads/
Downloads/
I can no longer access files in those directories (if I ls the directory, it appears empty; I can cd to it, but there's nothing inside). Not all of the directories are duplicated/damaged like this, but most are. A few non-directory files are also duplicated in this fashion, so for example:
[Code]...
What I plan to do is, create a duplicate file of a text file, and then append some text into the new text file.
View 1 Replies View RelatedAm I the only one who gets this on gnome everytime I start up package manager or package finder in 11.3?
System management is locked by the application with pid 6890 (/usr/sbin/packagekitd)
I literally have to kill -9 pid everytime I run it. What is going on here?
Anyone know of a good Linux application that will remove duplicate files interactively? I've recently spent a lot of time (read weeks) pruning my music collection, basically by hand. and now I'm moving on to my family photos. Most of the work with the music was done under Windows XP. As for the photos, I have a fantastic Windows application, D'Peg, that I had actually purchased some years ago. This app rocks for Windows. In my opinion it's so good that I would happily pay double the asking price. However, I'd prefer to use Linux if possible, so, what's out there, anything that is worth it's salt? Currently playing around with Picasa.
View 2 Replies View Relatedi waas wondering if anyone knew of a script or program that removes duplicate words in a txt file. im making an install script and the install list has gotten a bit long so i want to ensure there are no duplicates in the file
View 2 Replies View RelatedI have a text file that is filled with references to duplicate files. I'm trying to create a text file for each duplicate file found that contains the paths to the duplicates. I would also like the text file names to be based on the size and file name.
Some thing like:
231.5 KB - P&S.doc.txt
138.5 KB - LIMITED#C71.doc.txt
Code:
NamePathSizeLast ChangeLast AccessFile TypeOwnerAttributes
P&S.doc(3 Files)
P&S.docZ:Leg\_Pri_LegPurP&SBUYBarry V231.5 KB11/2/2001 4:07 PM11/22/2010 2:38 AM.doc (Microsoft Office Word 97 - 2003 Document)Lou_AC
P&S.docZ:Leg\_Pri_LegP&SBUYBarry V231.5 KB11/2/2001 4:07 PM11/22/2010 2:38 AM.doc (Microsoft Office Word 97 - 2003 Document)DMsC
P&S.docZ:Leg\_Pri_LegPropsPurP&SBUYBarry V231.5 KB11/2/2001 4:07 PM11/22/2010 2:38 AM.doc (Microsoft Office Word 97 - 2003 Document)DMsC
LIMITED#C71.doc(2 Files)
LIMITED#C71.docZ:Leg\_Pri_LegPurCV138.5 KB12/15/2003 1:04 PM11/22/2010 2:38 AM.doc (Microsoft Office Word 97 - 2003 Document)Lou_AC
LIMITED#C71.docZ:Leg\_Pri_LegPropsPurCV138.5 KB12/15/2003 1:04 PM11/22/2010 2:38 AM.doc (Microsoft Office Word 97 - 2003 Document)DMsC
ps revised.8.30.05.clean.doc(3 Files)
ps revised.8.30.05.clean.docZ:Leg\_Pri_LegPropsPurP&SSellVPSummit54.5 KB8/31/2005 11:46 AM11/22/2010 2:38 AM.doc (Microsoft Office Word 97 - 2003 Document)DMsC
ps revised.8.30.05.clean.docZ:Leg\_Pri_LegP&SSellVPSummit54.5 KB8/31/2005 11:46 AM11/22/2010 2:38 AM.doc (Microsoft Office Word 97 - 2003 Document)DMsC
ps revised.8.30.05.clean.docZ:Leg\_Pri_LegPurP&SSellVPSummit54.5 KB8/31/2005 11:46 AM11/22/2010 2:38 AM.doc (Microsoft Office Word 97 - 2003 Document)Lou_AC
Copy of 08 Lee All July Billing.xls(2 Files)
Copy of 08 Lee All July Billing.xlsZ:IS\_Sh_ISDevDocDocl 26 upgradeAS6 backup codeAPImport131.5 KB7/30/2010 12:11 PM11/22/2010 2:38 AM.xls (Microsoft Office Excel 97-2003 Worksheet)AdministratorsC
Copy of 08 Lee All July Billing.xlsZ:APKellie131.5 KB7/30/2010 10:03 AM11/22/2010 2:38 AM.xls (Microsoft Office Excel 97-2003 Worksheet)KellieC
Contained within each of these 67 text files is about 1 million urls. Yes. I have 67 text files that contain 1 million lines of urls each. I am sure I am swimming in duplicates. I tried opening one text file and clicking sort ----->remove duplicates. Now Gedit is not responding my processor is maxed out to 100% and I think I am finally ready to delve into some command line code. Can anyone give me idiot proof instructions on how to sort the duplicates out of each one of these 67 text files? How about no duplicates across all 67?
View 7 Replies View RelatedI am basically trying to remove duplicate words in my <title></title> tag after I got hit by Google Panda. I have around 750 .html files and it will be difficult for to me remove one by one. I am looking for a way to remove only from within <title> </title>
Example of a duplicate title I have:
Code:
<title>Pasta, Pasta Recipe and Pasta Guide</title>
I dont want to replace those words anywhere else in the file except for within the <title>
i have a big file of random numbers i generated at some point in time, after working with it with different things(how fun that was)... i want to remove duplicate lines and i'm not sure i'm doing this right
heres the command
Code:
sort random.txt | uniq -u > rand-shorter.txt
the file is pretty big, everything on a new line. i found the command on a web site so i'm sure its correct(bit of a command line in linux newbie)
can anyone confirm if this will remove lines duplicate lines (keeping one copy) and dump what is left in a file named rand-shorter.txt?
EDIT: i think its actually working, just taking a reallllly long time (on an old pen 4 from 2000)
In debian/ubuntu I want to:
a) Create a list of all the files in one directory tree
b) Do the same for a second directory tree
c) Compare the two lists such that, only the file NAMES are compared (i.e. just comparing the "file.txt" part so that "/home/folder/file.txt" == "/home/secondfolder/folder/file.txt)
d) Output a list of all the duplicates
How to do this using scripting languages or regex or something?
Trying to remove lines from a syslog text file that have duplicate strings
Mar 10 06:51:11[http-8080-1] INFO com.MYCOMPANY.webservices.userservice.web.UserServiceController [u:2533274802474744|360] Authorize [platformI$tformIdAndOs=2533274802474744|360, userRegion=America|360]
then a few lines down
Mar 10 06:52:03 [http-8080-1] INFO com.MYCOMPANY.webservices.userservice.web.UserServiceController [u:2533274802474744|360] Authorize [platformI$tformIdAndOs=2533274802474744|360, userRegion=America|360
got the same thing in terms of a u: number but the issue is I need to remove duplicates and just leave one and the file has multiple duplicates of different u: numbers and it's 14,000 lines long. can anyone tell me if I can use awk? sed? or sort for something like this to? removing lines that have a certain string in there that's a duplicate.
I want to take a graphics file and make 10 copies of it to the same directory, each with 001, 002, or some such designation at the end of each file name so they have discrete files names. Is this possible using cp?
View 12 Replies View RelatedMandriva 2010 kde4.3.5 Dolphin 1.3I like to use split screen with file manager. Would like duplicate up and back buttons that always corraspond to each pane of the window so I need not worry about which pane has the focus when I go to use the bauttons.I am hoping to find the functionality anywhere anyhow. I have been using the default Daulphin file manager but don't care if I need to change to a different one.
View 1 Replies View RelatedTried to use Ubuntu 11.4 to assist in recovering a windows xp system. Ran from cd without installing. Failure. Could not find Windows hd. How do I list all storage media. Where is the Mac OS Finder/Windows explorer? Could not find Terminal. Ran search, but seems limited to just your user data. How do I do a search for the terminal applications. Did get some worthless display of all installed programs, but could not launch application. Is there a way of switching the old User Interface from the running from CD version?
View 2 Replies View Relatedthere is this unknown notification popup appear on top left of the screen other than the one on the panel. Anyone have experience on remove the top notification popup? this is my root account that i mainly use everyday, but if i created new account the top navigation not exist.
View 2 Replies View RelatedI am trying to Connect a Hokuyo URG Laser Range Finder to a Jaunty Ubuntu computer through a serial to USB converter. When I plug it into the computer and type 'lsusb' it does not recognize the device.
Before I plug it in:
~~~~~ lsusb
Bus 001 Device 021: ID 0781:5406 SanDisk Corp. Cruzer Micro 1/4GB Flash Drive
Bus 001 Device 004: ID 0bda:0158 Realtek Semiconductor Corp. Mass Stroage Device
Bus 001 Device 003: ID 5986:0203 Acer, Inc
[code]....
I am looking for an application (better kde one) that can search two external hard disks I have and find any duplicate files. I did some backups before to one disk which i copied few years ago to the other disk. Right now I would like some program to check files and tell me if there are the same.
View 9 Replies View RelatedI've created a headless ubuntu mac server and everything is being found by Bonjour and showing up in Finder. The only thing that bugs me is the default horrible text used for remote desktop. How can I remove this item from the sidebar or rename it? I'm using the built in remote desktop utility on Ubuntu desktop 10.10
View 1 Replies View RelatedI have my MacBook 5,2 hooked up to an Ubuntu 10.10 'server' via ethernet.
I've installed netatalk and avahi-daemon on the server. I've disallowed Spotlight (OS X's search utility) from indexing the networked drives.
Everything works as it should, however, from time to time when I delete files that reside on the Ubuntu server from my MacBook, Finder (OS X's file manager) will freeze. I can kill the Finder process. I then try to restart it from the Terminal from the command line but I get the following error message printed:
Code:
LSOpenURLsWithRole() failed with error -10810 for the file /System/Library/CoreServices/Finder.app.
The only solution I know of at present is to reboot the MacBook.
So I guess I need to know what my options are here. Is it better for me to use SMB? Or is there a config file I can alter? I have a feeling this bug may be linked to certain disallowed characters in file or pathnames as it doesn't happen all the time, although this is just a hunch.
I have my MacBook 5,2 hooked up to an Ubuntu 10.10 'server' via ethernet.I've installed netatalk and avahi-daemon on the server. I've disallowed Spotlight (OS X's search utility) from indexing the networked drives. Everything works as it should, however, from time to time when I delete files that reside on the Ubuntu server from my MacBook, Finder (OS X's file manager) will freeze. I can kill the Finder process. I then try to restart it from the Terminal from the command line but I get the following error message printed:
Code:
LSOpenURLsWithRole() failed with error -10810 for the file /System/Library/CoreServices/Finder.app.
The only solution I know of at present is to reboot the MacBook. So I guess I need to know what my options are here. Is it better for me to use SMB? Or is there a config file I can alter? I have a feeling this bug may be linked to certain disallowed characters in file or pathnames as it doesn't happen all the time, although this is just a hunch.
I am very familiar with "find" and "locate" and many of the options they provide. Does anyone know a tool in order to search inside of documents and files like you would do it with the finder on Mac or with Windows search?I guess these tools use an indexer which is always running and indexing the content of every file so you can search and find a file based on what is in it, rather than by name only like locate would do.
View 1 Replies View RelatedI have a Nook. When I plug it into the USB port on my system, a window pops up asking what I want to do with the new device. I can open it and access media/nook and move files into and out of the directory.
There's a button to "Safely dismount Nook" before I unplug it. I use that. Apparently, however, sometimes it doesn't respond. Now I have .hal-mtab-lock in my /media folder, along with Nook Main Memory and Nook Main Memory (1) folders. I can't delete any of them.
How do I a) delete these folders, and b) make sure it actually unmounts the device in the future?
I have a text file with many pairs of number, one pair in each line. Each 25 of these pairs are a solution to a math problem I've been working on, and each solution is separated from another by a line with "**********".The problem is that there are duplicate solutions. In order to know exactly how many solutions I found, I have to delete the duplicate ones. How can I do that?Just to make things clear, here are the first three solutions:
1 1
3 2
5 3
[code]....
Was wondering if any perl guru's could help me with a quick log file adjustment. I have a text file that looks like so (tabs and newlines are revealed so you can see what separates the data):
There are maybe 100 lines of text in this file at any given time. I need to delete all duplicate lines only looking at the first bit of text prior to the first tab. It doesn't matter which one gets deleted as long as there are no two lines that begin with that same text at the beginning before the first tab. So in this example, either the fist line "1234" or the last line "1234" would need to be deleted. I already have code in my script that opens the files - I just need the code to read the text into an array and the part that would find matches based on the above criteria, and make the deletions.
If it would be easier, I can even do a system call and use SED (v4.1.5) and/or AWK (3.1.5) instead.
I downloaded three iso-images, 1 dvd-image and 2 cd-images:
openSUSE-11.3-DVD-i586.iso
openSUSE-11.3-GNOME-LiveCD-i686.iso
openSUSE-11.3-KDE4-LiveCD-i686.iso
Being paranoid, I created iso-files from the burnt DVD-R and the two burnt CD-R to verify integrity.
The iso-file of the DVD-R was identical to the downloaded image. Both iso-files created from the CD-R were different in size.
The original size of openSUSE-11.3-KDE4-LiveCD-i686.iso is 719.323.136 Bytes.
I only got 718.938.112 Bytes when recreating an ISO-file from my CD-R.
The CD-R is from Sony. When the length of my ISO-file doesn't correspond to the downloaded one, the checksum file verification doesn't work.
I finally got round to transcribing our wedding video from VCR to DVD. Now I would like to duplicate that video a few times and pass copies round the family, more to preserve it than to bore the relatives.
I dragged the DVD icon from the desktop to a thunar (file manager) window and it created a folder containing this lot code...
Total size 1.3 GB.
But I have no idea what to do with these files.
I tried this command code...
and ended up with a 4.4 GB file, which Archive Manager says contains the above folders, and presumably also contains an image of 3.1 GB of formatted but unused disk.
What's the best thing to do here? The ISO file will presumably burn a good DVD copy but it's a waste of disk space to keep it, (I'd like to keep a copy on hard disk too) and I guess will also take needlessly long to burn.
Can I create a smaller ISO from the file folders? If so, is there an app to edit the titles before I do so? The recorder put a second title "Empty Title" on the title page which I'd like to get rid of. I discovered by accident that the VOB files play in parole media player - one is the title screen, and the other two contain about half the video each. So I don't know what all the other files are about.
I tried to put a terminal in the desktop using more or less the procedure described in this article:
[URL]
It worked fine, but then I installed avant-windows-navigator and I think it created some conflicts with compiz and other applications.Both the desktop terminal and Skype started to appear in duplicate when I logged in. So I went to the startup applications menu and disabled them both. When I logged back in they both appear only once, but the terminal is in the wrong spot in the desktop.So there are probably some startup registers somewhere that are causing this.i've tried reinstalling compiz and I uninstall AWN and it didn't work.
i have network ( 5 windows and one ubuntu )simply i changed the hostname of my ubuntu pc and changed the workgroup name put the old pc name ( old hostname ) still on the network also the old workgroup name
View 2 Replies View Related