Ubuntu :: Moving Large Amounts Of Files
Mar 6, 2010I am trying to move a large amount of files (over 30k and 86GB) to another HDD but I get a Augment list too large error?? I tried rsync, cp, mv and still the same error
View 1 Replies
ADVERTISEMENT
Ubuntu Multimedia :: Prepare Large Amounts Of Images For Web?
Oct 27, 2010I've been using GIMP's 'save for the web' tool to reduce the file sizes of images.
I now have a directory with about 50 images. I'd like to avoid processing them all by hand.
I have a (very) basic knowledge of programming, and I'm comfortable with the commandline. I don't mind doing some homework on how to use new tools.
All I'm really concerned with here is reducing the file sizes of the images I have.
What possible pathways are there for me to prepare large amounts of images for the web?
General :: Move Large Amounts Of Music Within A File Structure?
Dec 20, 2009i have a car stereo that reads a USB drive with all my music on it, however to sort through the music it uses a method of finding folders containing music, then displaying them all in a list. i find this interface annoying because in order to sort the music by artist i have to go and manually move it out of the album folders by hand, this takes a long time for 11+ GB of music so i was trying to use the linux CLI to quicken the process. use a command like this
Code:
mv /media/usb/music/*/*/* /media/usb/music/*/
but for some reason this moves all my music into the last folder alphabetically in my drive, the music is all pre-arranged like this /media/usb/music/artist/album/song
General :: Writing Large Amounts Of Data To Multiple CD/DVDs?
Sep 1, 2009Are there any tools out there that let me select a bunch of data and burn it to multiple cd's or DVD's? I'm using k3b but have to manually select cd and dvd size amounts.
View 1 Replies View RelatedServer :: MySQL Backup - Deal With Large Amounts Of Data?
Feb 15, 2011we've been trying to become a bit more serious about backup. It seems the better way to do MySQL backup is to use the binlog. However, that binlog is huge! We seem to produce something like 10Gb per month. I'd like to copy the backup to somewhere off the server as I don't feel like there is much to be gained by just copying it to somewhere else on the server. I recently made a full backup which after compression amounted to 2.5Gb and took me 6.5 hours to copy to my own computer ... So that solution doesn't seem practical for the binlog backup.Should we rent another server somewhere? Is it possible to find a server like that really cheap? Or is there some other solution? What are other people's MySQL backup practices?
View 8 Replies View RelatedServer :: PAE Kernel (2.6.18) Fails To Swap With Large Amounts Of Physical Ram?
Dec 8, 2009We're load testing some of our larger servers (16GB+ RAM), and when memory starts to run low they are kicking off the oomkiller instead of swapping. I've checked swapon -s (which says we're using 0 bytes out of 16GB of swap), I've checked swappiness (60), I've tried upping the swap to 32GB, all to no avail. If we pull some RAM, and configure the box with 8GB of physical ram and 16 (or more) GB of swap, sure enough it dips into it and is more stable than a 16GB box with 16 or 32GB of swap.
View 6 Replies View RelatedUbuntu :: Moving Files In Terminal \ Moving Files That Have Root Permissions?
Mar 4, 2010I have limited experience in terminal, but let me first explain what I am trying to do to see if there is some easier way to do it. Basically I want to change the skin in aMSN. I downloaded the new skin but am unable to unzip or move it without /root permissions. I don't know how to acquire this without being in terminal. So I figured there had to be some way to go into the terminal and use it to move the unzipped folder from the desktop to the aMSN skins folder.
View 3 Replies View RelatedServer :: Cpanel Can't Handle Moving Such A Large Migration
Mar 16, 2010I have a cpanel server(not sure if that matters). I wanna transfer to another cpanel server. The size is about 3TB, I dont have enough on the hard drive to zip then transfer that way, and cpanel cant handle moving such a large migration.Been searching on the net to find an answer but everyone saying to backup then migrate. whats best tar or rsync or somthing else.
View 3 Replies View RelatedUbuntu :: Moving Files To A Pendrive Renders 0 Bytes Files And Files Gets Deleted
Jun 10, 2011I get a SD card. Put in the SD reader. It's empty. I go to my super-important-pictures-to-a-monthly-relatory folder and select all files. Select them for MOVE. Paste them on the SD card. When the move/paste process is finished, i click on the "Eject" button on top of the SD card name. Card's ejected. I can't access the card anymore. I take out the card and put on my other computer. From 300 pictures, there are only 10 available, the remaining ones are there, but with 0bytes and unrecoveable. I panic. I go back to my main computer, my pictures are not there anymore. The pictures were on the Home folder. I panic again. I reset the computer and boot on the LiveCD. I install foremost, scalpel, photorec and about everything till my USB drive complains about being filled up. I run everything and I can't recover my files. I'm in the danger of getting fired. Things like that makes Windows sounds more appealing. When you securely remove a pendrive, things get REALLY pasted there before screwing everything up with a removal.
View 8 Replies View RelatedUbuntu :: Command With The -r Option To Compare A Large Number Of Files And Files In Subdirectories
Jun 16, 2011I am using the diff command with the -r option, to compare a large number of files and files in subdirectories. My main interest is to find out which files have been changed, and not what the actual changes are, and since a lot of files has been changed, it would be a lot easier to view the file names only. Is there and option for diff that might do this, or does there exist a similar tool/command that could do the job?
View 1 Replies View RelatedOpenSUSE :: Dolphin Losing Files When Copying Many Files Or Large Folders?
Feb 14, 2010I've discovered that Dolphin seems to lose random files when copying many large folders.
I first noticed this a few months ago when I tried to copy my music library from one folder to another on the same HDD. It consisted of around 600 folders and 6500 files. During the copy there were no errors but after the copy I found that some of the newly copied folders were missing files. I put it down to human error or a glitch.
Yesterday I tried to copy 13 folders containing rips of some of my DVDs. Each folder basically had one film of either 700MB or 1.4GB. Again no errors showed up during the copy but I found 3 of the newly copied folders were empty.
It's not so critical with music or films but I can't afford to lose work data like this.
Has anyone experienced or seen a similar problem with Dolphin? I'm going to have to do some more extensive testing but this is not good.
The first time I noticed the problem I was running KDE4.3.4 (I think) and now the latest was with KDE4.4.0.
Software :: Differentiate Two Large Text Files Using Shell Script / Files Are Like Below?
Jan 20, 2009I want to automate this using script.How to automate it?
File1:
s.no# 1 name:aaaaaa
city:abcd
[code]...
Ubuntu :: Lost Files During Moving Files With Nautlis?
Oct 16, 2010I was moving a folder using Nautilus from an internal drive to a USB drive when suddenly, the power failed and the system rebooted before the UPS could go into backup. After I booted the PC again, half the files are are in neither of the drives. Do they go into a temporary folder first? There's nothing in /tmp and there's no Lost+Found folder. Is there anyway to get back those files? I'll always copy and delete from now on instead of moving.
View 2 Replies View RelatedServer :: After Moving PHP Files To /var/www They No Longer Are Seen As Hosted Php Files
Feb 25, 2010I am setting up a Demo website that I am hosting in a Debian Lenny VM, I have installed Apache, mySQL, and PHP5 I know the php server is working because if I place an info php file I can see it in the browser. However, I downloaded phpfusion, as well as phpmyadmin and they are on my desktop, I open a superuser file browser (also added write access to /var/www to everybody and copied the files over as me) and copied over the files. Once in the www folder they are no longer seen as "valid" php files, if I try to access them with iceweasel, IE, Konquerer it asks me if I want to download the file. If I look at the files on my desktop they have different icons. I have attached a screenshot. I can't tell what the difference is, but obviously there is one otherwise the icons wouldn't be different. Does anyone have any idea what's going on here or a way to rectify it?
View 9 Replies View RelatedUbuntu :: Rsync Really Slow On Large Files?
Mar 1, 2010I have Ubuntu on both my laptop and desktop machines, both are connected to the same network. I back up the laptop to the desktop by running the following on the laptop:
rsync -avv --stats /home/alisdt alisdt@xxx.xxx.xxx.xxx:/home/alisdt/laptop_backup (with the IP address of the desktop instead of the many x, obviously). Whenever rsync hits a large file (greater than a few MB), the network use rapidly drops to ~60KB/s (that's kilobytes not bits). When I copy the same file to the same place using scp, I get > 500KB/s throughout the transfer. Things I've tried:
* mounting the desktop home dir on the laptop using SSHFS -- a simple file copy is fast, rsync is still slow
* ditto with NFS
* rsync --whole-file option, in case the delta-transfer algorithm was choking on large files
* rsync --inplace option
* HPN-SSH (http://www.psc.edu/networking/projects/hpn-ssh/) to enable dynamic window and unencrypted bulk transfer, just in case it was some ssh bottleneck I think it's either an rsync application problem, or a network problem that is only affecting rsync. Any ideas, or other ideas of what I can try to debug? In case it's relevant, I'm using 9.04 on both machines. (A standing bug prevents me from upgrading the laptop, and I haven't bothered to upgrade the desktop).
Ubuntu :: Cups: Large Files Do Not Print?
Nov 29, 2010i have a problem with cups on a lucid/64 machine.
"Unable to write print data: Broken pipe"
The pdf-file to print has a size of 4,7MB. After sending the file to the printer the size of the file is more than 18 MB.
We use a Xerox WorkCentre 7232 which is via
socket://ip_adress:9100
connected to cups. The same configuration had been working fine for several years with hardy.
Cups refuses to print large files. When splitting up the print-file all works fine.
Ubuntu :: Moving Files From Different OS's?
Jun 26, 2010im switching. Vista is......yeah nothing needs to be said. Anyways i only have a few things preventing me from switching, biggest is Ubuntu is currently partinioned on 10gigs of my hard drive, the rest is mostly crap. All i want off vista is music, pictures, and a few videos. how do i get them onto the ubuntu side, or allocate more space to use a friends external harddrive. I know Wine is used for WoW(problem solved) but how about ventillo and the rarely played EvE online? also if possible i need to bring those over as well. other than than Ubuntu kicks the **** out of any windows or mac OS ive ever used. but thats not sayin a whole lot.
View 9 Replies View RelatedUbuntu :: File System Format For Mac OSX 10.5 For Large Files?
Sep 19, 2010Is there a file system that both Mac OSX 10.5 and linux can read/write for large files (like 4gb files)? My desktop is Ubuntu and I run most from there, but I want to back up my MacBook and linux box on the same external hard drive. Seems there are some (paid) apps for Mac that will mount NTFS but I'm wondering if there is just a shared files ystem that will work for both.
View 9 Replies View RelatedUbuntu :: Pulling Of Large Files From A Mounted Directory Into RAM?
Oct 18, 2010I'm having a bit of an issue with Lucid installed via Wubi. I stuck the OS on its own partition (30 GB in size), and don't store any large files in the Ubuntu file system (when I download something large I move it to another hard drive.) I don't have anything wacky or esoteric installed on my system.
I've been consistently having a problem where, after a few hours or a few days of being booted up, Ubuntu warns me that my available HD space is dangerously small. The amount of available HD space Ubuntu sees then shrinks from a few GB to nothing within a few minutes, and the only way I can seem to solve this is to reboot. Taking a closer look at what's happening, my Home folder balloons in size until there's no more writable space recognized. But there are no files being created or added to, so it looks like there's a bug of some sort. This SEEMS to be correlated with watching videos (or maybe it's the pulling of large files from a mounted directory into RAM? My videos are all on another HD, as mentioned before). I can generally go a few days without getting the "low space" message, but I can't seem to make it through a full 2-hour movie without getting the error.
Ubuntu :: Server Crashes When Transferring Large Files
Feb 6, 2011Every time I attempt to transfer over a large file (4 GB) via any protocol, my server restarts. On the rare occasion that it doesn't restart, it spits out a few error messages saying "local_softirq_pending 08" and then promptly freezes. Small files transfer fine.
Relevant information:
Ubuntu server 10.10
Four hard drives in RAID 5 configuration
CPU/HD temperatures are within normal range
OpenSUSE :: Burn Large Files With K3b Udf
Nov 3, 2010Problem is with files greater than 4G onto dual layer or BD disks.mkisofs crashes. I believe the problem to be when this requires udf filesystem and disk does not get written to. As yesterday version is suse11.3 patched to date. k3b writes standard dvd disks ok. I am seeing a lot of searches saying this is because of cdrkit rather than cdrtools, can I replace this easily? Is this the case? Tried setting the k3b options when burning to udf same error. Other searches show k3b has fixed probs with these issues, so appears to point to underlying mkisofs stuff full error log in yesterdays post if it helps. I will also try on ubuntu to see if it works there
View 1 Replies View RelatedSoftware :: Cp To Have A Progress Bar For Large Files?
Mar 10, 2010I always wanted cp to have a progress bar for large files. I came across this:[URL]... I just wonder, how could you install it as an Arch package? Is it possible?
View 9 Replies View RelatedSoftware :: RPM Not Supporting Large Files?
Jan 5, 2010I currently using RPM version 4.4.2.3. It fails to build with files larger than 2 GB and file sets larger than 3 GB. I have files larger than 2 GB and sets larger than 3 GB.Is there a work around, possibly a switch or option for RPM, that will ignore this limitation?
View 8 Replies View RelatedSlackware :: Get Ftp To Download Large Files?
May 29, 2010I am using xfce desktop and terminal.
1) How do i check to see what is the default FTP Client used by Slackware12.2 when i type:
$ftp
2) How do i get ftp to download large files? > 2gb from ftp server elektroni.phys.tut.fi or any ftp server.
Ubuntu Networking :: Moving Files On LAN
Sep 13, 2010i want to copy files from a local ubuntu 10.04 machine to a remote XP machine on a LAN.using gnome terminal server client i'm able to copy text but not files!is this possible to achieve with terminal server client or do i need to use another program? if so whit and how?
View 2 Replies View RelatedUbuntu :: Lockup When Moving Files?
Dec 17, 2010After updating to 10.10, I started getting hard freezes on a regular (read: every 10 min.during use) basis. A bit of diagnosis showed me that it was only a problem during periods of intensive I/O activity (moving files, downloading, etc.).A bug report started with:BUG: soft lockup - CUP#0 stuck for 61s! [kswapd0:26]I reinstalled 9.04, and was able to successfully copy 15gb from one drive to another. I upgraded to 9.10, and copied it back.Upgraded to 10.04 and copied it again. 10.10, it copied a few mb and froze.
View 1 Replies View RelatedUbuntu :: Moving Files Between Partitions
Jan 14, 2011I have windows 7 and am soon to partition a large amount of my drive over to linux. I'd rather all of my computer be linux but I'm unsure how to get my files to my other partition, I don't have a thumbdrive and my email doesn't have much space. I have 300 gbs of room, 150 will be linux, how do I get the 100 gigs moved from my windows partition to my linux so I have more space on my linux.
View 1 Replies View RelatedUbuntu :: Moving Files Into Directories
May 12, 2010I downloaded some backgrounds from Gnome Art and am having trouble moving them to the backgrounds folder. I've been trying this: sudo mv desktop <filename> usr/share/backgrounds.I moved to the desktop to make it easier.
View 1 Replies View RelatedUbuntu :: Transfer Large Files To External Hard Drive
Apr 21, 2010how to transfer large files from my laptop to external hard drive. Problem occurs when I'm sending Blu-ray films (4.4GB) to external, gets to 4GB and then comes up with error. Is there any way of breaking it up and then merging when it reaches the hard drive or is there a way of sending it as one whole file.
View 1 Replies View RelatedUbuntu :: Data Loss When Transferring Large Number Of Files?
Jul 20, 2010This problem is not exclusive to Ubuntu, I've experienced it in Windows and OSX as well, but it seems that almost every time I transfer a large number of files (i.e. my music collection) between my desktop computer and laptop via my external hard drive, I end up losing files for no reason. I usually don't notice the files are missing until later on, because I am never informed of any data loss. Now, every time I make a large transfer of files, I just do it two or three times to ensure that I don't lose any files.
View 2 Replies View Related