General :: Bash - Compressing Files Despite Low Disk Space?
Jul 18, 2011
I use Linux. I coded a screenshot program some time ago and now I have 9 GIG of screenshots, 60000 JPEGs, most of them look pretty similar, and I have 300 MB of disk space remaining.
What are some good ways to start to compress batches of them (or all of them) in the background given the limited space? The problem with compressing the folder all at once is that I wouldn't have enough disk space for that. It seems the process needs to be broken down into chunks. So maybe something like: Get a list of all the files Add a chunk of the files (say, 20) to a compressed archive. Once it is done and saved successfully, delete the chunk of files
View 2 Replies
ADVERTISEMENT
Jun 20, 2011
At the linux command line, I'd like to compress all .pdf files in a directory, any of it's subdirectories and so on - but only .pdf files. I'm struggling to figure out the syntax
View 2 Replies
View Related
Nov 10, 2010
I seem to be running low on disk space on my linux server. 'df' shows about 82% usage on a stock CentOS install with sendmail. I routinely delete old email directories, but for some reason, I stay pretty high in disk usage. Is there a fancy little bash script or something I could run that would find the biggest files and I could go get rid of them?
View 3 Replies
View Related
May 3, 2010
My main storage partition got full, so I'm deleting files to make room. However, df -k keeps reporting no space available on that partition (/disk). Here's the output of the command several minutes apart while another process is deleting a 30G of space:What can I do to make the space available immediately?
View 4 Replies
View Related
Feb 24, 2011
root@localhost:~ $ df /dev/sdb1
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/sdb1 1922858352 23247088 1801935664 2% /mnt/external/sdb1
[code]....
View 1 Replies
View Related
Nov 6, 2010
i have a collection of text files for 50 gbs..i want to compress these files and store them into dvds.i want to know the present popular optimized method to compress the files.let me know masters.
View 1 Replies
View Related
Mar 17, 2011
How do I get a task bar for the commmand line for the tar.gz or tar.bz2 when compressing files? I want a task like wget has for download and like you get when you tar.gz or tar.bz2 with a gui.
View 6 Replies
View Related
Jan 29, 2009
running ubuntu 8.10 amd64 on my HP intel 2.26ghz dual core processor, 320gb hdd and 4gb ram. My main problem is that when I dual booted ubuntu onto my laptop, I had vista already installed, so I only set aside 20GB of hard disk space for ubuntu, which seems like more than enough to me. What's going on is that it says I have used all my space and only have one GB left, when the only thing I have on my computer are word files and necessary installs like flash player, compiz, avant, etc.When trying to hunt down what was using all my space, first I checked out the disk usage analyzer (some pics from here in):theres my hdd with 1/19 gb remaining here's a breakdown of my home folder, showing that it's not using very much at allhere's my filesystem, now we can see that all the space is being used in the folder: /var
View 9 Replies
View Related
May 18, 2010
I examined the problem, and determined that a huge amount of disk space is being taken up by files in /var/log/ The following files:
Code:
/var/log/messages.1
/var/log/kern.log.1
/var/log/daemon.log.1
/var/log/messages
/var/log/kern.log
/var/log/daemon.log
/var/log/syslog
are all over 1 GB in size. The largest is 18 GB. Together, they total 48.3 GB. I restarted the system, forcing a fsck.
View 3 Replies
View Related
Feb 2, 2011
I started getting errors about running out of disk space in root this morning. I hunted up what's taking all the space; var/log is 39GB (Ubuntu is installed on a 50G partition.) It's specific files that live in that directory, not subfolders. The files are:
kern.log = 11.6 GB
messages (plain text file) = 11.4 GB
kern.log.1 = 6.1 GB
[code]...
View 9 Replies
View Related
Nov 18, 2010
I don't understand disk sizes in Linux. I have a 500GB drive. It's ext4. I have run "tune2fs -m 0" on it to reserve the amount of space reserved for root to 0.
I'm using Ubuntu 10.04 that comes with a Disk Utility. When I run "System->Administration->Disk Utility (palimpsest)" the disk shows up as 500GB (see picture). But when I run df -h it shows up as 459GB. So, I don't understand the discrepancy.
When I run df I get the following:
Question: Why is Disk Utility showing me something different than "df"?
View 6 Replies
View Related
Sep 7, 2010
My /var/ partition continues to fill up on all my servers, and it is because the logs in /var/log/apache2 or /var/log/mysql are being deleted during log rotate, but their file handles are being held open. Thus, a "du -sh /var/log" shows the correct values, but "df | grep /var" shows something much different.
It seems that the log files rotate, however if I run "lsof | grep deleted" it returns lots of files that are no longer visible in the directory, however refuse to clear themselves off the disk.
The only way I have found to make these log files go away (and thus clear up the disk space on the partition I should have) is to restart either apache or mysql, depending on which process has huge sized log files being held open.
Is it just me, or is this a big flaw in the way linux works, that it can't figure out how to release file handle for a log so the disk space can be reclaimed? This is happening to me a lot lately.
Here is some output from one of my web servers so you can see what I am seeing...
root@web49:~# df -h | grep /var$
Filesystem Size Used Avail Use% Mounted on
/dev/sda8 9.2G 6.1G 2.7G 70% /var
root@web49:~# du -sh /var
[Code]....
View 9 Replies
View Related
Mar 13, 2011
I used photorec to recover lost files and it brought up 70gb worth of files, when I was done looking through them I deleted these files. but these files still seem to be taking up my disk space. When I try to access my trash bin with root I get a message that reads...."The folder contents could not be displayed. sorry, could not display all the contents of "trash": operation not supported." if I open my trash bin when I'm not in root, the bin is empty.
How do I free up my disk space?
View 8 Replies
View Related
Oct 14, 2009
I have a list of files in a directory which starts with - or have space.
I need to copy them back without the space or -?
linux1[sim]% ls linux1[sim]% cp ./-* ./*
View 8 Replies
View Related
Jan 14, 2010
I have a folder that may contain text documents, pictures, MP3s, video clips, all sorts of stuff. Supposing that, within reason, I'm not too bothered how long it takes to compress and uncompress them. And suppose I don't care if it's free or open source (well, has to be free as in beer). What's the best compression format/algorithm (whatever it is that I install in Synaptic and choose from the drop down menu in the compression tool) I should use?
View 9 Replies
View Related
Jan 31, 2010
Today I was installing a lot of software since I'm just setting up my Slackware system again after a fresh install, and I realized that my root partition has very little space left.
Here is the output of df -h:
Code:
As you can see, I have a 20G (19G here for some reason) root partition, 8G /var, and 86G of /home. I thought this would be plenty since many recent recommendations for / are 10-15G. Now, though, 17G are used up for some reason! How is this possible? I thought a full slackware install only had about 4G of software! I don't have any music or movies or any crazy huge files that I know of, and those would be in my /home directory anyway. Is there any way I can see which files are taking up all this space?
If it's necessary to allocate more space to my / partition, is it still possible to boot up a GParted live Cd, shrink /home a bit, move some partitions to the right, and expand my root partition? I would REALLY prefer I don't have to reinstall since I just spent a ton of time setting up my system again, but if worst comes to worst ... :'-(
In case you're curious, here's my /etc/fstab:
Code:
View 14 Replies
View Related
Nov 10, 2009
My disk space has grown from 30% to 60% in the last 3 months.
I can only assume this is from log files in the form of maillogs and squid logs.
Any ideas on how to free up the space? I'm pretty sure I have logroate running.
I just ran this on the mail log files:
View 14 Replies
View Related
Aug 17, 2009
I got the Hp 2133 mini notebook not to long ago maybe back in april. But they got a linux instead of Windows. I have yet to save anything on the computer, but everytime i logged on, i was usuing up disk space. Now I cant even log on and it gives me the message GDM Could not write to your authorization. Im sure i am not the first to receive this message. I dont know what to do. Its a Suse Linux Enterprise Desktop 10. I tried entering commands that ive seen on here that helped others. But its not working for me. I havent been able to use the laptop since may.
View 14 Replies
View Related
Aug 25, 2009
OS: RHEL AS 5 64-bit
HDD:300 GB Hardware mirror (HP blade bl460c)
While installing OS, in partition window after OS file system structure I've left 277 GB. But after installation it shows Size - 255GB and available disk space is 242 GB.
Isn't it weired? How can I use the total amount of space in Linux? I need the whole 277GB exactly. What should be my workaround?
View 6 Replies
View Related
Feb 22, 2010
Suddenly my disk that contains everything but the home dirs and which is usually only approx 9% full is now 100 % full.Any suggestions on how to find how this has happened? How can i find the largest files minus the mounted dirs which are on other disks?
View 3 Replies
View Related
Sep 29, 2009
Had this problem in a few different instances where a process was creating a set of files in directory and using those files.
Some one just happened to go to the dir and deleted those files without stopping the process. The result being that as the process is still telling the machine that the disk usage is still what it initially was (df -h shows the old disk usage) , where as a du -h or a ls -lh on that same dir show that the files are not there.
Once this happened with mysql where the user delete the database dir in /var/database_name in the mysql home dir. The result being that the dusk usage was still showing as the old one even if the files were missing. This was resolved by restarting the mysql server.
Similar thing happened with some other processes where on restarting the problem was resolved..
My question being is there a method to solve this problem by whithout restarting the concerned process.. Some magical command like free disk or recheck dis usage :-) .. may be too much to ask but can some one help me out here.
View 1 Replies
View Related
Jun 2, 2011
I want to use awk to list all the mount points, disk size and space available. Now I have all that info but I want to round the totals, so there is no delimiters, how can I do that?
PHP Code:
#!/bin/sh
date
df=`df -Pl | grep "^/dev" | awk '{print $6, $2/1024 , $4/1024}' | sed "s/%//"`
echo "$df"
[Code]...
View 6 Replies
View Related
Mar 27, 2010
Running ver 9.10 with Wine installed. Up untill about 2 mos ago Wine loaded 'Rosetta' ok. I tried last week and get Application Error. "Cannot create needed files of not enough disk space". I have over 35 gb unused space. I removed wine (purged) and re-installed -- still no good. It however works on my laptop that has same configuration (9.10)??
View 2 Replies
View Related
Sep 20, 2010
I am running Ubuntu 10.04 on one 80GiB disk partitioned as two equal. The second one is mounted as my home folder. The reasons for the partitioning are historic and I don't think they're relevant here.
My problem is that Ubuntu frequently reports 'Low Disk Space'. The initial solution was to turn off backups and that seemed to ease the problem. Now it has started happening again, but backups are still turned off. I can't see anything unusual in the tmp directory - or anywhere come to that - but I don't really know where to look.
I have searched for known leaky problems but haven't found anything that seems to fit. I don't store images, videos or music.
View 2 Replies
View Related
Jun 16, 2011
I am running centos 5. So far, it gives no problem but just yesterday, when it reported "no free space" for file writing, I try to remove some file as usual. Unfortunately this time no matter how much files I had deleted, it just keep showing no available space for doing so.
Result from df:
[root@LSMSVR ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
1.2G 269M 879M 24% /
/dev/hda6 4.8G 138M 4.4G 4% /tmp
/dev/hda5 19G 2.4G 16G 14% /usr
/dev/hda3 48G 12G 34G 25% /var
/dev/hda2 379G 365G 0 100% /home
/dev/hda1 99M 15M 80M 16% /boot
tmpfs 180M 0 180M 0% /dev/shm
ow to recover the lost space in /home?
View 2 Replies
View Related
May 26, 2009
The partition is formatted to ext3, starting with block 1 on the drive. The mount point for /dev/sdc1 lists 0 files when doing `ls -A` `df -h` shows that the partition has 92MB used. How is this space being used, and how can I free it up?edit: I guess this isn't a newbie question.
View 7 Replies
View Related
Feb 23, 2011
I am using Ubuntu in a laptop. The C disk has 15GB, and Windows is installed in C disk. I installed Netbook Ubuntu in D disk which only has 10GB free space. Now I am trying to install some applications in ubuntu such as emacs. But the system says it only has about 450Mb disk space. So how could I get more space? Can I install the applications under some different path? without using apt-get?
View 3 Replies
View Related
Aug 4, 2010
For a given directory, I want to know the space occupied on disk by it and all files and directories having it as an ancestor, so to speak. Is there a command for this in linux?
View 2 Replies
View Related
Sep 29, 2010
I need a script to fill up my diskspace on my Linux box. It would be best if I can leave 200 MB free. I have Nagios installed, and it should email me when something like this happens, but how do I test it?I have Perl and PHP installed so if you want to use that then sure.
View 1 Replies
View Related
Nov 3, 2010
Purchased (4) 2TiB Drives (actual disk space) and created a RAID5 array expecting to have 6TB of useable disk space, however actual useable space is 5.46TiB.
So, the question is where did the disk space go?
First off, I can say for certainty the disks actual useable is verified at 2TB each have mounted and formated on a non-linux system (OSX).
Disks - 2TB Per disk, Tested HFS, Actual 2TB Useable
root@server:/server# fdisk -l 2>/dev/null | egrep "sd[hijk]" | grep Disk
Disk /dev/sdh: 2000.4 GB, 2000398934016 bytes
Disk /dev/sdj: 2000.4 GB, 2000398934016 bytes
Disk /dev/sdk: 2000.4 GB, 2000398934016 bytes
[Code]....
View 2 Replies
View Related
