General :: Bash - Compressing Files Despite Low Disk Space?

Jul 18, 2011

I use Linux. I coded a screenshot program some time ago and now I have 9 GIG of screenshots, 60000 JPEGs, most of them look pretty similar, and I have 300 MB of disk space remaining.

What are some good ways to start to compress batches of them (or all of them) in the background given the limited space? The problem with compressing the folder all at once is that I wouldn't have enough disk space for that. It seems the process needs to be broken down into chunks. So maybe something like: Get a list of all the files Add a chunk of the files (say, 20) to a compressed archive. Once it is done and saved successfully, delete the chunk of files

View 2 Replies


ADVERTISEMENT

General :: Command Line - Compressing All .pdf Files Recursively (.tar)?

Jun 20, 2011

At the linux command line, I'd like to compress all .pdf files in a directory, any of it's subdirectories and so on - but only .pdf files. I'm struggling to figure out the syntax

View 2 Replies View Related

General :: Low On Disk Space - Looking For Biggest Files?

Nov 10, 2010

I seem to be running low on disk space on my linux server. 'df' shows about 82% usage on a stock CentOS install with sendmail. I routinely delete old email directories, but for some reason, I stay pretty high in disk usage. Is there a fancy little bash script or something I could run that would find the biggest files and I could go get rid of them?

View 3 Replies View Related

General :: Disk Full Deleted Files But No Space Available

May 3, 2010

My main storage partition got full, so I'm deleting files to make room. However, df -k keeps reporting no space available on that partition (/disk). Here's the output of the command several minutes apart while another process is deleting a 30G of space:What can I do to make the space available immediately?

View 4 Replies View Related

General :: Why Is Used + Available Disk Space Always Less Than Total Disk Space

Feb 24, 2011

root@localhost:~ $ df /dev/sdb1
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/sdb1 1922858352 23247088 1801935664 2% /mnt/external/sdb1

[code]....

View 1 Replies View Related

Fedora :: Compressing Collection Of Text Files?

Nov 6, 2010

i have a collection of text files for 50 gbs..i want to compress these files and store them into dvds.i want to know the present popular optimized method to compress the files.let me know masters.

View 1 Replies View Related

Ubuntu :: Get Task Bar For Commmand Line For Tar.gz - Tar.bz2 When Compressing Files?

Mar 17, 2011

How do I get a task bar for the commmand line for the tar.gz or tar.bz2 when compressing files? I want a task like wget has for download and like you get when you tar.gz or tar.bz2 with a gui.

View 6 Replies View Related

Ubuntu :: Log Files Eating Hard Disk Space?

Jan 29, 2009

running ubuntu 8.10 amd64 on my HP intel 2.26ghz dual core processor, 320gb hdd and 4gb ram. My main problem is that when I dual booted ubuntu onto my laptop, I had vista already installed, so I only set aside 20GB of hard disk space for ubuntu, which seems like more than enough to me. What's going on is that it says I have used all my space and only have one GB left, when the only thing I have on my computer are word files and necessary installs like flash player, compiz, avant, etc.When trying to hunt down what was using all my space, first I checked out the disk usage analyzer (some pics from here in):theres my hdd with 1/19 gb remaining here's a breakdown of my home folder, showing that it's not using very much at allhere's my filesystem, now we can see that all the space is being used in the folder: /var

View 9 Replies View Related

Ubuntu :: Determined That A Huge Amount Of Disk Space Is Being Taken Up By Files In /var/log/?

May 18, 2010

I examined the problem, and determined that a huge amount of disk space is being taken up by files in /var/log/ The following files:

Code:
/var/log/messages.1
/var/log/kern.log.1
/var/log/daemon.log.1
/var/log/messages
/var/log/kern.log
/var/log/daemon.log
/var/log/syslog

are all over 1 GB in size. The largest is 18 GB. Together, they total 48.3 GB. I restarted the system, forcing a fsck.

View 3 Replies View Related

Ubuntu :: 10.4 Making HUGE Log Files--running Out Of Disk Space?

Feb 2, 2011

I started getting errors about running out of disk space in root this morning. I hunted up what's taking all the space; var/log is 39GB (Ubuntu is installed on a 50G partition.) It's specific files that live in that directory, not subfolders. The files are:

kern.log = 11.6 GB
messages (plain text file) = 11.4 GB
kern.log.1 = 6.1 GB

[code]...

View 9 Replies View Related

General :: Disk Utility And Df Show Different Disk Space ?

Nov 18, 2010

I don't understand disk sizes in Linux. I have a 500GB drive. It's ext4. I have run "tune2fs -m 0" on it to reserve the amount of space reserved for root to 0.

I'm using Ubuntu 10.04 that comes with a Disk Utility. When I run "System->Administration->Disk Utility (palimpsest)" the disk shows up as 500GB (see picture). But when I run df -h it shows up as 459GB. So, I don't understand the discrepancy.

When I run df I get the following:

Question: Why is Disk Utility showing me something different than "df"?

View 6 Replies View Related

Ubuntu Servers :: Deleted Log Files Taking Up Huge Disk Space?

Sep 7, 2010

My /var/ partition continues to fill up on all my servers, and it is because the logs in /var/log/apache2 or /var/log/mysql are being deleted during log rotate, but their file handles are being held open. Thus, a "du -sh /var/log" shows the correct values, but "df | grep /var" shows something much different.

It seems that the log files rotate, however if I run "lsof | grep deleted" it returns lots of files that are no longer visible in the directory, however refuse to clear themselves off the disk.

The only way I have found to make these log files go away (and thus clear up the disk space on the partition I should have) is to restart either apache or mysql, depending on which process has huge sized log files being held open.

Is it just me, or is this a big flaw in the way linux works, that it can't figure out how to release file handle for a log so the disk space can be reclaimed? This is happening to me a lot lately.

Here is some output from one of my web servers so you can see what I am seeing...

root@web49:~# df -h | grep /var$
Filesystem Size Used Avail Use% Mounted on
/dev/sda8 9.2G 6.1G 2.7G 70% /var
root@web49:~# du -sh /var

[Code]....

View 9 Replies View Related

Ubuntu :: Deleted Photorec Backup Files Taking Up Disk Space?

Mar 13, 2011

I used photorec to recover lost files and it brought up 70gb worth of files, when I was done looking through them I deleted these files. but these files still seem to be taking up my disk space. When I try to access my trash bin with root I get a message that reads...."The folder contents could not be displayed. sorry, could not display all the contents of "trash": operation not supported." if I open my trash bin when I'm not in root, the bin is empty.

How do I free up my disk space?

View 8 Replies View Related

General :: Scripting - Cp A List Of Files Which Starts With - Or Space Without - Or Space?

Oct 14, 2009

I have a list of files in a directory which starts with - or have space.

I need to copy them back without the space or -?

linux1[sim]% ls linux1[sim]% cp ./-* ./*

View 8 Replies View Related

Ubuntu :: What's The General Purpose Compressing Format

Jan 14, 2010

I have a folder that may contain text documents, pictures, MP3s, video clips, all sorts of stuff. Supposing that, within reason, I'm not too bothered how long it takes to compress and uncompress them. And suppose I don't care if it's free or open source (well, has to be free as in beer). What's the best compression format/algorithm (whatever it is that I install in Synaptic and choose from the drop down menu in the compression tool) I should use?

View 9 Replies View Related

Slackware :: Disk Space Lost- Root Partition Has Very Little Space Left

Jan 31, 2010

Today I was installing a lot of software since I'm just setting up my Slackware system again after a fresh install, and I realized that my root partition has very little space left.

Here is the output of df -h:


Code:

As you can see, I have a 20G (19G here for some reason) root partition, 8G /var, and 86G of /home. I thought this would be plenty since many recent recommendations for / are 10-15G. Now, though, 17G are used up for some reason! How is this possible? I thought a full slackware install only had about 4G of software! I don't have any music or movies or any crazy huge files that I know of, and those would be in my /home directory anyway. Is there any way I can see which files are taking up all this space?

If it's necessary to allocate more space to my / partition, is it still possible to boot up a GParted live Cd, shrink /home a bit, move some partitions to the right, and expand my root partition? I would REALLY prefer I don't have to reinstall since I just spent a ton of time setting up my system again, but if worst comes to worst ... :'-(

In case you're curious, here's my /etc/fstab:

Code:

View 14 Replies View Related

General :: Disk Space Up To 60%

Nov 10, 2009

My disk space has grown from 30% to 60% in the last 3 months.

I can only assume this is from log files in the form of maillogs and squid logs.

Any ideas on how to free up the space? I'm pretty sure I have logroate running.

I just ran this on the mail log files:

View 14 Replies View Related

General :: Out Of Disk Space ?

Aug 17, 2009

I got the Hp 2133 mini notebook not to long ago maybe back in april. But they got a linux instead of Windows. I have yet to save anything on the computer, but everytime i logged on, i was usuing up disk space. Now I cant even log on and it gives me the message GDM Could not write to your authorization. Im sure i am not the first to receive this message. I dont know what to do. Its a Suse Linux Enterprise Desktop 10. I tried entering commands that ive seen on here that helped others. But its not working for me. I havent been able to use the laptop since may.

View 14 Replies View Related

Hardware :: Reduced Disk Space / Use The Total Amount Of Space?

Aug 25, 2009

OS: RHEL AS 5 64-bit

HDD:300 GB Hardware mirror (HP blade bl460c)

While installing OS, in partition window after OS file system structure I've left 277 GB. But after installation it shows Size - 255GB and available disk space is 242 GB.

Isn't it weired? How can I use the total amount of space in Linux? I need the whole 277GB exactly. What should be my workaround?

View 6 Replies View Related

General :: Disk Space Is Being Hogged

Feb 22, 2010

Suddenly my disk that contains everything but the home dirs and which is usually only approx 9% full is now 100 % full.Any suggestions on how to find how this has happened? How can i find the largest files minus the mounted dirs which are on other disks?

View 3 Replies View Related

General :: Freeing Disk Space ?

Sep 29, 2009

Had this problem in a few different instances where a process was creating a set of files in directory and using those files.

Some one just happened to go to the dir and deleted those files without stopping the process. The result being that as the process is still telling the machine that the disk usage is still what it initially was (df -h shows the old disk usage) , where as a du -h or a ls -lh on that same dir show that the files are not there.

Once this happened with mysql where the user delete the database dir in /var/database_name in the mysql home dir. The result being that the dusk usage was still showing as the old one even if the files were missing. This was resolved by restarting the mysql server.

Similar thing happened with some other processes where on restarting the problem was resolved..

My question being is there a method to solve this problem by whithout restarting the concerned process.. Some magical command like free disk or recheck dis usage :-) .. may be too much to ask but can some one help me out here.

View 1 Replies View Related

General :: Round Disk Space With Awk?

Jun 2, 2011

I want to use awk to list all the mount points, disk size and space available. Now I have all that info but I want to round the totals, so there is no delimiters, how can I do that?

PHP Code:
#!/bin/sh
date
df=`df -Pl | grep "^/dev" | awk '{print $6, $2/1024 , $4/1024}' | sed "s/%//"`
echo "$df"

[Code]...

View 6 Replies View Related

Ubuntu :: Wine / Rosetta Stone - "Cannot Create Needed Files Of Not Enough Disk Space"

Mar 27, 2010

Running ver 9.10 with Wine installed. Up untill about 2 mos ago Wine loaded 'Rosetta' ok. I tried last week and get Application Error. "Cannot create needed files of not enough disk space". I have over 35 gb unused space. I removed wine (purged) and re-installed -- still no good. It however works on my laptop that has same configuration (9.10)??

View 2 Replies View Related

General :: Ubuntu 10.04 Recurring Low Disk Space?

Sep 20, 2010

I am running Ubuntu 10.04 on one 80GiB disk partitioned as two equal. The second one is mounted as my home folder. The reasons for the partitioning are historic and I don't think they're relevant here.

My problem is that Ubuntu frequently reports 'Low Disk Space'. The initial solution was to turn off backups and that seemed to ease the problem. Now it has started happening again, but backups are still turned off. I can't see anything unusual in the tmp directory - or anywhere come to that - but I don't really know where to look.

I have searched for known leaky problems but haven't found anything that seems to fit. I don't store images, videos or music.

View 2 Replies View Related

General :: CentOS 5 - Available Disk Space Always 0 Percent

Jun 16, 2011

I am running centos 5. So far, it gives no problem but just yesterday, when it reported "no free space" for file writing, I try to remove some file as usual. Unfortunately this time no matter how much files I had deleted, it just keep showing no available space for doing so.

Result from df:
[root@LSMSVR ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
1.2G 269M 879M 24% /
/dev/hda6 4.8G 138M 4.4G 4% /tmp
/dev/hda5 19G 2.4G 16G 14% /usr
/dev/hda3 48G 12G 34G 25% /var
/dev/hda2 379G 365G 0 100% /home
/dev/hda1 99M 15M 80M 16% /boot
tmpfs 180M 0 180M 0% /dev/shm
ow to recover the lost space in /home?

View 2 Replies View Related

General :: Disk Space Used On Empty Partition?

May 26, 2009

The partition is formatted to ext3, starting with block 1 on the drive. The mount point for /dev/sdc1 lists 0 files when doing `ls -A` `df -h` shows that the partition has 92MB used. How is this space being used, and how can I free it up?edit: I guess this isn't a newbie question.

View 7 Replies View Related

General :: Get More Disk Space Into My Home Folder?

Feb 23, 2011

I am using Ubuntu in a laptop. The C disk has 15GB, and Windows is installed in C disk. I installed Netbook Ubuntu in D disk which only has 10GB free space. Now I am trying to install some applications in ubuntu such as emacs. But the system says it only has about 450Mb disk space. So how could I get more space? Can I install the applications under some different path? without using apt-get?

View 3 Replies View Related

General :: What's The Space Subtree Takes On Disk?

Aug 4, 2010

For a given directory, I want to know the space occupied on disk by it and all files and directories having it as an ancestor, so to speak. Is there a command for this in linux?

View 2 Replies View Related

General :: Disk Space - Script To Fill Up Diskspace?

Sep 29, 2010

I need a script to fill up my diskspace on my Linux box. It would be best if I can leave 200 MB free. I have Nagios installed, and it should email me when something like this happens, but how do I test it?I have Perl and PHP installed so if you want to use that then sure.

View 1 Replies View Related

General :: Where Is The Missing Disk Space On Software Raid

Nov 3, 2010

Purchased (4) 2TiB Drives (actual disk space) and created a RAID5 array expecting to have 6TB of useable disk space, however actual useable space is 5.46TiB.

So, the question is where did the disk space go?

First off, I can say for certainty the disks actual useable is verified at 2TB each have mounted and formated on a non-linux system (OSX).

Disks - 2TB Per disk, Tested HFS, Actual 2TB Useable
root@server:/server# fdisk -l 2>/dev/null | egrep "sd[hijk]" | grep Disk
Disk /dev/sdh: 2000.4 GB, 2000398934016 bytes
Disk /dev/sdj: 2000.4 GB, 2000398934016 bytes
Disk /dev/sdk: 2000.4 GB, 2000398934016 bytes

[Code]....

View 2 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved