Ubuntu :: /var/log Files Are Huge; Mounting Large Hard Drives?
Oct 9, 2010
syslog, messages and kern.log are incredibly huge files that are taking up a lot of space on my hard drive. Is it safe to remove them and/or to reduce logging so it doesn't take such an enormous amount of hard disk memory? If so, how can I reduce the logging so it doesn't produce logs that are 10s of GB in size?Also, mounting a drive places it into the folder /media. Will it become problematic if the size of the mounted drive exceeds the amount of free space available on my Ubuntu partition?
I recently purchased a Western Digital 1TB USB hard drive to use for general data storage. I had thought about repartitioning it into 8 - 10 individual drives (most Linux users will doubtless understand the arguments for and against this) and reformatting them with another filesystem, probably ext2.
The unit actually consists of two 500GB drives that are presented by the internal controller as a single 1TB drive, and are formatted with the old HPFS/NTFS filesystem, so I'm a bit cautious about the possibility of my original plan confusing the drive's controller. Does anyone have any experience with these large drives, any thoughts about repartitioning/reformatting, and relevant criteria for optimizing their use?
I have a few hard drives that I connect to my system with an usb to ide cord. some of the drives mount right away but some others don't below example.
Oct 24 11:10:04 linux-b21t kernel: usb 1-3: new high speed USB device using ehci_hcd and address 14 Oct 24 11:10:04 linux-b21t kernel: usb 1-3: configuration #1 chosen from 1 choice Oct 24 11:10:04 linux-b21t kernel: scsi15 : SCSI emulation for USB Mass Storage devices Oct 24 11:10:04 linux-b21t kernel: usb-storage: device found at 14
I know this is an easy task, especially using cPanel. However I want to do this without formatting the drive, since there is sensitive data already on the hard drives. So how would I mount a hard drive, but not format/lose any of the data already on it?I've looked and everything seems to lead me to believe that I'll lose data if I do it that way.
is their any way to change the mounting location of your hard drives so when you click a certain hard drive in nautilus, it'll go to that location instead of the default one?
I have a fresh installation of Fedora 11 and I am having a hard time figuring out how to automount my storage drives. Each time I login, I try to access my various storage drives and gnome makes me authenticate asroot before mounting it. FSTAB lists only logical volumes but not my storage drives. What can I do to make sure these automount when I login?
OpenSuse 11.2 64bit When I select a hard drive in Dolphin file manager it asks for the root password. I would like to gain easier access to the drives. The Yast Partition Manager lists all of the drives and has a dialog box to change this i.e. user can mount the drive. Can we change this feature on the run, while the system is running ? The Fstab file is not listing all of the drives, so I cannot just edit the config here.
I've been struggling with this one for a while - I have three SATA hard drives installed on my system: /dev/sda - an 80 GB disk with three partitions, one NTFS for WinXP, one ext4 for Fedora 11 x86_64, and a boot partition /dev/sdb - a 250 GB disk with one partition, ext4 /dev/sdc - a 250 GB disk with one partition, ntfs
I can mount any partition on /dev/sda without problems - everything works exactly as expected. Attempting to mount a partition from one of the other disks results in something like the following (this is for sdc1):
Code: [User@machine ~]$ sudo mount -t ntfs /dev/sdc1 /mnt/shared [sudo] password for User: ntfs-3g: Failed to access volume '/dev/sdc1': No such file or directory ntfs-3g 2009.11.14 integrated FUSE 27 - Third Generation NTFS Driver XATTRS are on, POSIX ACLS are off
Copyright (C) 2005-2007 Yura Pakhuchiy Copyright (C) 2006-2009 Szabolcs Szakacsits Copyright (C) 2007-2009 Jean-Pierre Andre Copyright (C) 2009 Erik Larsson
Usage: ntfs-3g [-o option[,...]] <device|image_file> <mount_point> Options: ro (read-only mount), remove_hiberfile, uid=, gid=, umask=, fmask=, dmask=, streams_interface=. Please see the details in the manual (type: man ntfs-3g). Example: ntfs-3g /dev/sda1 /mnt/windows Ntfs-3g news, support and information: http://ntfs-3g.org The /mnt/shared directory is created; the failed to access error is related to the disk.
Here is the output from fdisk: Code: [User@machine ~]$ sudo fdisk -l Disk /dev/sdb: 250.0 GB, 250059350016 bytes 255 heads, 63 sectors/track, 30401 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0f970f96
Device Boot Start End Blocks Id System /dev/sdb1 1 30401 244196001 8e Linux LVM Disk /dev/sdc: 250.0 GB, 250059350016 bytes 255 heads, 63 sectors/track, 30401 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x1050104f
Device Boot Start End Blocks Id System /dev/sdc1 1 30401 244196001 7 HPFS/NTFS Disk /dev/sda: 80.0 GB, 80026361856 bytes 255 heads, 63 sectors/track, 9729 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x8e538e53
Device Boot Start End Blocks Id System /dev/sda1 1 6375 51200000 7 HPFS/NTFS /dev/sda2 * 6375 6400 204800 83 Linux /dev/sda3 6400 9729 26743361 8e Linux LVM
Disk /dev/dm-0: 21.4 GB, 21428699136 bytes 255 heads, 63 sectors/track, 2605 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-0 doesn't contain a valid partition table
Disk /dev/dm-1: 5955 MB, 5955911680 bytes 255 heads, 63 sectors/track, 724 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-1 doesn't contain a valid partition table Disk /dev/dm-2: 250.0 GB, 250059348992 bytes 255 heads, 63 sectors/track, 30401 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0f970f96
Device Boot Start End Blocks Id System /dev/dm-2p1 1 30401 244196001 8e Linux LVM Disk /dev/dm-3: 250.0 GB, 250056705024 bytes 255 heads, 63 sectors/track, 30400 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-3 doesn't contain a valid partition table
And also from blkid (this does not match the output from above - but I don't know if this is actually related to the problem or how to fix it): Code: [User@machine ~]$ sudo blkid /dev/sda1: UUID="506412E06412C91C" TYPE="ntfs" /dev/sda2: UUID="811bf259-33d5-4db2-9851-e93b47dcbcc8" SEC_TYPE="ext2" TYPE="ext3" /dev/sda3: UUID="U3AJLH-Lhm1-b0lf-HDX9-ZK1V-ezqU-sb0YGQ" TYPE="lvm2pv" /dev/dm-0: UUID="f5733171-0753-4f53-834b-cc693ffb0aed" TYPE="ext4" /dev/dm-1: TYPE="swap" /dev/mapper/vg_machine-lv_root: UUID="f5733171-0753-4f53-834b-cc693ffb0aed" TYPE="ext4" /dev/mapper/vg_machine-lv_swap: TYPE="swap"
I have brought an ipod of my friends with a lot of movies and i was then running on windows. The Whole sys was infected and I reloaded the windows operating system but it worked fine only upto two restarts. Then I started and completely successfully installed fedora core 10 i386. I Have very much important information in the windows hard drives. Please tell me anyone how to mount these partitions from the beginning.
There is a question I cannot find answer to.Should hard drives be mounted in the computer's case hard (screwed to wall) or soft (suspended by means of rubber washers)? And the same question about DVD drive which vibrates far more than a hard drive.
how to transfer large files from my laptop to external hard drive. Problem occurs when I'm sending Blu-ray films (4.4GB) to external, gets to 4GB and then comes up with error. Is there any way of breaking it up and then merging when it reaches the hard drive or is there a way of sending it as one whole file.
I suspect this is not new but I just can't find where it was treated. Maybe someone can give me a good lead.I just want to prevent certain users from accessing CD/DVD drives and all external drives. They should be able to mount their home directories and move around within the OS but they shouldn't be able to move data away from the PC. Any Clues?
I am building a home server that will host a multitude of files; from mp3s to ebooks to FEA software and files. I don't know if RAID is the right thing for me. This server will have all the files that I have accumulated over the years and if the drive fails than I will be S.O.L. I have seen discussions where someone has RAID 1 setup but they don't have their drives internally (to the case), they bought 2 separate external hard drives with eSata to minimize an electrical failure to the drives. (I guess this is a good idea)I have also read about having one drive then using a second to rsync data every week. I planned on purchasing 2 enterprise hard drives of 500 MB to 1 GB but I don't have any experience with how I should handle my data
I have Fedora 14 installed on my main internal drive. I have one Fedora 14 and one Fedora 15 installed on two separate USB drives.When I boot into any of these drives, I can't access any of the other hard drives from the other drivesll I can, but just the boot partitions.Is there any way of mounting the other partitions so I can access the information?---------- Post added at 12:42 PM ---------- Previous post was at 09:34 AM ----------I guess even an explanation on why I can't view them would be good too.
I just tried to install OpenSUSE 11.3 on sda4 which is approximately the 2nd half of a 1TB drive, with a pre-existing Win7 installation on the 1st half. The installation summary (before it made any changes) told me "The bootloader is installed on a partition that does not lie entirely below 128GB. The system might not boot." Naturally, not keen on having a computer that won't boot, I aborted the installation.
Of course it's not below 128GB -- Windows is there.
Is there a workaround that is straightforward enough for someone who has very limited experience with GNU/Linux and isn't a comp-sci student?
I am attempting to upgrade a system from 4.7 to 5.2 using a (now) DVD drive attached to the onboard IDE. Originally I had tried using a remote NFS image and a USB stick but I thought maybe there was a problem with the image. I can get up to the point of the installation of selecting the keyboard for the system and then it freezes and never goes any further. It doesn't appear to be a kernel panic since I can still switch between consoles.
I've got an MSI K9NGM2-FID with 14 drives in it. It serves as a file server for our backup server. It's got a secondary 4 port Silicon Image SII 3114 SATA card using the sata_sil module, and an old IDE Promise FastTrak TX2000. Technically I could have 16 drives but the 750W PS is walking the fine line on tripping it's self-breaker with the 14 drives and 7 fans. I would like to NOT have to disconnect all of this to do the upgrade.
I thought maybe that running the install using the "noprobe" option would help so it didn't detect and load the modules for the Silicon Image or the Promise cards and detect all of the drives but it still gets stuck on the step after selecting the keyboard. The installation info console and the dmesg console don't really provide any useful information. The installation console says:
INFO : moving (1) to step welcome INFO : moving (1) to step language INFO : moving (1) to step keyboard INFO : moving (1) to step findrootparts
And the last lines of the dmesg console says:
<6>device-mapper: multipath: version 1.0.5 loaded <6>device-mapper: multipath round-robin: version 1.0.0 loaded <6>device-mapper: multipath emc: version 0.0.3 loaded
Is there a hidden "debug" option that will turn on a lot of extra logging?
I have a large RAID array of 12 TB attached to one of my Ubuntu server machines. The RAID volume is formatted with NTFS. The problem is that I can not mount this volume in Ubuntu. I can read it normally if I attach it to windows machine.This is the output from "sudo fdisk -l":
I have a SATA drive that worked fine. Then I installed two more hard drives into my system. When these hard drives are installed, if I try to access the SATA drive in Linux, it will start lightly clicking and then the drive will become unavailable. If I power on the machine without the other two hard drives then it works fine. What could be causing this to happen? I don't think it's heat because the two hard drives are far away from the SATA drive.
I've been Ubuntu 8.10 along with Windows from abt 3-4 monthsFor automatically mounting of NTFS drives that I has which were created by WIndows, I uses NTFS Configuration tool Everything was working fine in both OS's.But how come of a sudden today I'm not able to open any drive that I have which were happening till now.Not only this,at least if we press F9 then we get sidebar,from where we could have opened the drive .even that is not happening.
I have a 60GB partition with / and home on it. I logged on yesterday and it gave me a warning saying that I had only 1.9 GB of disk space left. I ignored it for a day and assumed that i had too many videos and pics.But the next day i had not added any files or downloaded any software but i had 0B left. I used the disk usage analyser and found that 33GBs came from /var/log. It was from two log files. syslog and daemon.log 16.5GB each!! I opened them up and i found that this line of text was repeated hnundreds of thousands of times.
Code: Jul 22 19:32:36 aulenback-desktop ntfs-3g[5315]: Failed to decompress file: Value too large for defined data type
i have about 2 TB of 700mb avi files as data on disc want to spread it across two 2TB ext usb drives (sata 3.5 inside the housing) obviously i have to rip them to the laptop and then move to the ext hdd (omg laborious little task) am i better doing the ripping in meerkat or in a windows machine? files need to be accessible by W7, XP, and meerkat to vlc player. what should i format the discs to?
I am using the diff command with the -r option, to compare a large number of files and files in subdirectories. My main interest is to find out which files have been changed, and not what the actual changes are, and since a lot of files has been changed, it would be a lot easier to view the file names only. Is there and option for diff that might do this, or does there exist a similar tool/command that could do the job?
I'm looking for a fast way to verify a copy of a folder with 150Gigs of data, in 33 files. Some of the files are a few kb, while a few are 20-30Gigs. I've done a file count, which is quick, but doesn't verify that all the files are intact. I tried running md5sum on them, which works, but will probably take as long as copying the files in the first place. Diff works too, but is slow too.
I have a wav file bigger than 8GB. i recorded it on a windows PC. unfortunately wav files cant be bigger than 2GB. somehow i got a file that is almost 9GB. I tried to chop the file under ubuntu into smaller pieces to open it part by part. i used gnome split to divide the file and made 10 parts out of it. now i have these parts of the data which i cant read with no program except for gnome split to merge them together again - which would only bring me to the beginning of my problem. so my question is: is there any other way to open/ split&open a wav file of that size or maybe a way to open the splitted file partially?
I just recently found an iso for 6.06 and installed it on an old pc of mine that already had 8.04 and crunchbang on it. crunchbang is on an ext4 formatted partition.
When I setup 6.06, it asked me what i wanted to mount my drives as, so i told it to mount the ext4 system as hda1.
whenever 6.06 boots, it tries to mount hda1 but can't because it doesn't recognize ext4.
What I am asking is this: is there a deb or a package out there I can install to make 6.06 recognize ext4? if not, how can i make it so that 6.06 does not want to mount hda1?
I can get past the initial error message and into the desktop, so 6.06 does work.
I have Ubuntu 9.10 and when i plug in my usb drive it wont mount it automatically and is not shown in the nautilus browser also, but if i search in /dev its visible(its detected) and i can mount using mount /dev/sdc /mnt But if i do this i can only copy files from browser and for all other times i need to use terminal again
It seems to be (we have experienced) that 10.10 can't handle having an older ext3 drive mounted to a folder on the 1010 ext4 drive. The files get "corrupted", but afterwards, putting the drive back into the original older 9.04 system, the files are perfectly fine again.
