General :: Data On Disk Drive Management By OS - Getting Base I/O Unit Size?
Mar 31, 2010
I want to ensure I have done all I can to configure a system's disks for serious database use. The three areas I know of (any others?) to be concerned about are: I/O size: The database engine and disk's native size should either match, or the database's native I/O size should be a multiple of the disk's native I/O size. DMA: Disks that are capable of Direct Memory Access (eg. IDE) should be configured for it.
Write-caching: When a disk says it has written data persistently, it must be so! No keeping it in cache and lying about it.
I have been looking for information on how to ensure these are so for CentOS and Ubuntu, but can't seem to find anything at all. I want to be able to check these things and change them if needed. The actual hardware involved is very modest. The point is to get the most out of what hardware we do have, even though it's "not very serious hardware" from a broader perspective.
View 1 Replies
ADVERTISEMENT
Jul 17, 2011
I currently have a 2TB qnap nas which will be relegated to mirroring important files from my new nas. I am building up a HP Microserver with 2*2TB and want to look at the best way to manage the data, disks and backups.
My wish list: Power down unused drives
I want all the disks to appear as one.
I want to be able to easily add an extra drive and add to the available space
I want to be able to replace a disk with a larger one and add to the available space (It's ok if I have to manually copy the data from the old drive to the new drive)
If a disk dies I want the remaining disks to still function with whatever data they have left on them.
Email me if a drive dies
If the server blows up then I can plug any drive from the server into another pc and copy the available data off the disk
Mhddfs - anyone use this much? What's the speed like? Do individual drives get spun down if not used? How is it decided which drive gets the data? No one talks about mhddfs much. It all seems to be about mdadm and raid and LVM which I don't think is suitable for my current purpose. I have a existing qnap nas with a total of 2tb that will rsync changed files from the server nightly. To restore missing files would I use rsync in reverse?
View 4 Replies
View Related
Apr 28, 2011
I am trying to burn mac osx 10.5 install disk from from a 6.7gb dmg disk image. I thought I would be using 2 DVD-R 4.7GB discsfor this burn, I was hoping when the first was full it would ask for another to finish the burn. Instead it get the message that the DVD will not hold the choosen DMG. file.
Can I do anything besides buy a dual layer DVD that would hold the whole file?
View 1 Replies
View Related
Oct 10, 2010
I have a 2 TB disk in an external SATA dock, formatted with a single ext3 (Linux) partition, which doesn't show up in the Windows 7 Computer Management->Disk Management utility, even as a raw/blank disk. I've verified that there's nothing wrong with the disk by connecting it to my Linux machine and mounting it, and I've verified that the dock is functioning properly by connecting a different FAT32-formatted disk, which mounts flawlessly as expected.I realize that I can't actually read the ext3 partition without additional software (e.g., Ext3IFS), but why doesn't the disk show up at all? Is there some sort of stupid anti-Linux filter built in? Is there any way to force Windows to recognize the disk, so that I can at the very least use direct block access with it?
Background: I want to clone an identical 2 TB disk onto this one. Due to my hardware layout, it's much easier to have the source disk attached to one machine and the destination disk connected to another, and do the clone over the network (the network is not a bottleneck with switched gigabit ethernet), than it is to hook them both up to one machine.(1) I did this once before when both machines were running Linux, but I've since upgraded the destination machine and decided to switch back to Windows for regular desktop use. I've got Cygwin installed, and have verified that the same basic method (dd + nc) will work, but I can't do anything if Windows doesn't even consider the destination disk to exist.I only have one eSATA port on each machine. Opening them up just to do this clone is a rather large annoyance. Also, since this is my backup disk, I'd like to eventually automate the cloning from the active disk to another one that I regularly swap with a third disk that I store off-site.
View 1 Replies
View Related
Mar 30, 2010
OS: LINUX RHEL5
I want to resize the partition
for example..
my
/u01 is 50 gb.
/u02 is 30 gb.
i need to risize /u02 to 100gb( i have space left of around 60 gb and I need to take 10gb from /u01)
View 1 Replies
View Related
Nov 1, 2010
I accidentally formatted a 2TB drive of mine (big oops), but have recovered 2 of the 3 partitions using testdisk. My third partition is a LUKS encrypted partition. Testdisk managed to recover a piece of it, but it won't mount as most of it is unallocated. The partition originally occupied all space from sector 2,930,272,065 to the end of the disk -- sector 3,907,024,064. That is about 473 GBs. Currently, the partition only uses space from sector 2,930,272,065 to 2,930,288,129, about 7.84 MB.
The rest of the space is unallocated. Now what I need to do, is to expand the partition so that it occupies all the space that it used to. How would I do this? I cannot resize the partition, cause it would try to recreate the filesystem AFAIK and I don't want that, as it will fry my data. My data is not terribly important, but I would rather have it then not. I attached a screenie of kpartitionmanager. The partition in question is /dev/sdb2.
View 4 Replies
View Related
Oct 27, 2010
If I have an array which its size is based on the user input, from some material, I need to use malloc function to allocate memory for that array what is known dynamic array. Don't forget to free it.hat's fine, however, I like to try things out even I know the program will crash.I have written some test program on my Mac using C language like this:int width = 0;//get user input, and assign the input value to width, for example, 3char * array_var[width];and width is an int, its value will be assigned by the user input. The point is, this program work as expected, for example, in command line, I input 3, then array_var length is 3, its size is 3 * sizeof(char *).
View 1 Replies
View Related
Jul 12, 2010
I want interface any free data base software to fedora 12 version.
View 15 Replies
View Related
Aug 29, 2011
Please let me know how to delete/flush complete LDAP database ? I tried deleting all files from /var/openl dap- data. but still top level data base attributes remains.initially I had set shadowExpire,shadowFlag etc, I want to remove all these.Kindly help me to build my new database.
View 5 Replies
View Related
Mar 17, 2011
a client brought in an 160GB external HDD and wanted to get the files off it, there appeared to be no partitions on the disk but i thought it may have been formatted to use the whole disk. I tried to mount it as the various FS types the client thought it may have been to no avail.
I ran testdisk on it which told me that it previously had a mac partition table and a 210GB partition on it (which is larger than the disk) could anyone enlighten me as to whether or not this is even possible, and if so how could i retrieve the data?
View 2 Replies
View Related
Aug 2, 2010
i am new with ubuntu i need to know can i use ubuntu on a police car data base or department?
View 1 Replies
View Related
Jan 21, 2010
We know that, in a network, data transfer time is dependent on capacity of the receiving node. I have two Linux systems A (sender) and B (receiver) connected. I want to simulate congetion in a network, that means I want to increse the time taken to transfer some data. I believe, I can do this if I can reduce the capacity of the receiver node B. That perhaps possible by decreasing the receiving buffer size of B. How can I change the receiving buffer size of this linux system B?
View 1 Replies
View Related
Feb 21, 2011
When I run df command, the sum of free and used space doesn't tally up to total space. Now I found an explanation in this thread: URL...The amount of "reserved" space seems a little too high as OP of the thread had commented, but may be that's what needed. Now my question is is there a way to change/specify this amount of "reserved" space manually?Also is there a way where you can see the actual disk usage for every mounted partition including the hidden "reserved" space? Because sometimes this mismatch makes the output of df very confusing!
I am attaching output of df, and fdisk from my NFS server. The amount of reserved space seems to be close to 5% of the total partition size.
View 3 Replies
View Related
Aug 5, 2011
These following ext3 partitions contain identical data. As we can see, the larger the partition size, the more space is required for the same files:
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/loop11 3965777 561064 3199964 15% [...]
/dev/loop19 573029 543843 29186 95% [...]
[code]....
View 2 Replies
View Related
Sep 22, 2009
I have a router that is 1000 Base T and two computers each with ethernet cards that support 1000 Base T. All are equipped with Cat 5e cable. Before I had a router that only went up to 100 Base T and I would setup one box with linux running proftpd. On the other box,I would use win xp pro and use firefox to ftp into the other box and download a file. Download speeds went up to 11.2 MB/sec. Now when I switched routers, I expected something like 120 MB/sec but I'm only getting 5.3 MB/sec. What do I need to change?
View 12 Replies
View Related
Jul 2, 2011
I created the disk and now I would like to increase its size. I know I could add a new one, but I don't want to.
View 1 Replies
View Related
Jan 17, 2011
I use dd in its simplest form to clone a hard drive dd if=INPUT of=OUTPUT However, I read in the manpage that dd knows a blocksize parameter. I was wondering whether there is an optimal value for the blocksize parameter that will speed up the cloning procedure?
View 4 Replies
View Related
Jan 3, 2011
I'm new to Fedora 14, vmware player. After getting Fedora up and running in VMware player. The disk size was 2.7 GB. After three hours of working with it, the disk size has bloated to 4.3 GB. I havent added software to account for the near doubling in size. How do I reduce the size back to 2.7GB range or lower. Im new to Fedora and superuser controls. Im removing more software than adding software. Is this a VMWARE problem or Fedora problem?
View 1 Replies
View Related
May 22, 2011
I created a VM disk image with kvm-img, but I forget what was the max size of that disk image when I created it. Currently, its size is 6.2G, I want to install some large packages in that VM, so I want to make sure the disk image can expand to an adequate size.
View 1 Replies
View Related
May 11, 2011
I have one hard disk (call her HDA) that contains nothing but a single ext4 partition containing a backup of all my important data. Last night I did a clean install of Ubuntu 10.10 on my primary hard disk (call her HDB) and from there proceeded to upgrade directly to Ubuntu 11.04 upgrade. In 10.10, I was able to read HDA just fine. However after the upgrade, I can no longer mount this drive. When mounting from file browser:
Code:
Error mounting: mount: wrong fs type, bad option, bad superblock on /dev/sda,missing codepage or helper program, or other error In some cases useful info is found in syslog - try dmesg | tail or so The end of dmesg said the following:
Code:
dmesg | tail
[ 82.130904] EXT4-fs (sda): bad geometry: block count 122096646 exceeds size of device (122096381 blocks)
my hard disk has a block count greater than the size of my device. I've done my background searching on this and tried a command line utility I've never heard of before:
Code:
# sudo e2fsck /dev/sda
e2fsck 1.41.14 (22-Dec-2010)
The filesystem size (according to the superblock) is 122096646 blocks
The physical size of the device is 122096381 blocks
[code]....
this is as far as I've gotten. This drive holds over a decade's worth of work for me and is extremely valuable. I really didn't think that the Ubuntu upgrade process would mess with this drive, seeing as the Ubuntu install was contained on an entirely different drive. What is it that I need to do to restore my drive to working status?
View 9 Replies
View Related
Dec 23, 2010
I wonder if this is possible to extend or regrow the Linux hard disk partition from 8 GB to 20 GB without losing the existing data on the partition ?at the moment this Ubuntu Linux is deployed on top of VMware and I've just regrow the hard drive from 8 GB into 20 GB but can't see the effect immediately.can anyone suggest how to do this without losing the data ?
View 9 Replies
View Related
Jan 20, 2010
I have set up squid server. My cache directory has been set up as per following statements.cache_dir ufs /Cache1/squid 10000 16 256cache_dir ufs /Cache2/squid 10000 16 256Now the problem is that size of /Cache1 and /Cache2 has reached to about 8GB and in near future it will reach the maximum limit of 10GB. I just want to know that whether I need to delete the contents of these directories or otherwise.
View 1 Replies
View Related
Jan 14, 2011
I went and fdisk'd a USB disk and put the Fat32 filesystem onto it. Then I thought I ran dosfsck over it which I thort formatted the disk - apparently not. Then I copied a bunch of files and directories to it. Now I am unable to recover the files and data. In the rare instances when I perform a sloppy mount I see directories named 001, 002, 003 and 004. These directories variously contain files named 001, 002, 004 (no 003) etc.
Fdisk gives me:
I don't know enough to use dd, kpartx, parted, partmon, partprobe, partx et al
View 1 Replies
View Related
Jan 26, 2010
I've got a CentOS 5.4 box and the following disks connected:
# parted /dev/sda print
Model: ATA WDC WD1600BEKT-0 (scsi)
Disk /dev/sda: 160GB
Sector size (logical/physical): 512B/512B
Partition Table: msdos
Number Start End Size Type File system Flags
1 32.3kB 107MB 107MB primary ext3 boot
2 107MB 160GB 160GB primary lvm
# parted /dev/sdb print
Model: ATA WDC WD1200BEVT-0 (scsi)
Disk /dev/sdb: 120GB
Sector size (logical/physical): 512B/512B
Partition Table: msdos
Number Start End Size Type File system Flags
1 32.3kB 107MB 107MB primary ext3 boot
2 107MB 120GB 120GB primary ext3 lvm
the OS, data and programs are on /dev/sda.
I'd like to copy the full directories and files to the newly added /dev/sdb wich has, as you can see, less space. Also note that /dev/sda has only about 3.6Gigs uses, so it will no doubt easily go into /dev/sdb. How can I do the full copy, and yet make /dev/sdb bootable just like /dev/sda (just as if it was cloned by Ghost)? I've checked dd, but AFAIK, it needs that both source and target devices be the same in size.
View 1 Replies
View Related
Oct 1, 2010
Need reasons why the unit of cache swapping is called a line rather than a page ?
View 4 Replies
View Related
May 3, 2010
I have installed on my computer Solaris10 (64bit version), PCBSD8 (64bit) on 2 primary partitions and 7 Linux distributions (Redhat,Debian,OpenSuse,Fedora,LinuxMint,Slackware,Ubuntu) on the extended partition. I know this might be a stupid question, but here it goes: I have a problem with my actual power supply unit (the fan doesn't work as it should) and I will change it soon. Is there a problem with any of the Linux distributions if I change my power supply unit? I mean, will the Linux operating systems work properly with a new power supply unit or do I have to reinstall all Linux distributions?
View 4 Replies
View Related
Nov 19, 2008
Is there a open-source data protection management tool that anyone knows about and/or can recommend?
View 1 Replies
View Related
Jan 16, 2010
I cannot find what my hard drive size is and need to know what size is my Ram.
View 4 Replies
View Related
Apr 20, 2010
can we find logarithm to base 10 instead of base 2 on shell script??i can do it with bc..like 'l(1000)/l(10)' | bc -l
View 1 Replies
View Related
Aug 9, 2010
Risk to native OS from Live CD?
when booted from linux live cd, all partitions of hard disk become accessible without any restriction. How to block this?
View 2 Replies
View Related