Networking :: Distributed File Systems
Jan 21, 2010
Last year I was looking into fault-tolerant distributed file systems and I recall one kernel-based system that required a physical partition on each machine in the cluster, but would treat it as a single volume - ie. a write on one server would appear on the disk on all the servers.Unfortunately I didn't bookmark the specific system I was looking at, and now a year later I can't remember the details.What I don't want is NFS - a single file server with a file system mounted on various machines. What I do want is mirroring - one disk shared among multiple servers, so that if one server dies, it doesn't make any difference to the rest of them.
A bit of investigation turned up Red Hat's GFS, which kind of looks like what I want, but looks more and more like an NFS model to me. I was wondering what everyone's opinion of the various options out there were.
View 3 Replies
ADVERTISEMENT
Apr 30, 2011
I'm built an distributed application, and now I want to take some metrics to show how my application works. These metrics includes the time of computation, the time of communication and the amdhal law. I would like to know what tests can be done to show the performance of the application. So, I'm searching for a book or document that shows me what type of tests can be done to show the performance of an application.
View 2 Replies
View Related
Apr 30, 2010
I'm trying to understand how deb packages work. Are there source debs?I assumed there were, but from[URL].. I see that source is distributed in a GZipped file.
View 3 Replies
View Related
Oct 6, 2009
is there a way to set-up a file system, where you have multiple nodes (PC's) linked to one storage pool? ZFS seems to support this idea with multiple disks on one node, but could you connect multiple nodes in this manner?
View 3 Replies
View Related
Jun 17, 2011
I am currently looking for a file system that needs to be distributed over several nodes and need redundancy, like RAID5, and the ability to grow if needed, like LVM. Also not all nodes are going to be located in the same data center, but I guess that's not that important as long as the connection between DCs is sufficiently fast. I am currently looking at AFS, Coda, GFS and OCFS to see if they have what I need.
Edit: I just figured that it may be better to have the RAID5-like setup within one location, and have RAID1-like mirroring between the locations. That would probably better for performance, right?
View 2 Replies
View Related
May 26, 2010
I have fedora12 on two pc's, i want to share some files between them which i was not able to do with nfs, so let me know the whole procedure to do that n also let me know where my shared files will be visible
View 10 Replies
View Related
Aug 25, 2010
I have gotten my DNS servers up and running, and query against them using dig returns the proper information. How do I get the information to be distributed across the Internet now?
View 1 Replies
View Related
Dec 19, 2010
if this a simple question I apologise, I'm using a SSH connection to a remote machine which also has ubuntu installed, my remote machine is connected to a windows server, using <places> <Network> and clicking on the server, doing this mounts the server into my remote file systemWhen i look around the file system of the remote machine i'm unable to make the windows server resource available to me.I Assume it has a service file in the /dev directory, but would not know what its called or what i would have to do with it.In the mean time i've managed to connect directily to the server from my local machine, (which is probbialy a better solution) but is it possible to see the server via my remate machine?
View 4 Replies
View Related
Aug 4, 2009
I'm using a program on a group of servers which contact each other using SSH. I've got the authentication keys setup with no password but when one box tries to connect to another it wants the password for the user it's trying to communicate with. So the main problem is there is a lot of communicating within this program so it's important to allow each box communicate with each other without the use of a password. I'm using OpenSSH 4.3 with OpenSSL 0.9.8 on Red Hat Enterprise Linux Server 5.3 (Tikanga). I'm also using SSH on Ubuntu(Intrepid) to connect to these servers at the mo as i don't have direct access to the boxes.
View 4 Replies
View Related
Jun 16, 2011
Paths displayed in Nautilus appear to be just that. Nautilus private syntax. Esp with respect to anything "special". Apparently when you hand a path like this to a program to open, you get a folder in your home directory: smb://cyberstorm/c_drive/
At least that is what my program does with it. A folder called smb: in my home directory. Probably because the default folder for the program is the home directory [~]. Is there a universal network folder syntax for the network and other "special" file systems?
I see things like: network:/// and computer:/// showing up in "properties" dialogs for some things. But these are useless to a program apparently.
At least a program written in Qt. Is this a Qt problem, or a problem with Ubuntu not yet making the network a first class citizen in the world of paths? Who do I complain to? Time for the network to be a first class citizen, right?
View 9 Replies
View Related
Oct 21, 2010
I have 2 different mounts. One points to a local windows share(NTFS ->Samba) and the other one points to a PPTP VPN connection sharing(I belive that is NTFS too). I use "cifs" scheme in my fstab to mount these. And I use my Debian box to copy between these 2 mounts. I have started using Rsync for that purpose, I think that it works fine for now. My main problem is that it looks like Rsync cannot figure out if the files are same or not in source and target folders when I use these mounts. Most of the time Rsync copies the same files and folders over and over again even though those files and folders are on the target.
I am wondering if there is a way to make this scheme work? Being on a Vpn connection(slow) a Windows box, Rsync could have save a lot of my time if it could have recognized the files and folders that are same on both ends
View 4 Replies
View Related
Jan 29, 2011
How to get the permissions of any file systems
---------------------------------------------------
what does it mean?
"permission denied while opening filesystem"
through commands can we give/get permissions of file systems
View 4 Replies
View Related
Jan 31, 2011
during the boot process mounting other file systems takes a while. Although it ends up resulting [OK] it was not like this before and it used to be was very fast. I took a look at /etc/fstab file which is posted below, and suspected that devpts is the problem. So I commented it out and reboot, but it wasn't helpful.
[Code]...
View 5 Replies
View Related
Jun 22, 2011
After an update recently I noticed that my process count jumped up quite a bit. Somehow it doesn't seem related (it was an apt update I believe), but I'll just throw it out there. All of the extra processes seem to be related to XFS and JFS file system kernel processes, but none of my file systems use XFS nor JFS, just EXT3 & EXT4. Is there any safe/easy way to kill off these processes and prevent them from re-spawning? I don't find having irrelevant idle processes to be beneficial nor efficient. It's using Ubuntu 10.04 64-bit. Only active file systems are EXT4 and EXT3.
[Code]...
View 2 Replies
View Related
Nov 22, 2010
and also I need to find answers for following two questions.How to find mountable devices and their device files in Linux?How can I allow a regular user to mount a device in Linux?
View 2 Replies
View Related
Oct 5, 2010
I'm familiar with the software and hierarchy of the mount command but I can't find any info on why it is needed or preferred. What are the physical aspects of it? What is the burden of having files accessible all the time?
View 14 Replies
View Related
Jul 23, 2009
I was wondering if it was possible to hide the File Systems from a user. So when then browse through folders or choose to save something the default folder is their "home" folder. I am using SAM Linux distribution and don't want my users to be able to screw anything up! I use thunar as my file manager and was just wondering if it is possible?
View 12 Replies
View Related
Apr 29, 2011
I have to move files between two file systems /inst and /inst2.When I perform 'cp -a /inst /inst2' it copies everything even hidden files and preserves access permissions.But when I perform 'mv /inst /inst2' it also preserves access perms and moves everything besides hidden files.Questions :hy is so ?What tool to use when moving file systems from one fs to another (rsync) ?
View 8 Replies
View Related
Jun 19, 2010
I have 3 linux systems configured for running applications in each, named system1, system2 and system3. I have around 100 GB of space in system3 under /usr but not much being used. In System1 very less space is there but mostly hits coming here and need to have proper backup, as the system1 is quite old and not planned partitons properly. So I want to use a disk having more space for backup requirements.
View 17 Replies
View Related
Apr 30, 2011
We have upgraded CentOS release 5.6 (Final) with 2.6.18-238.9.1.el5 kernel. After the reboot all configuration files under /etc became READONLY. my file system's still in rw mode.code...
View 2 Replies
View Related
Jan 1, 2010
This post is not to ask for help, but rather to document my recent effort to downgrade my ext4 file systems to ext3 file systems. I don't know if it'll help anyone, but here it is anyway, fwiw.I am running ubuntu 9.10 on an older Dell GX-270, and had formatted my partitions with ext4 file systems. I began to notice partimage wasn't backing up my ext4 file systems and I decided to downgrade to ext3 file systems.My system has one 160GB drive and one 500GB drive. I also have an external usb2 500GB drive./home is on the internal 500GB drive. To convert it, I mounted an ntfs file system on the external drive, created a container file, put a file system on it, and mounted the container as a linux file system.
The backup was done done via rsync. rsync makes things really easy. It understands uids, gids, file permissions, and all kinds of links. That's one reason I created the container file on my external drive. NTFS doesn't understand uids gids, linux file permissions, or linux style links.
View 1 Replies
View Related
Mar 23, 2011
I have more than 60 ubuntu systems in my network. I want to copy files from one system to other ubuntu systems. All IP addresses are listed in a text file. So what command can I use to complete the task?
View 6 Replies
View Related
Sep 29, 2010
iv been looking around at the different Linux systems particularity the smaller ones such as DSL, Slax and Puppy Linux. However i need a Linux distribution that doesn't have a GUI desktop environment just the plain old terminal to work on. The system would have to be able to boot from a USB drive also. If anyone knows a systems that fits those requirements or something else related please post. Also what file system is best for USB drives for booting systems?
View 4 Replies
View Related
Jan 14, 2010
We recently had an issue with "cat /proc/mount" telling us that a CIFS file system was mounted, even though the mount was not working correctly. So we're not sure if we can trust linux to report malfunctioning mounts, so we're planning on adding a specific file on the mounted file system, and verify the mount by reading this file from the client side (linux). If linux fails to read it, we know that the mount have failed. But before we go ahead doing this I thought I'd just hear how others are doing this sort of thing - how do you make sure that mount points are up and working?
- kenneho
EDIT: I just saw that I've posted in the security area, not in the server area. How do I move it?
View 6 Replies
View Related
Oct 5, 2010
after reading a lot I was finally able to run the upgrade interface (no more root errors) but I get a new error:"You need mor espace on the following file systems:346M on On / I have 760mb free. I dont know what else to do to install, I though I just needed 250mb to upgrade. Post added at 08:37 PM CDT Previous post was at 07:20 PM CDT Well after unistalling a lot of apps I managed to free 900mb in total.I dont know why my / is so full, I arranged a 9gb for it, and apparently I need more space, Im not using it more than sharing and downloading files, some hosting (nothing right now). How can I now what is getting so much space? Or maybe is the hole update process, from 8 to 11 and now from 11 to 13...
View 1 Replies
View Related
Aug 13, 2010
What limits a file to have some maximum size depending on the Operating System? I do not exactly understand this. If you have the storage space, what else can be the limitation? You should be able to store as much data as you want the way you want (even in a single file) unless you run out of storage space.
View 5 Replies
View Related
Apr 10, 2011
One of the good points of linux is that is easy to customize the partitioning scheme of the disk and put each directory (/home, /var, etc) in diferent partitions and/or diferent disk. Then we can use diferen file system/configurations for each of them for make them better. xamples:
noatime is a mount option to not write access time on the files. data=writeback is an option to layz write metadata on new files. ext3/4 has journaling that make the partition more secure in case of a crash. bigger blocks make the partition waste more space, but make it faster to read and may become more fragmented. (not sure) Then: What are the best filesystem/configurations for each directory? Note: given the answer of Patches, will only discuss /, /home and /var only.
/var -> It's modified constantly, it write logs, cache, temporal, etc.
/home -> stores important files.
/-> stores everything else (/etc and /usr should be here)
View 1 Replies
View Related
Apr 28, 2011
Back in the old days of PC-DOS 3.1, computers are much simpler than today's. I can learn a lot of how File System works with tools like PCTools, Norton Disk Doctor, and [URL]. Have been working exclusive in corporate database application area for over a decade, my knowledge of how these stuff work is diminishing. Standard-clean OS (Windows, Linux) installation is all I can do now. And it starts to cause me many data-loss troubles, when I have to perform something that I don't have much insight, such as install and remove peer linux os or move and resize partitions.
I'm looking for books, web resources, or communities where I can educate myself on how various file system works, for which I can have in-depth answer to questions such as:
How to remove ubuntu and grub2 ? (I recently did that, but with a lot of frustration when I was not really sure what I was doing and confront with some scary error message like "Missing BootMgr" What kind of disk-partitioning operation can be performed non-destructively, and why ? What is Active partition ? Primary Parition ? Extended Partition ? How it stored on the disk. There are many free partitioning tools out there, which one is safe to used ? NTFS, Ext3, Ext4, .. What the differences ? How to choose it wisely.
View 2 Replies
View Related
Aug 1, 2010
so here's what i want to do. I have a harddrive with Ubuntu 10.04 on it, the biggest partition is a 242gb ext3 partition. I want to format a part of that to FAT, without loosing any data from the hard drive.Is this possible?
View 4 Replies
View Related
Mar 12, 2011
I have noticed the (understandable) tendency of new Linux users to think about disk drives in the 'Windows way'; their first thought is to exchange a new drive for an existing one, rather than combine both drives for a larger 'file system'.
There are times when replacing one drive with another is indeed the correct action (aging drive, failing drive, slow drive, etc). But in other cases it may be preferable to use the inherent strength of the fstab (file system table) file to combine physical drives to become a larger 'file system'.
Lets first look at a user with an 8 gig netbook who is running out of space. Rather than replace the 8 gig flash drive with a 32 gig device, the old and new devices can be combined to yield a 40 gig 'file system':
This same principle can be applied to a user with a computer using an 80 gig hard drive, and who 'adds' a new 320 gig drive instead of replacing the 80 gig drive with the 320 gig drive:
This same principle can also be applied to building a massive 'file system' without the requirement of using RAID:
The above 12 terabyte system can be built using a basic motherboard with four open SATA ports and four 3tb hard drives. No server based equipment is needed; no raid hardware or software is required. This is just something that Linux does (and does very well).
View 2 Replies
View Related
