Server :: 2 Tier File Synchronization (block Based, Possibly Cluster FS)
Oct 25, 2010
I'm looking for a write one, read many file synchronization, file system or similar technique. In fact I want a to imitate a zfs_send/zfs_receive similar behaviour on Linux. My requirements are pure local (or in terms of distributed file systems: rack-aware) file handling with remote synchronization. Some random features/requirements I want to achieve are (I use the terms file and "file system" here interchangeable, as I don't care wheter I have to synchronize file based or use full file system supporting that):
Access on files from a specific host is pure local, i.e. the node has a full copy of a file, no parts are distributed. Read and write access is local, the remote side gets synchronized with write changes only Write changes on the remote side are non-blocking and asynchronous No need for concurrent file access, concurrent, distributed locking and so on Every file is changed by a single node only, other nodes have read access The file "owner", thus the node allowed to write files must be changeable Similar techniques (some as technology concept, not usable for me) exist, among those DRBD, MySQL Replication or even pure rsync.
I don't care whether I'm referring to a pure local solution (i.e. between two block devices) or a client/server mode. DRBD won't fit because its a peer to peer solution, I need to synchronize a lot of clients with a central storage through that way where DRBD just mirrors from peer to peer among two nodes and doesn't allow another node to take over the role of the primary node (i.e. node A is master, storage B secondary, I want to change to a thrid node C which becomes master and receives hence a full update from storage B.
Just as a guess, I'd make a local LVM volume on every node where write access happens. In the same time there exists a iSCSI target with multipath to a remote hosts which is shared with every node, again providing a clustered LVM. So I'd need to synchronize a local LVM volume with a remote LVM image. The question is just by which technique I could achieve that (i.e. as RAID 0, where every read and write goes to one node only and doesn't wait the other node to succeed). I could achieve this with rsync by a cyclic push to the remote host, but the problem is, that rsync isn't block based thus I'd need to synchronize every time the whole file, not only changes.
View 2 Replies
ADVERTISEMENT
Mar 15, 2011
I'm having a very strange problem with red hat cluster. After testing it in the lab, I tried to install a new cluster and received the following error: cman not started: Cannot start, cluster name is too long or other CCS error /usr/sbin/cman_tool: aisexec daemon didn't start I've checked the internet for that error, but nothing. I decided to to take the example from cluster.conf man, which looks like that :
[Code]...
And still I get the same error. I can find my servers both from DNS (FQDN and short name) and they also appear in /etc/hosts.
View 3 Replies
View Related
Feb 19, 2010
Posted in wrong section. Moved to Linux Servers Forum.
View 2 Replies
View Related
Jun 27, 2010
I need to setup an linux cluster ..so i prefer ubuntu because of support and i personally i use ubuntu.. and can any one explain in breif ..what all the things needed to setup an ubuntu based cluster my configuration for each node will be (totally 6 nodes) core2 duo with 4 gb ram i need 4 nodes and 2 for load balancing..
View 1 Replies
View Related
Sep 3, 2010
configure a separate NIC for the heartbeat. what i need to add to cluster.conf to achieve this?
View 1 Replies
View Related
Jun 12, 2011
build a cluster within local network based on opensuse and fedora?
View 2 Replies
View Related
Jan 17, 2011
I want to have 1-tier client/server architecture using ubuntu edition. I have no idea how to proceed. I have many doubts:1. Which Ubuntu edition will be used i.e. desktop or server? 2. Which manual/book(s)/paper will best describe to proceed further?
View 4 Replies
View Related
Jul 16, 2010
I am working on a NFS server embedded on a PowerPC plateform (4650EX, 512Ram, 1 GB Ethernet) but i can't mount my exports folders from my client. Here are messages :
[Code]...
View 2 Replies
View Related
Jun 8, 2010
I am trying to do the cluster storage with the Rock Cluster storage operating system . I have install the rock cluster on the main server . and I want to connect the client with the PXE boot . when I starting the client then it boot from the PXE boot into the mode of compute node. but it ask the where is to be stored the I have give the path..then server says that not able to find the directory path.
Steps:-
1) insert-ethers
2) client is started with the PXE boot.
3) it detects the dhcp .
4) At last it demand where is to be started by cd-rom, harddisk ,nfs etc.
then I started with the nfs and I have given the lanIp of server.and server is detecting the client but client is not finding the filesystem directory. into export partition directory but it is not taking path.
PATH:-
/export/rock/install it is not finding this path then it is not able to start the o/s from PXE boot..Is there any solution and manual of rock or anyother solution then u can reply to me...
View 3 Replies
View Related
Jun 23, 2011
i keep receiving this damn annoying spam: Quote: No Cost Website Analysis and Ranking Report Rank mysite.com at the top of the 3 major search engines Do you want to know why your competitors are showing up at the top of the three major search engines and how you can rank on top? To increase the number of visitors to your website it is crucial that you have a top search engine position. If you are like most people, you will spend countless hours trying to get traffic to your website.
Our search engine optimization experts will run a detailed website ranking and analysis report showing you exactly where mysite.com currently stands in all the major search engines along with the recommendations of how we can increase your ranking on Google, Yahoo and Bing. For Your No Cost Analysis Report and More Info Please Click Here
[Code]...
i get about 30 of those a day, everyday, for a long time. ive asked the ISP to stop it (theplanet.com) they are not responding and the spam continues. i was thinking is there a way that i can tell postfix to reject emails that contain "No Cost Website Analysis and Ranking Report" in their subject? there must be a way but i dont know how.
View 4 Replies
View Related
Sep 13, 2010
for a while I?ve seen hundreds of attempts via ssh against my system. They finally stop and this could mean only two things my security measures are working "NOT" or they actually got in. In any case browsing around my system for suspicious changes I found a file"agent.4015" on my tmp folder. This file denies read privileges to root and I?m afraid to chmod until I know for sure what it is.
View 4 Replies
View Related
Jan 22, 2010
I have started ntpd service with chkconfig ntpd on .When i execute : ntpdate 0.pool.ntp.org , then i get error :
No suitable server for synchronization .
View 1 Replies
View Related
Jun 28, 2010
Currently have multiple small DNS-323 NAS-in-a-box that need to be replaced with a single storage server.
Since the setting is for an advanced home server (2-3 simultaneous clients max) that will hold movies and application/game ISO's, I was originally going to go with a simple RAID6 on freenas. As I learned about silent data corruption, and with a max of 3 simultaneous users, I don't see a need for a hardware raid processor. So I gathered that software RAIDZ (RAIDZ2) based on ZFS or BTRFS that prevent silent data corruption would be a better match (please correct me if I am wrong).
NEEDS: The needs (in addition to prevention of silent data corruption) are basically online capacity expansion (OCE), and 2+TB volumes (64bit LBA); with a preference for the ability to spin down idle drives. I'm going to make the assumption that any solution I go with will allow me to read/monitor actual SMART drive data.
STUMBLING BLOCK(S):
1. Would someone validate the (perhaps mistaken) assumption that since BTRFS is integrated into the latest Linux kernel, it is mature enough for NAS candidacy.
2. Please validate: Forward-compatibility of BTRFS has been stated (no need to reformat with subsequent BTRFS updates).
3. Am I missing any NAS software (open-source or otherwise) that would meet these requirements and provide a nice pretty graphical interface?
4. What software solution would you recommend? (btrfs on xxxxx? zfs-fuse? linux+xfs (+mdadm)? ..?)
5. What are my next steps?
Accumulated hardware for project:
SERVER: 3u chassis with 16hot swap trays. Tyan S5360G2NR i7520 mainboard. Single Intel 2.8Ghz CPU (dual-capable). 4GB ECC RAM (do i need more?). Dual hot-swappable 550W psu. CD-ROM
DRIVES: Eight 1.5Tb SATA drives, plus an additional four that are in-use in the DNS323 that I will migrate over using OCE. Four 750 SATA drives that are also in-use and can be migrated over via OCE. One 16Gb SATA SSD, intended for Boot OS and logs.
INTERFACE CARDS: Two 3Ware Escalade 9500S-8 8Port SATA RAID (PCI-X, 64bit) [can change these to something else].
UPS: 1500VA
View 3 Replies
View Related
May 18, 2010
i had tried several restrict options and disabling the slackware "no serve to anyone" default. i want the slackware system to host the ntp server for other devices to sync with so im not so hard on the remote ntp servers.
Code:
# Sample /etc/ntp.conf: Configuration file for ntpd.
#
[code]....
View 3 Replies
View Related
Mar 29, 2011
i need to make an file server.but I'm not gonna ask how because that's a piece of pie.The thing is i need to make an ubuntu/xubuntu based file server.For windows users.But not just a regular file server. A File Server with accounts. That when you try to access the file server in explorer you need to provide a username and password.And that you( as the administrator) manage the privileges for the server/folder/file. so with different permissions.
View 4 Replies
View Related
Mar 29, 2011
I am having a situation with an NTPD server.
Code:
remote refid st t when poll reach delay offset jitter
plesk2.datacent .INIT. 16 u - 64 0 0.000 0.000 0.000
91.198.87.118.b .INIT. 16 u - 64 0 0.000 0.000 0.000
core.fr.zeroloo .INIT. 16 u - 64 0 0.000 0.000 0.000
178-26-105-100- .INIT. 16 u - 64 0 0.000 0.000 0.000
and it remains so no matter how long I wait...
Hoping to get better results with ntpdate, I stopped NTPS and tried :
Code:
# ntpdate ntp.skynet.be
29 Mar 09:12:26 ntpdate[4715]: no server suitable for synchronization found
# ntpdate -ud ntp.skynet.be
29 Mar 09:14:02 ntpdate[4814]: ntpdate 4.2.4p4@1.1520-o Sun Nov 22 16:14:35 UTC 2009 (1)
transmit(195.13.23.5)
receive(195.13.23.5) .....
I am running Debian Lenny 64b, and every packages are totally updated. I have 25 identical servers. And there is just one giving me this problem. From what I see, it is not a connection/FW issue since ntpdate get replies from the ntp server (ntp.skynet.be is my isp's stratum 2 ntp server).
View 14 Replies
View Related
Jan 8, 2010
I cant get ntpd to synchronize with the ntp servers. I have a CentOS 5.3 32 bit Virtual Machine. I'm in USA on Pacific Standard Time. Here's all configuration and other important information for troubleshooting. Is there anything wrong with my config? btw, I used wireshark to look at the UDP packets - I dont get any responses from any of the servers back. I only see requests going out from my server, but no response. Is this a firewall Issue? If it is, then do I need to just enable UDP port 123 on the firewall?
[Code]...
View 4 Replies
View Related
Sep 24, 2010
Time synchronization with ntp 3 mins delay from client and server
View 4 Replies
View Related
Jan 9, 2011
Im trying to install a trading program fx trading station II on a dedicated virtual server that's linux based at media temple. Any ideas on how to run the program so that the exe file isn't prompting to download the file instead of prompting the user to login and trade?
View 2 Replies
View Related
Nov 2, 2010
I can't update my ubuntu clock with my server. If i run the command ntpdate domain.local, it gives me this erro (no server suitable for synchronization found) if i run the command nslookup domain.local it works well and found my server
View 3 Replies
View Related
Nov 6, 2010
I am trying to build GFS2 cluster with 2 or 3 Fedora 14 nodes, but I've encountered some problems from the start. First luci does not work at all in Fedora 14. There is no luci_admin and even if I manage to start luci service, I get a blank white screen when I try to open it from the browser. I've googled a bit and found that I'd might be able to setup GFS if I manage to build cluster.conf manually and start the cluster suite, but I cannot find documentation on how to create cluster.conf anywhere. If anyone knows how to setup GFS2 without a cluster suite or how to configure cluster.conf.
View 9 Replies
View Related
Sep 1, 2011
I am working in a project that needs to set up an Apache Web Cluster. The cluster needs to be High-availability (HA) cluster and Load-balancing cluster. Someone mentioned the use of Red Hat Cluster Suite, but, honestly, I can't figure out how it works, I haven't been able to configure it correctly. The project currently have two nodes, but we need to support at least three nodes in the cluster.
View 5 Replies
View Related
Mar 2, 2011
is possible to edited the default RHEL CD to have it automatically install RHEL based off of a kickstart file that I will store locally on the CD. My plan would be to put a cd in a server and have the OS automatically being installed.
View 3 Replies
View Related
Oct 21, 2010
Does anyone have any experience with clustering KVM? I know how to do this for Xen, but I would like to know if it can also be accomplished with KVM. I am looking for a solution that is not specific for a distro.
View 3 Replies
View Related
May 13, 2011
Can a Cluster, made up of 5 Dell Poweredge computers, each with a NIC and a HDD, be a file-server that is highly available? If I go over, and break one of the computers with a sledgehammer, will the cluster continue to operate without data loss?Goes on to say how fancy the cluster is,
View 3 Replies
View Related
Jan 26, 2010
I've tried many, many different ways of setting up the cluster.conf file, but every time I start the cman service I get a message telling me "corosync died: could not read cluster configuration".This means nothing to me, nor can I find logs, or anything on the net about this message. I'm ultimately just trying to run a simple GFS2 config on 2 Ubuntu 9.10 desktop nodes, but I can't even get a basic cluster config going.What am I missing? I've been at this for days.
Code:
<cluster name="example" config_version="1">
<clusternodes>
[code]...
View 3 Replies
View Related
Dec 18, 2009
I put together a 3 PC cluster approx. 6 years ago with Redhat, at that time I was in Grad. School. Now I am in a small company and we are planning to go for a cluster setup. I have chosen to go with Centos5.
The last time around I used NFS, RSH etc. for file sharing, communication etc. Would it be OK for me to go with the same stuff or some new software/technology has come in.
The Centos cluster setup is for high-performance computing.
View 1 Replies
View Related
Feb 8, 2010
When using cssh, I define some cluster tags in my local .csshrc file. Other parameters seem to be picked up by cssh, but the tags are not.I have no /etc/clusters or /etc/csshrc files. I create a fresh, default .csshrc file and append a line like:myhost = frodoWhen executing "cssh myhost", I get: Can't call method "name" on an undefined value at /usr/bin/cssh line 988This is the same message I get if I make up some destination, like: "cssh doesnotexist". So it looks like rather than picking up the tag "myhost" from .csshrc, and translating the command to "cssh frodo", it does a dns lookup on myhost.I've tried making a /etc/csshrc file like this (but without the equal sign), but that doesn't work either. This is all on Ubuntu 9.10 with cssh version 273.
View 1 Replies
View Related
Jan 15, 2010
I have a Linux (Kubuntu) system with a large (~20Gb) file which I would like to mess with. Specifically, I want to copy the entire contents of another large file (~12Gb) to the middle of this file, and keep the bits of the file which are not overwritten.This is what I want to happen, with the text between the pipes representing file contents:Before:
outfile: |abcdefghijklmnopqrstuvwxyz|
infile: |123456789|
After:
[code]....
View 1 Replies
View Related
Oct 10, 2010
I wanted to know how to cluster linux server. I mean any squid proxy server or apache server cluster or any other service, but I just wanted to know how to do cluster in linux. I have been searching it but there is no hope.
View 4 Replies
View Related