Fedora Servers :: Creating A Web Caching Server For Myself
Feb 12, 2009
I am looking into creating a web caching server for myself using fedora 10. I believe I need to use squid for this but it seems to have a lot of features. Basically, all I want for now is to be able to cache web pages that I and my network users use the most, increasing access time and lowering the load on my internet connection. Can squid do this and can someone point in the right direction on an article on how to configure such a thing?
View 5 Replies
ADVERTISEMENT
Sep 5, 2009
I've set up a caching nameserver on my laptop running Fedora 11. The problem with this is that NetworkManager always overwrites the entry that points to the local nameserver. NetworkManager no longer respects /etc/dhclient.conf or at least its scripts run after dhclient.conf. Also it doesn't respect /etc/sysconfig/ network-scripts/ifcfg-* setting of DNS{1.2}.The man page of NetworkManager describes scripts that run in /etc/NetworkManager/dispatcher.d which can be run when interfaces are brought up and down. I've written a script that will put the entry needed for the local nameserver.
View 1 Replies
View Related
Jan 25, 2011
I will be relocating to a permanent residence sometime in the next year or two. I've recently begun thinking about the best way to implement a home-based network. It occurred to me that the most elegant solution might be the use of VM technology to eliminate as much hardware and wiring as possible.My thinking is this: Install a multi-core system and configure it to run several VMs, one each for a firewall, a caching proxy server, a mail server, a web server. Additionally, I would like to run 2-4 VMs as remote (RDP)workstations, using diskless workstations to boot the VMs over powerline ethernet.The latest powerline technology (available later this year) will allow multiple devices on a residential circuit operating at near gigabit speed, just like legacy wired networks.
In theory, the above would allow me to consolidate everything but the disklessworkstations on a single server and eliminate all wired (and wireless) connections except the broadband connection to the Internet and the cabling to the nearest power outlets. It appears technically possible, but I'm not sure about the various virtual connections among VMs. In theory, each VM should be able to communicate with the other as if it was on the same network via the server data bus, but what about setting up firewall zones? Any internal I/O bandwidth bottlenecks? Any other potential "gotchas", caveats, issues? (Other than the obvious requirement of having enough CPU and RAM).Any thoughts or observations welcome, especially if they are from real world experience in a VM environment. BTW--in case you're wondering why I'm posting here, it's because I run Debian on all my workstations/servers (running VirtualBox as a VM for Windows XP on one workstation).
View 14 Replies
View Related
Feb 17, 2010
How do i exclude some URL from the proxy caching at squid.conf as i dont wont to cache ....., mediacafe etc, I know i can block site by create a file like bad-sites.acl, then adding it to squid.conf but that blocks it.
View 2 Replies
View Related
Oct 21, 2010
What is the recommended filesystem to use when creating a home server/nas?
I'd be sharing files using SAMBA, DLNA Server or some sort of streaming. I'll have two win7 laptops, 2 ubuntu desktops and ps3 accessing the files. Most of the time the server will just 75% read from 25% writing.
Would ext4 be an ideal?
View 4 Replies
View Related
Sep 25, 2009
I am trying to setup a Caching-Name Server for my lab but I am unable to locate the named.caching-nameserver.conf under /etc directory. I am trying to use this file as a template.I already checked the /usr/share/doc/bind-* for samples but unable to find it.I am using RHEL5 with bind and bind-chroot packages installed.
Can someone tell me where I can find named.caching-nameserver.conf file? Also, I notice that there isn't /etc/named symbolic link... do I have to create the sym link to /var/named/chroot/etc/bind.conf
View 4 Replies
View Related
Oct 4, 2010
I have configured Master and Slave DNS server in Red Hat Linux 4 Enterprise. I want to know about what is a Caching Nameserver and in which situation we use it? If there is a master and slave DNS server we can use cache name server as well ?
View 7 Replies
View Related
Feb 25, 2010
I found in the following mail thread: [URL] That we can add, netgroup: caching compat and also the netgroup caching rules stanza in nscd.conf But the mail thread is for FreeBSD Unfortunately, I can't get any reference for RHEL 5.x I need to do exactly same stuff. The following line in my nscd.conf was enuf to leave me disheartened, :'(# Currently supported cache names (services): passwd, group,hosts The nsswitch.conf on my system works only with following: netgroup: nis Does neone knows if netgroup caching is supported by nscd.conf.
View 1 Replies
View Related
Sep 16, 2009
I'm putting a server together and have run into a boot up problem. (I thought about putting this in the server forum, but it might be a more generic problem that others have seen and know how to rectify.) The install seems to have gone just fine. I have the /boot partition on an internal IDE drive. The rest of that drive and another are mirrored in a Raid0 configuration (using the Linux software to do that) for data storage. The swap partition is a part of the Raid5 SCSI array that also has the / (root) partition on it.
After installation it would not finish the booting process. I suspected that GRUB didn't like all the Raid arrays and such, but it seems to be fine. I can say that because the machine will boot into rescue mode with the GUI splash screen and I have access to the whole directory tree. I have already searched on-line and following prudent advice, ran the yum update while in the chroot /mnt/sysimage mode. That only took overnight to download and most of this morning to complete. Still no dice. Used vim to delete the rhgb quiet commands in the grub.conf file so I could see where the kernel seems to be hanging.
So right after the "Creating initial device nodes" is a line about my generic PS2 wheel mouse. So I tried a USB mouse. Got more output so tried swapping out to a USB keyboard. Got a little further with more information about input devices, but still stops. Also, I tried a PCI video card just to make sure the onboard video wasn't the problem - no change. So, if someone in the Fedora community knows what loads up or is configured right after the mouse and keyboard, I might be able to figure out what's causing the computer to hang during the boot process.
View 2 Replies
View Related
Feb 28, 2010
I'm working on setting up a new subversion server and getting an error I'm not having much luck resolving.
I'm attempting to create the repository in /home/svn/foo with the command svnadmin create /home/svn/foo while in /home/svn.
I am greeted with the error: svnadmin: SQLite compiled for 3.6.20, but running with 3.6.17
I installed subversion via yum install subversion
I've installed SQLite 3.6.22 from source and removed/installed subversion with no change.
What gives? I wasn't really wanting to install subversion from source. Seems a bit excessive.
Environment stuff:
[root@COS svn]# yum repolist
Loaded plugins: presto, refresh-packagekit
repo id repo name status
fedora Fedora 12 - i386 enabled: 15,366
updates Fedora 12 - i386 - Updates enabled: 4,731
repolist: 20,097
View 1 Replies
View Related
Feb 7, 2011
I need to create a lot of users locally on my server.I have these info:username:GID:UID.How I can make a "for cycle" for make a multiple useradd? (useradd -u UID -g GID -m /home/USERNAME -s /bin/bash USERNAME)I tried to do this:
touch userlist.txt (UID:GID:USERNAME)
100:110:user1
200:210:user2
[code]...
View 6 Replies
View Related
Dec 17, 2010
I have a Bind DNS caching-only server setup that is working. I am bringing up a new AD domain controller that will also be a DNS server for that AD but I don't want it responding to any DNS queries except those that are AD related.So, my goal is to leave this caching server as the primary DNS server for stations on the network and have it forward requests for the AD domain to the domain controller.My understanding is that I just need a forward zone for that domain pointing to the domain controller. However it does not seem to be working.So that leaves me to think that my caching server is not forwarding properly.
For example, this AD is going to have a naming convention of hostname.mydomain.local.If I do an nslookup and specify the domain controller's IP address as the server, I can query addresses that exist in DNS on that server, such as dc1.mydomain.local.However, queries to my caching server times out (I get a response from the caching server if I query mydomain.local but none of the objects in that domain) Here is my named.conf file:
options {
directory "/var/named";
listen-on { 192.168.0.14; 127.0.0.1; };
[code]....
View 1 Replies
View Related
Sep 3, 2010
Basically, i have a clustered filesystem using GlusterFS. This is ultimately going to host a very large number of files.
It is mainly used as a storage destination for backups, and historical copies of files.
Remote servers sync using unison every few minutes. A local script will run over the whole filesystem once per hour looking for new files/folders, and files that have been updated based on their timestamp.
99% of filesystem access is browsing the directory structure, listing directory contents and checking the modification times of files. Access to the actual content of a file is minimal. Only a tiny fraction of the filesystem is actually modified from hour to hour.
GlusterFS alone is quite slow when browsing the directory structure. (ie. "ls -Rl /data") The speed of things for actually transferring file content is sufficient for my requirements.
What I need is to vastly improve performance when running operations such as "ls -Rl /data". (/data is the mount point)
I believe the best way to do this is to implement caching. The cache options within GlusterFS are simply not sufficient here.
My first thought was to re-export the GlusterFS mount with NFS, and then mount the NFS share and set the cache on the client to a very long expiry. (like 86400 = 24 hours) It is my understanding that any change made to a file using the mount point will invalidate the cache entry for that file. (it is only mounted in one place, so no changes possible at the back end.)
I did this using the kernel based NFS server, but ran into major problems with the "Stale NFS" errors which from reading is due to a problem related to FUSE that doesnt sound like its going to be fixed soon. Aside from the Stale errors, this did provide a suitable boost in performance.
I tried the beta of GlusterFS that has the integrated NFS server (so presumably, no FUSE) but I could not get this to compile properly on our servers.
Finally, I tried using the Gluster patched version of unfs3 that uses boost to talk to Gluster instead of FUSE. Now this works, but for some reason the NFS client cache doesnt seem to cache anymore.
One last thing that I was looking at is the possibility of running a simple cache layer in front of either GlusterFS or NFS. I believe Cache-FS is the tool for the job but I have been unable to get that to work - I believe it is disabled in my kernel or something. (mount command says cachefs is unknown)
I am running Ubuntu 8.04 on most servers, but have upgraded one to 10.04 to try and get around Kernel limitations. My servers are all 32 bit (I know, not recommended for GlusterFS) and its very difficult for me to change this. (its a live system)
I quite simply need to add a cache for the directory structure information, and then maybe export this with NFS so that it can be mounted on a *single* server. (the cache can be on the server where it is mounted if required, but due to the large size of the cache - it may be better to have a server dedicated for the cache)
I am running GlusterFS 3.0.5 in a replicate/distribute manner.
View 4 Replies
View Related
Mar 13, 2011
There is this server that is running a lot of websites and runs varnish for caching for performance boosting. But I want to somehow remove certain URLs from caching which change frequently. But I do not want to remove complete domains from caching but certain URLs from the websites. Is there any way to remove those pages from caching?
View 2 Replies
View Related
Nov 29, 2010
Is there anything like a persistent caching proxy available in linux for me to configure, ie not public? (persistent meaning the cache remains in hard disk between reboots) Is it possible that it NEVER looks for any update to a page that is available in the cache?
View 1 Replies
View Related
Jun 29, 2011
I'm running into a little trouble trying to configure bind as a caching dns server on centos 5.6. for debugging purposes I've got iptables and selinux turned off, but I can't get see the dns service on my local network. on my server itself I can run nmap against it and see that port 53 is open, but if I try it from another computer on my network the port is closed.
View 7 Replies
View Related
May 25, 2011
I want to configure proxy caching on my openSUSE boxYast >>> Proxy >>>
View 5 Replies
View Related
Feb 14, 2011
I can configure a caching-only name server fine, but how do I make it forward DNS queries too?
I'm thinking I could add the below to the options stanza in the /etc/named.conf file:
View 1 Replies
View Related
Oct 23, 2009
what i need, I got two servers for about 4000 users and 300 servers and well the guy never setup dns caching right, so im redoing it. Now my goals
1) DNS cache
2) Transparent Squid Cache only
3) Load Balance - at switchlevel
Upgraded Hardrives to SSD 2x32gb each server 4gb of ram 2x Dell poweredge 850's - p4 2.8 (single cores) So any advise , pointers , expeirnces and best ways to do this being both server will do both dns caching and squid! Also is bind9 the best for this?? i seen stuff about DNSmasq what performs better( i dont need DHCP)
View 1 Replies
View Related
Mar 6, 2009
I'm using FC10 and I want to create a symlink to my movies directory in my home folder:
This is what I did:
I created in
/var/www/html
ln -s /home/username/movies movies
Then in /etc/httpd/conf/httpd.conf
DocumentRoot "/var/www/html"
<Directory />
Options FollowSymLinks
AllowOverride None
</Directory>
<Directory "/var/www/html">
Options Indexes FollowSymLinks
AllowOverride None
Order allow,deny
Allow from all
</Directory>
<Directory "/home/username/movies">
Options Indexes FollowSymLinks
Order allow,deny
Allow from all
</Directory>
Restart apache and then the test page is working.
The directory /home/username/movies has following permissions:
drwxrwxrwx 2 apache apache 4096 2009-03-05 23:43 movies
When trying to access my webpage at localhost/movies I get the 403 Forbidden Error.
Ok then, entering:
sudo -u apache ls /var/www/html
> movies
This works, sudo -u /var/www/html/movies returns the permission denied error.
As well sudo -u /home/username/movies
Is the user apache chrooted by default? SELinux is in permissive mode. What can I do?
View 4 Replies
View Related
Apr 25, 2010
i've installed directory server in a fedora 12 box, i got it running and i can access it using coldfusion to manage users and groups.i hit a snag when creating a user, this because coldfusion cannot generate a password, the directory server needs a certificate and a ssl connection.so i started googling for a way to generate and install a certificate on the server itself and in the directory.s is my administration server and directory(it's novabase directory) not the other one.
View 2 Replies
View Related
Jan 4, 2011
I have installed bind 9.3.6 on a centos 5.4 virtual machine. i have successfully installed it and i just want to run it as a caching server but it is not working.I mean when i dig any url it gives connection time out messages .
I checked /var/log/messages on my machine and there were two kinds of messages:
Now there are a lot of errors of the above two kinds only. The only difference in the errors are the ip address that is different.
View 4 Replies
View Related
Feb 4, 2010
i want to configure a caching server on linux . that will be support better speed for resolve index. how can i do this .
View 1 Replies
View Related
Aug 8, 2011
I am currently working on a project at work to do caching across a windows network (web traffic thorugh squid and windows updates with WSUS). It is proving to be an interesting learning project.This got me thinking about my home network. Currently I am running 8 Fedora Computers (with the very real possiblity of more in the forseeable future).
Oviously running "yum update" on every computer and having them download these updates directly on each computer eats a lot of bandwidth on the external link. I would like to know if there is a way to set up a proxy server (or something else for that matter) to cache yum downloads. This way when I deploy a new machine, or run updates, I can save time and bandwidth by only downloading the packages too my LAN once, instead of nearly a dozen times.
View 4 Replies
View Related
Jun 2, 2009
I am using Fedora 5 (I know it's out of date), and I want to create a web mail server.
View 3 Replies
View Related
Sep 12, 2010
creating a radius server. i need info regarding books or webpages.
View 4 Replies
View Related
Apr 3, 2011
ran an internet cafe and last week my windows server got fried because of power surge. Now i got Fedora 14 running on another PC and i want to set it up as a full caching proxy server, so other computers can connect through it to the internet. I have 2 network cards inside.I'm really new to Linux and now learning my way around. I managed to install squid but don't know how to configure it to suit the purpose above
View 1 Replies
View Related
May 9, 2011
I want to configure DNS Server on Fedora14. So I install caching-nameserver cause any template files.I can't install caching-nameserver on my Fedora14 by this command: [but i can do it on Fedora5]
View 4 Replies
View Related
May 31, 2010
I just upgraded to Fedora 13, with emacs 23.1. Now when I edit a .gpg (encrypted) file, emacs doesn't cache the passphrase, so when I save the file emacs demands that I repeat the passphrase twice.Previously, the following line in .emacs made it cache the passphrase:
Code:
(setq epa-file-cache-passphrase-for-symmetric-encryption t) This is supposed to work, according to the documentation [URL], but in Fedora 13 emacs it seems to have stopped working.
View 1 Replies
View Related
May 3, 2010
I have Webmin installed on an Ubuntu server. I currently have a successful apache server running on port 80, however I want to create a virtual host on port 81. When I try I go to servers->Apache Webserver-> Create Virtual Host I change the port to 81 and the document root to /var/port81www then I click create. How ever when I goto 192.168.1.5:81 (local ip, I know I have to port forward but its not even working local) it does not work.
View 5 Replies
View Related
