Networking :: Implement Bandwidth Shaping Policy In A Virtual Environment
Nov 27, 2010
I want to implement bandwidth shaping policy in a virtual environment. So i have 2mbps link, which i want to distribute it among Email,http(s),ssh,... and some other traffic. I want to do this in a virtual environment, for testing purpose. I want to run this script on a virtualbox virtual machine, which has ubuntu installed on it. and then use that as the router.
(a) is there any software that could simulate email,http,... traffic so that i could test it?
(b) my second question is (though not related to networking) how do i set a (virtual) machine as a router? or is it even possible?
I've been learning linux for a while now with half an eye on making a career out of it in future. One sizeable gap in my knowledge at the moment is networking. Is it feasible/desirable to set up a network of virtual machines to use as an environment to learn networking? My budget is non-existent so I was hoping to be able to get a basic understanding of the principles from installing a few desktops, a virtual gateway etc on VMware workstation on my laptop, and doing a lot of reading online.
Is this feasible, or will I just end up learning about virtual networks instead of real ones? Also how much power would be required, because my 3GB RAM lappy has just gone bang and all I have now is a (new) 1GB RAM lappy.
I am running vsftpd-2.2.2-3 on my Fedora 12 box. This box has multiple IPs. What I am looking for is make vsftpd listen on those multiple IPs and when a user FTPs to a certain IP, they get landed to the home directory that has been configured for the IP.
This feature is there in Proftpd and is called virtual hosting. I tried to find for Vsftpd such feature, but couldn't find out exactly how to implement in it. how to implement virtual hosting in Vsftpd?
I created a the class like this for shaping the packets with a specified bandwidth rate.....
tc qdisc del dev eth0 root tc qdisc add dev eth0 root handle 1: htb default 15 tc class add dev eth0 parent 1:0 classid 1:1 htb rate 750kbit ceil 750kbit tc class add dev eth0 parent 1:1 classid 1:3 htb rate 600kbit ceil 750kbit prio 0
For Our Requirement:-
I dont want to specify the bandwidth rate strictly like this rate750kbit ceil 750kbit,based on whatever speed is coming which should allocate the bandwidth rate for particular class...I need one application for finding the upcoming bandwidth & Is any other method is there for specify the bandwidth rate in a classes.
We are using squid deplay pools successfully in our lan and it is working very fine but now i want each computer bandwidth to be shaped for each port means that whenever the user make ftp connection with ftp software or whenever the user access outlook express for email each port like smtp,ftp,remote desktop connection will be shaped or otherwords each pc will get fixed bandwidth.
Our Broaband having 1Mbps connection and we have 16 user who access the internet so i want the 1Mbps will distribute in each user. Our Six Users of internet is our directors and managers of the company so i want to give them max speed and 10 users will get low speed.
Six Special users Ip address: 192.168.1.3 to 192.168.1.9. Other Regular users Ip Address: 192.168.1.10 to 192.168.1.20.
I want to explicitly commit bandwidth to only 3 VOIP connections, where a connection is defined as a source IP address, destination IP address, and a traffic class. I would like the traffic controller to put the first 3 VOIP connections into 3 different queues that would have equal priorities that are higher than Best Effort. If a 4th VOIP connection were to start, its packets would be put into the Best Effort queue. When one of the VOIP connections ends, I would like the incoming packets of a VOIP connection that is in the Best Effort queue (assuming there is one) to now start going into the free VOIP queue. Is it possible to do this? Can traffic control keep track of connections being created and deleted like that? If so, how is it done? I would like to avoid having to be constantly updating my filters whenever a connection starts/ends. In actuality, I would want to do this for several different classes.
I am running Fedora 9 and KDE 4.2.1. I want to set up some traffic shaping on my machine to prevent my torrent client from hogging my entire bandwidth. I.e., I want KTorrent to download and upload to the best of its ability, but still be able to browse the net freely in spite of the torrents. I have done some reading about traffic shaping in Linux. There is lots of material about it, but most of it (such as the lartc.org "howto") is very complex and comprehensive and looks extremely intimidating. Furthermore, most of it addresses situations where you want to distribute traffic between multiple computers in a network. I just want to manage processes on a single machine. I am hoping for a piece of software that lets me assign each a "priority" to each application, or something like that. Like cFosSpeed for Windows.
I'm trying to shape bandwidth using HTB method and filtering classes with destination mac address. for this I've found two codes but none of them seem to filter bandwidth as i want (test with iperf) can some one explain me the problem with theses codes
Code: tc qdisc add dev eth0 root handle 1: htb tc class add dev eth0 parent 1: classid 1:1 htb rate 1000kbit ceil 1000kbit tc filter add dev eth0 parent 1: protocol ip prio 3 u32 match u16 0x0800 0xFFFF at -2 match u16 0xM4M5 0xFFFF at -4 match u32 0xM0M1M2M3 0xFFFFFFFF at -8 code2:
We have a need to shape outgoing traffic EXCEPT to certain IP/subnets (sounds opposite to the title, but not really :P), using iptables if possible. We've had decent luck doing it with various things, but one of the big problems is the decrease in download speed (which DOES NOT need to be shaped at all) due to upload shaping. ie, we want the shaping not to apply to TCP/UDP overhead. Semi related but probably not important is the ability to shape virtualised systems as well (ie the guests), but as the guest traffic goes through the host any traffic shaping done on/to the host should affect the guests as well.
I maintain a network in a hostel for university students. As we often have a relatively slow connection I tried to find a solution. A friend of mine used traffic shaping / QoS here before I got the job. But we seem to have not made the best rules for the shaping as the connection was way faster without the shaper than with. As he himself installed the system alone I have nearly no knowledge how to put up another, better system.
About the hostel:
- 90 people in this house - 10 mbit SDSL dedicated line, full flatrate - very mixed type of internet traffic (P2P, HTTP, EMails, Rapidshare, Torrents, Skype, ...)
I would like to install a linux router with traffic shaping, QoS and maybe even SQUID. Googling for the words brought so much older stuff, but nothing newer.
I've got an apache server running several virtual hosts. I have them separated by domain name, and they all come into the same IP address. I'm looking for a way to monitor the bandwidth that they use. The only feature that I'm really looking for is a breakdown of which domain is dishing out how much bandwidth.
blocks.com got three visitors this month. And spent 200kb in serving them. emus.net got fifteen. And spent 1mb in serving them. reverse.org got 4000. and spent 400mb in serving them.What I would like to see is a report, could be a web page could be a file. Ideally with graphs. Showing: 1. 2..... 3[400mb worth of dots]
1-blocks.com 2-emus.net 3-reverse.org
I don't need it to show me how many visitors or from where or anything like that. I am just looking for a side by side comparison of how much bandwidth each domain is using.Is there some application for this or something. Everything that I've found has been for information on a single site (awstat and friends can show me information for multiple sites, but as far as I know it won't show me information comparing them) I haven't found anything for nagios, but perhaps there is something out there for it, or a sneaky way to make a nice plugin that would do this.
We have a sipmle office network set up that we also use use to connect to the internet, however of late the number of users has increased thus slowing internet access. Bandwidth upgrade is not an option thus i have to do bandwidth shaping on our linux router. The question is how do set the squid configs to allow certain IP's range a certain percentage bandwidtheg 60% and furthe divide the rest. Alternatively how can allow certain IPs to have higher bandwidth access.
I'm not exactly a newb (anymore), but I'm trying to get F11 to install in a virtual PC environment on Win7.
I'm installing on a tablet PC, so I want to do the virtual thing first, to see if Linux can handle the touch screen the way I need it to before I put only Linux on here. The problem I'm running into is that the install wants to default to "text mode", which isn't really a problem, but upon the first reboot, the graphics are all messed up, and I can't get the install to continue.
Is there a command line I can modify to use standard VGA settings during the install, but "redetect" the display settings when the install is complete and I'm ready to use F11?
I would like to install a very light linux distribution. Light enough to be an host running virtualbox (or vmware player) and then a linux virtual machine of choice on it. Occasionally I could be in needs of running a windows distribution.
The reason why I would like to do this is that I am a developer. I found much convenient to prepare my development environment and run it from machine to machine. Rather than reinstalling a distribution and set it up each time I buy a new laptop.
Do you think it's possible ? The alternative could be to make a kind of linux image and install on a brand new PC, but I don't know how to do that and what are the downside of it.
I'm looking into creating a virtual machine to mirror a web hosting environment I pay for. Long story short, I need a lab so I am not taking down the live site with my mistakes.Questions:
1 - What OS is most commonly used and / or best for running apache web server?My paid host is running "Operating System =linux; Kernel Version2.6.28.5-grsec-sg2"
2 - What is the best open source solution for creating a virtual linux machine on a box running XP?
I am in the process of setting up a couple of virtual servers in a cloud environment. I am currently working on my application server (Server 1) and am stuck on the creation of my ruleset for this server.
I need to allow SSH, FTP, HTTP, HTTPS, and PING on this server. This server will also need to be able to talk with a couple of database servers as well as a memcache server (all internally within my cloud environment)
I have been reading on iptables, since I have never messed with them before, and have come up with the ruleset I will paste below. I have taken other steps to secure my server...changing ssh port, not allowing root to login via ssh without logging in as a user, turning off unnecessary daemons, editing my hosts allow/deny files, just to name a few.
I am a newbie to iptables, so I would love a bit of helpful advice, criticism, and even a good explanation why I should add or remove or edit something. I really want to know the how AND the why!
When I reboot my computer, my iptables sets itself to a policy of dropping everything, adds a bunch of rules, and a bunch of extra chains, to the effect that (due to everything being set to drop) I can't do anything. I know how to fix this from the terminal to the extent of just clearing most of it and changing the policies back. However, what I don't know is how to make it stay that way. I have a file with the iptables rules I want, so every time I start up I just run iptables-restore, but I don't want to have to do this every time, particularly since others use this computer who do not have admin privileges.
I've tried changing /etc/network/interfaces with the added code pre-up iptables-restore < (etc) But that never does anything, or if it does it just makes stuff work even less. I've tried changing init.d before based on similar info elsewhere, still no luck. I don't know how to get it to stick, and I don't know why it is defaulting to the rules it is, other than that I used a firewall app a while ago and afterwards this was the result, for which I uninstalled that app after no success using it to reverse the damage.
Seems like this should be a simple question, but I've looked around and have not found an obvious location to keep custom policy based routing rules in Ubuntu./etc/network/if-up.d comes to mind, but I was wondering is that was a "standard" spot. Also it doesn't seem like these rules really need to run each time an interface is up'ed or down'ed.
I have set the iptables INPUT policy to DROP. As I have expected tcpdump wasn't showing any packages... for a while. Suddenly it begun to show UDP syslog packages being sent by a remote host. It is conform with the configuration of syslog, but since the INPUT policy was set to DROP, with no exceptions, it is not conform with configuration of iptables. Why after setting INPUT policy to DROP, with no exceptions most of the packets recieved before are being dropped and some not, as tcpdump shows?
When implement openswan in redhat5 and start ipsec appear this problem whack: Pluto is not running (no "/var/run/pluto/pluto.ctl") what this file contain
and when run this command ipsec verify Checking your system to see if IPsec got installed and started correctly: Version check and ipsec on-path [OK] Linux Openswan U2.4.10/K2.6.18-8.el5 (netkey) Checking for IPsec support in kernel [OK] Testing against enforced SElinux mode [FAILED]
SElinux is running in 'enforced' mode. Since no working SElinux policies exist for Openswan, SElinux should be disabled. echo "0" > /selinux/enforce (or edit /etc/sysconfig/selinux) NETKEY detected, testing for disabled ICMP send_redirects [FAILED]
Please disable /proc/sys/net/ipv4/conf/*/send_redirects or NETKEY will cause the sending of bogus ICMP redirects! NETKEY detected, testing for disabled ICMP accept_redirects [FAILED]
Please disable /proc/sys/net/ipv4/conf/*/accept_redirects or NETKEY will accept bogus ICMP redirects! Checking for RSA private key (/etc/ipsec.secrets) [DISABLED]
ipsec showhostkey: file `/etc/ipsec.secrets' does not exist Checking that pluto is running [FAILED]
whack: Pluto is not running (no "/var/run/pluto/pluto.ctl") Two or more interfaces found, checking IP forwarding [FAILED]
whack: Pluto is not running (no "/var/run/pluto/pluto.ctl") Checking NAT and MASQUERADEing [OK] Checking for 'ip' command [OK] Checking for 'iptables' command [OK]
When I create virtual ethernet interface and do a ping -I <v_int> <host> the outgoing address is the one of the physical interface and NOT the virtual interface.Is there no chance that trafic will go out with virtual interface address??Incoming trafic is done well i.e. responds to the virtual interface have the virtual address.
My problem is that I have 2 modems and want to check both default gw behind the modems. If I do a "normal" ping both are reachable over default route even the modem which is not the default route will not work because ping goes over the working modem.So I have 2 routing tables and want to route the virtual interface to one modem the other to the other modem
I have a question regarding Traffic Shaping in Linux, Suppose I have a server on the internet (web, email or ftp) and I want to shape outgoing traffic per IP, say 256k for each destination IP. I've seen examples on the internet on how to shape traffic per IP by adding a queue for each IP, and some examples by using u32 hash if I have e.g. a /24 network, but if I have a server and I want to shape the traffic by destination IP, and of course... since it is a server on the internet I can't manually define any IPs of subnets. An example using the tc command?
I've been searching the last days for a tool to limit the bandwidth per application. I found the perfect tool for it: trickle, but it doesn't work (I tested it with firefox and chrome but they didn't obey the limit and I think the problem is that they don't use dynamically linked libs and trickle doesn't work for statically linked apps). I found some other tools but they don't limit per application (only per user or network interface).Does someone knows any other tools like trickle (easy too use and able to limit bandwidth per application) but for all applications?
I am renting a VPS from[URL].They do not supply a webhosting panel for restarting/shutting down or for seeing monthly bandwidth consumtion. I am running CentOS 5.3. I was wondering if theres any programs that you can install to view monthly/daily bandwidth consumption on our server?
Im looking for a program to monitor the ammount of bandwidth usage per network. Ex: I have lots of networks connected to one server, and i would like to know for example how much is the average bandwitdh usage for network 172.16.2.0/24 and 172.16.5.0/24 for one hour, for example.
I'm doing some simulations (using Iperf) to obtain throughputs values of a link between two gigabit ethernet cards for different delays and different drop probability (using netem) .... Now I have to do a 3minute long simulation in which during the firstnute the bandwidth is 1000Mbit/s, 500Mbit/s during the second minute and 1000Mbit/s during ththird one....Does anybody know how can i do this type simulation
I am trying to limit bandwidth of certain ip addresses on my server. I have been doing hours of reading and not getting very far...
So far I believe the iptables command is:
And now I just need the tc command to read those marks and limit bandwidth, I have a gigabit connection and would like to limit each of these ip addresses to 10mbit in and out.
