i am using Ubuntu 10.04 when i downloaded some thing using wget like wget [URL] where this page will get downloaded and second thing sudo apt-get install perl-doc i installed documentation for perl the same i have for postgreSQL... how to use these perl documentation in learning perl.
View 1 RepliesI'm trying to download all the data under this directory, using wget: [URL] I would like to achieve this using wget, and from what I've read it should be possible using the --recursive flag. Unfortunately, I've had no luck so far. The only files that get downloaded are robots.txt and index.html (which doesn't actually exist on the server), but wget does not follow any of the links on the directory list. The code I've been using is: Code: wget -r *ttp://gd2.mlb.***/components/game/mlb/year_2010/
View 4 Replies View RelatedTo make an rpc call I need to sent an xml file as post data.I know how to do this with wget. It works fine when I have the xml already filled in (depending on the node values the response from the call is different).owever I want to be able to edit part of this file, and then sent that as post data using wget. can edit this file using sed (I dont want to rewrite the files each time this gets used; and it does get used alot, with alot of different values).
View 1 Replies View RelatedI've been pulling my hair out trying to get wget to post data to a webpage to automatically download some files. I've tried many methods of syntax, but wget always downloads the html for the login page. A snippet of code I found in the login html page is below. Some of the characters are japanese, because it's a japanese website.
View 7 Replies View RelatedI'm trying to use wget to retrieve some data from our tape backup utility (HP Command View 1/8 G2 Autoloader). The URL requires two parameters for the info I want to retrieve. I have searched for a few hours and have tried numerous combinations to get the data but the parameters aren't being executed. I have escaped the URL as well.
Code:
wget --user=x --password=x --recursive --no-clobber --page-requisites --html-extension --convert-links --no-parent -O ssi.html "10.0.x.x/inventory_status.ssi?mag_0=1&mag_1=1"
returns:
Code:
<HTML><HEAD><TITLE></TITLE></HEAD><BODY>
<SCRIPT LANGUAGE="javascript">
top.location.href='logout.ssi';
[code]....
I am on a limited broadband plan with 4GB download limit per month. Is there any software which can tell me how much data I have downloaded in a particular period of time?
View 1 Replies View RelatedSometimes I connect to the internet via a "wired" connection (interface usb0), sometimes via a dial-up connection (ppp0).
Stupid annoying arbitrary data transfer limits imposed by ISP make me want to keep a running total of data uploaded and downloaded, so I can keep an eye on this and hopefully avoid using up my allowance. program that will keep this running total for me, across all interfaces? Or maybe someone has a script that can do this?
I use a Karmic Koala and I want to upgrade to Lucid Lynx. All the packages are up to date. So if I upgrade online, how much data download am I looking at? I have a sufficiently fast connection, but I have a limit on the data that I can download. Is it less than downloading a Lucid Lynx CD? Can I get an exact figure somehow?
View 2 Replies View RelatedAt present I have to live with a 5Gb/month data volume limitation. Due to having to monitor this usage, I have been forced to use the software that came with the web dongle - and that means having to use Windows (spit!)
Can anyone recommend a Linux package I could download that readily shows how much data one has uploaded/downloaded over a set period?
my isp is putting a max bandwidth in my area and I need to monitor my downloads and uploads per month. Is there anything that has a gui that is easy to set up and just shows the amount of data downloaded and uploaded per month. Also if possible to do a pop up if you set a maximum bandwidth amount.
View 2 Replies View RelatedIf a wget download is interrupted (like if I have to shutdown prematurely), I get a wget.log with the partial download. How can I later resume the download using the data in wget.log? I have searched high and low (including wget manual) and cannot find how to do this. Is it so obvious that I did not see it? The wget -c option with the wget.log as the argument to the -c option does not work. What I do do is open the wget.log and copy the URL and then paste it into the command line and do another wget. This works but the download is started from the beginning, which means nothing in the wget.log is used.
View 2 Replies View RelatedI'm looking for a powerful network traffic monitor that can do all of the following (or at least a combination of tools that can do the following):
Tell me how much data was downloaded/uploaded on an interface this month and the previous month tell me how the traffic was used throughout the monthshow which internal IPs (IPs in the 192.168.1.0/24 network) used how much traffic show which ports/protocols on those IPs used all that traffic
Hhow LIVE traffic flow statistics that can tell me total speed of traffic going through an interface as well asshow which internal IPs (IPs in the 192.168.1.0/24 network) are using how much of the traffic show which ports/protocols on those IPs are using that traffic
This tool will run on a linux router through which all my internal PCs are connected to the Internet. This means the tool(s) need to work with NAT (traffic being forwarded and not necessarily destined for the interfaced being monitored).
The distribution being run doesn't have a package manager so any packages or dependencies have to be manually compiled and SCPed over file by file. For this reason, the tool/tools need to be simple (things like vnstat, not things like ntop that have their own web interface).
I know that vnstat can tell me the first bullet point so it's only there incase there's a tool out there that can do everything. If there's a tool that can only do the second or third bullet point, that's great too - I'll just keep using vnstat and look for something else to do the other task.
after the netinst finished to download the last package, one hour later the process never continues, I checked the log file and I didn't find anything suspecious, also dmesg and nothing, in fact, in the log file before checked I found that the last line was registered just a minute ago - DHCP renew IP-, so my questions are:
1. all the packages downloaded are gone?, can I restart the installation using all those packages downloaded?
2. where I can find the error or problem that cause that the installation was freezed?
3. in the case that installation needs to start from the beginning, can I use the package downloaded?
I need to mirror a website. However, each of the links on the site's webpage is actually a 'submit' to a cgi script that shows up the resulting page. AFAIK wget should fail on this since it needs static links.
View 1 Replies View RelatedI have a computer under Linux with several network cards, for example: eth0, eth1, eth2, eth3. Is there some way to run any downloader, like aria2 or wget only through one interface, for example eth0?
Main problem: for some reason I can't use iptables
I'm doing this wget script called wget-images, which should download images from a website. It looks like this now:
wget -e robots=off -r -l1 --no-parent -A.jpg
The thing is, in the terminal when i put ./wget-images www.randomwebsite.com, it says
wget: missing URL
I know it works if I put url in the text file and then run it, but how can I make it work without adding any urls into the text file? I want to put link in the command line and make it understand that I want pictures of that certain link that I just wrote as a parameter.
i use this code to download :wget -m -k -H URL... but if some file cant be download , it will retry Again and again ，so how to skip this file and download other files ,
View 1 Replies View RelatedI need to download about 100 packages so I'm using wget-list to make it easier. My question however, is once I've made the list (I assume it's in a .txt format), is there a way I can insert comments into it that wget will ignore? Something like this:
#This is a comment
http://someurl.com
http://anotherurl.com
I have a crontab that wgets a PHP page every five minutes (just to run some the PHP code), and I want to send the output to /dev/null. I couldn't find it in the wget manual.
I'm looking for something like:
wget -o stout http://whatever.com/page.php > /dev/null
I had the bad surprise that wget doesn't redownload when a file of the same name already exist.
Is there an option to force him to redownload without deleting the file first on linux ?
I have a website that I need to go to often and disable a monitor. To disable I need to login to the website-> click on monitor -> then uncheck a box.
I am told that I can do this through a scipt using the WGET command. I got the parameterized query and then tried to execute it through a *.sh script.
The script generates a php file in the location from where it is executed. When I go to the site and check the monitor is not disabled.
I m trying to access a site through a perl script for a project of mine, and i use a system call fora wget.
The login form is this
Code:
I mean should i add in the --post-data all the hidden fields? should i try using perl's md5 function for the last two fields? anyone has any idea on what are the elements i should be sending along --post-data?
Is there a way to --load-cookies from mozilla or something similar instead of creating new cookies with wget?
I would like to use wget to downlaod file from Redhat linux to my windows desktop , I tried some parameter but still not work , can advise if wget can do download file from linux server to windows desktop ? if yes , can advise how to do it ?
View 14 Replies View RelatedI want the wget command to work on my linux machine.This is the output of the uname command on my machine Linux kalpana
Quote:
I get the error -ksh: wget: command not found.So can anyone tell me how do I install the wget utility on my machine.
I am trying to download data/file from web server where htpassword has been setup, I have tried with browser it its working fine, but when trying to same with 'wget' its not working, how to download the file. Below is the command I am using. [URL]... admin[:]password (may be smily get overide)
View 4 Replies View RelatedWhen I wanna use wget to download some file by http, which conditions fulfilled on the server would make that successful. I mean that such service httpd is running and so on.
View 1 Replies View RelatedA few months ago I have setup a server with three hard disks. The partition mapping the disks as follows:
Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x7ca36fee
[code]....
Now I have the following problem the LVM file system don't mount properly.If I open the mount point I see only a few files of the LVM disk. If I want to unmount the disk I get the following error:
umount /data/
umount: /data/: not mounted
If I want to mount the volume I get the following error:
mount -a
mount: /dev/mapper/gegevens-Data already mounted or /data busy
I am trying to use wget to access a RESTful interface, but I can not figure out how to do HTTP PUT with wget. How can I do it? Or isn't it prossible?
View 2 Replies View RelatedI'm trying to download two sites for inclusion on a CD:URL...The problem I'm having is that these are both wikis. So when downloading with e.g.:wget -r -k -np -nv -R jpg,jpeg, gif,png, tif URL..Does somebody know a way to get around this?
View 2 Replies View RelatedWhy doesn't this work?:
View 1 Replies View Related