I am vijaya, glad to meet you all via this forum and my question is I set a crontab for automatic downloading of files from internet by using wget but when I kept it for execution several process are running for the same at the back ground. My concern is to get only one copy, not many copies of the same file and not abled to find out where it's actually downloading.
View 1 RepliesI used the crontab to start wget and download the file with the following
Quote:
14 02 * * * wget -c --directory-prefix=/home/Downloads/wget --input-filefile=/home/Downloads/wget/download.txt
But it doesn't shows a terminal and so not able to get the current status and stop wget. So how can I start wget with a terminal using crontab?
I want to download pages, in the way they are seen when we visit them in a normal way. For example, I used this on Yahoo, and here is a part of the file I got:
[Code].....
But I just want the normal text, and nothing else...
Example: [url]
This was what I tried...wget -A rar [-r [-l 1]] <mediafireurl>
That is to say, I tried with and without the recursive option. It ends up downloading an HTML page of a few KB in size, while what I want is in the range 90-100 MB and RAR.
What happens with MediaFire for those who may not be aware, is that it first says
Processing Download Request...
This text after a second or so turns into the download link and reads
Click here to start download..
How to write a proper script for this situation.
I'm trying to download phpmyadmin from sourceforge => http://sourceforge.net/projects/phpm...r.bz2/download .I'm using the wget command followed by direct link from the page. All I get is some irrelevant file that has nothing common with phpMyAdmin-3.3.9-all-languages.tar.bz2.The direct link is for clients with web browsers that triger automatic download to user desktop, but I need to download the package to a server. What is the wget option to get the file from this kind of links?
View 1 Replies View RelatedI'm trying to have wget retrieve the pics from a list of saved URLs. I have a list of facebook profiles from which I need the main profile picture saved.When I pull such up in my browser with the included wget command I see everything just fine; however, when I do it reading in a file (or even manually specifying a page to download), what I receive is the html file with everything intact minus the main photo of the page (that pages' user picture).I believe I need the -A switch, but I think that is what is causing the issues (because the page is not a .jpg, it's getting deleted).
View 1 Replies View RelatedI have a very simple php web application deployed on linux (centOS4) machine. It creates a file and stores the file in /tmp folder on my linux machine. The path for this file is specified in the href attribute of the link. Ideally when we click this link the download manager should pop up so that the file can be downloaded on client machine.
When i access this website remotely from my window xp machine on firefox it downloads the file properly but when i run on internet explorer (i have IE7 on my windows XP) and click the link, the download manager does'nt pop's up. even when i right-click that link and select save as, an error message pop's up saying "file path not found". possibly IE is not able to determine the linux file path .so how do i work around this. is there some specific way for specifying the linux file paths to be downloaded by IE?
i try to make wget download automatic in startup in ubuntu
View 8 Replies View RelatedIn my office there is a department where the access of internet & intranet is very limited. I've been given a task that I should add a script which would automatically take screenshots of the PCs. The script works fine, but I can't make it work with the cron jobs. There are many methods given on the internet to grab screen, but none of them works with cron.
View 2 Replies View Relatediam working on fedora 14 kde 32-bit version
as the title says , when iam downloading anything from anywhere ,, even when iam updating , i cant use anything else on internet ,,, no chat , not even browsing ,
I have a Linksys AG300 "Adsl gateway" router/modem. When I download files with Iceweasel, the connection to the internet drops out (the internet connection light goes off, downloading stops). It's been happening for a while with Etch (and whatever version of Iceweasel Etch has), but I've today installed Lenny and it is still happening in Lenny.
My ISP said it could be a problem with the phone line because my computer is connected to an extension, but it does not happen at all if I download with Opera, and I would have thought that the browser wouldn't matter if it was the phone line or something in the router/modem. I'm not that fussed because I can use Opera to get my downloads, and the new version of Iceweasel will let you continue on if the download stops so all is not lost if it stops (it's just annoying). I'd be interested if anyone has any ideas as to why this happens. It seems to be an "Iceweasel thing".
I've installed Fedora 10 Gnome from DVD. How do I let yum and "Add/Remove Software" first check the DVD before downloading packages from the Internet?
View 1 Replies View RelatedI understand wget is used to download files. Is there a way I can search a url for what files are available for me to download. I need to install a plug-in from an adobe website.
View 2 Replies View RelatedI keep on downloading tar.gz files into my downloads folder and i cant do anything with them. what i need to do to install the file so i can use it? An example, i am trying to install Frets on Fire, and am failing bad.
View 9 Replies View RelatedI am using Linux 64 bit Redhat Linux. I am trying to setup simple crontab as follow...1. Edited crontab file using crontab -e2. Listed the file once to verify it using crontab -l. This will display as.. 18 5 * * 2-3 ksh $HOME/testScript.sh > $HOME/testscript.out3. Logged in a root and restarted cron deamon using "/etc/init.d/crond restart"As per my understanding now my testScript should start running at 5:18 am Thuesday
View 3 Replies View RelatedI am trying to dl the files located here: http://good.net/dl/bd/CCCamp-2007/video/m4v/ using wget.
Now when I use the command wget -r -A .m4v http://good.net/dl/bd/CCCamp-2007/video/m4v/
I get the just a bunch of filefolders, but no files, ex."cccamp07-de-1845-Freifunk_und_Recht.m4v" but its a folder.
im using fedora 14 and i have a slow internet connection. i want 2 install some packages from the fedora 14 dvd instead of downloading from internet using add/remove packages. i tried to edit /etc/yum.repos.d/fedora.repo and /etc/yum.repos.d/fedora-updates.repo but it dint work.
View 2 Replies View RelatedI administer a desktop computer with ubuntu 8.04 in an university library. Since it works almost all night, to enable students to study, after some time I noticed some misuses of the computer during the evening, when there isn't many students. My goal was to disable users from accessing internet from 7pm to 7am, but also enable it if certain user was logged in (I use that user for torrent, and I seed on that computers from time to time). So I created a script that's being called by root's crontab, and here is the script's code:
Code:
#!/bin/bash
NUM=`who|grep myuser|wc -l`
#echo $NUM
if [ $NUM -le 0 ]; then
/sbin/ifconfig eth0 down
else
/sbin/ifconfig eth0 up
fi
Since I created the script, I actually never seeded anything, so I'm wondering now if that's going to work at all, and (also) is there a better solution for this.
I was trying to write a crontab entry using "crontab -e"
Code:
0 0 * * * cp /var/log/httpd/domains/mydomain.net.log
/home/admin/logs/mydomain.net.log
crontab is giving me this error:
Code:
"/tmp/crontab.XXXXfMOnRS":2: bad minute
errors in crontab file, can't install.
I've tried a dozen different values for the minute, but it's still giving me the same error.
Internet stops on downloading. I have windows xp dualbooted and it hasn't this problem. I am sing 8.04 LTS
View 3 Replies View RelatedNote: Not upgraded yet, still using Ubuntu Lucid Lynx.Recently I've had a strange problem with my internet connection. When downloading something I am unable to use the internet with other net clients. An example, this morning I was downloading a very large set of backup files from an online server where I store backups. The files totalled 1.5 GB and I was downloading them using a SFTP client called FileZilla - during the download I was UNABLE to access the internet using Firefox, pages did not load at all - NOT slowly, but NOT at all, the "can't find the server" message was displayed by Firefox.LikewiseThunderbird was not able to check/download email. Confirmation that no internet access (other than FileZilla) was possible was shown by trying to 'ping google.com', the response "ping: unknown host google.com". During all this FileZilla was downloading very happily and quickly and as soon as the downloads finished everything worked as normal.
The problem is not limited to FileZilla, when downloading a file with Firefox the same problem occurred. It is as if when downloading something all other net connections are put on hold including DNS lookups. In the past my internet connection might slow down as a result of downloading but I'd still be able to access the web and email just slower as a result of the download. This problem has only started happening in the last week or thereabouts.
I'm trying to download a set of files with wget, and I only want the files and paths "downwards" from a URL, that is, no other files or paths. Here is the comand I have been using
Code:
wget -r -np --directory-prefix=Publisher http://xuups.googlecode.com/svn/trunk/modules/publisher There is a local path called 'Publisher'. The wget works okay, downloads all the files I need into the /Publisher path, and then it starts loading files from other paths. If you see [URL]..svn/trunk/modules/publisher , I only want those files, plus the paths and files beneath that URL.
Can u tell me any download manager for linux mint 9.
View 3 Replies View RelatedA friend of mine put up a bunch of mkv files on a public server, how can i download them all with one wget command?
I have tried
wget -r [path]
which simply grabs the index file, robots.txt and skips the mkvs. I also tried
wget -r -A.mkv
If i try getting a individual file directly it works fine, what am i doing wrong here?
Let's say there's an url. This location has directory listing enabled, therefore I can do this:
wget -r -np [URL]
To download all its contents with all the files and subfolders and their files. Now, what should I do if I want to repeat this process again, a month later, and I don't want to download everything again, only add new/changed files?
i was trying to copy some files over my hdd using wget.this was the format of the command the catch is that there is a local website that is installed into directory heirarchy and i would like to use wget to make the html files link to each other in one directory level.the command didn't work inspite of trying different forms, so what's the mistake in this command or is there another way?
View 3 Replies View RelatedIs it possible to configure yum so that it will download packages from repos using wget?Sometimes in some repos yum will give up and terminate for "no more mirrors to retry". But when use "wget -c" to download that file, it will be successful
View 2 Replies View RelatedI had set two 700MB links for download in firefox 3.6.3 by browser itself. Both of them hung at 84%.I trust wget so much.Here the problem is : when we click on download button in firefox then it says save file & when download has begun then i can right click in downloads window & select copy download link to find that link was Kum.DvDRip.aviif i knew that earlier like in case of hotfile server there is no script associated with download button just it points to avi URL so I can copy it easily. read 'wget --load-cookies cookies_file -i URL -o log'I have free account (NOT premium) on sharing server so all I get is html page .
View 4 Replies View RelatedI often run into the situation where I would like to download a number of sequential files on a website, example names are:
http://www.WebSiteName.com/downloads/filename001.zip
http://www.WebSiteName.com/downloads/filename002.zip
http://www.WebSiteName.com/downloads/filename003.zip
[code]...
I was downloading the Android SDK when, mid download, I lost my internet connection. Now I cannot connect to the internet via hardwire connection. I can still connect on Vista, and I can connect via wireless, but I cannot have a hardwired connection.
I was following these instructions [URL]