Ubuntu :: Wget Webpage And Some Links For Offline View
Apr 25, 2010
I've looked around the other threads as well as the wget man page. I also Googled for some examples. I still cannot work it out. From the page [URL] I want to download the 48 linked files and their corresponding information page.To do this (the first file) by hand I click on the line that saysApplications (5) Go to the first optionDell - Application Open and copy the linked pageApplies to: Driver Reset Tool Then back on the first page click on the Download button. On the window that opens up I choose to save the file.
Then I move on to the next option (which is Sonic Solutions - Applications) and repeat this until I would have all my files. I do not want to download the many other links on this page. Just the above mentioned, so I can take it back to my internet-less place and refer to it as if I was on the net. I am using the 9.10 LiveCD at my friends place.
View 2 Replies
ADVERTISEMENT
Mar 3, 2010
I'm trying to figure out how to use wget to save a copy of a page that is frequently updated. Ideally, what I'd like it to do is save a copy of the page every minute or so. I don't need multiple copies; I just need to know what the most recent version was. Also, if the page disappears for whatever reason, I don't want it to save the error page, just wait until the page is up again.
View 2 Replies
View Related
Feb 8, 2011
I am trying to setup a virtual machine server as a web development environment. Install and setup is going correct. To avoid any accidents I have the apache alias set to www.example.dev instead of www.example.com. The URL will redirect no problem but I need to find a way to have every instance of a link (example.com) show up as (example.dev) so that whole site will function on the server without linking to the live external site. I'm using git as a version control system that will push certain commits to my live site and thus want to avoid changing any configuration files to get this desired effect on my virtual machine. How to do this server side, maybe via PHP, apache2.
View 4 Replies
View Related
Jan 16, 2011
I am trying to see whether wget can be used to generate actual url hits on a webpage. This does not look good so far�. I changed the following lines in /etc/wgetrc to:
Code: http_proxy=http : / /<proxy_ip>:<port>/ use_proxy on Output :
Code: root# wget -c <url>/ > /dev/null
--2011-01-16 12:26:38-- <url>
Connecting to <proxy_ip>:<port>... connected.
[code]....
2011-01-16 12:26:39 (88,9 KB/s) - `index.html.3' saved [50548] This does NOT generate a hit on the actual web page! It does not seem like the, > /dev/null part is working either... How can I get this to work?
View 4 Replies
View Related
Feb 18, 2011
I wish to download a webpage, which is secured by username and password, using WGET. The thing is there are many forms on that page and I dont know how to tell WGET which one should it send (by POST method) the parameters. I have solved it till this so far:
wget --post-data="predmet=xxx" --http-user="yyy" --http-password="zzz" [URL]
It gets through the authentication but it will not submit the form.
View 3 Replies
View Related
Feb 8, 2011
I have just started Learning Programming, & for that i study this link > [URL]
I want to save this page but (not only single page) , I want to save the Whole page including the links.....i don't want to save each page, i want to save it as a whole so that if i am not online, the page+its links should be read exactly as via INTERNET...
I Repeat... I don't want to save each page 1-by-1, perhaps their is a method so that i can save whole page, and in ofline-State if i open that page, and click on the link in the save page, it should be loaded...
Moreover, i don't want to download a book etc...
View 2 Replies
View Related
Nov 25, 2015
This is the command line switch I am using:
Code: Select allwget -p -k -e robots=off -U 'Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.6) Gecko/20070802 SeaMonkey/1.1.4' -r www.website.com
For some reason it seems to be downloading too much and taking forever for a small website. It seems that it was following alot of the external links that page linked to.
But when I tried:
Code: Select allwget -E -H -k -K -p www.website.com
It downloaded too little. How much depth I should use with -r? I just want to download a bunch of recipes for offline viewing while staying at a Greek mountain village. Also I don't want to be a prick and keep experimenting on people's webpages.
View 3 Replies
View Related
Feb 2, 2010
I am trying to download the contents from [URL] to my local system for off-line browsing but am having little to no success. I have tried using wget and httrack, although I can download the directory structure there does not seem to me any sfw files.
View 7 Replies
View Related
Jun 6, 2011
I just setup my first Linux box using [URL] everything went along fine except now I have a problem that I cannot seem to solve. I've set up a webpage on the box for my company's intra-net for testing purposes but I cannot get the links to work. On the server itself all the links work but Firefox still ask me to authenticate with the Adobe Flashplayer (player10), but when I access the page from another computer I have the following issues:-
1. Even though hostname -f shows the a fully qualified domain name I have to use the IP Address eg. 192.168.100.100
2. I can access the page but the links leading to the other pages do not work I get "Webpage cannot be found or the HTTP 404 Not Found" Error Message
3. None of the embedded pictures show up I get the red X.
View 3 Replies
View Related
Feb 19, 2011
I would like to download a webpage using WGET which needs a form submission (POST method) in order to appear. I can do that with this command.
wget --post-data="computer=hosts&style=list" http://www.example.com
The problem is there is more than one form on the requested page and I dont know how to tell WGET which one should it POST the data to.
View 3 Replies
View Related
Jun 29, 2010
I'm trying to download two sites for inclusion on a CD:URL...The problem I'm having is that these are both wikis. So when downloading with e.g.:wget -r -k -np -nv -R jpg,jpeg, gif,png, tif URL..Does somebody know a way to get around this?
View 2 Replies
View Related
Aug 8, 2011
[URL]..The download button's link cannot be opened in a new tab, what to do?
View 5 Replies
View Related
Apr 23, 2010
I have just started to learn abit about websites so I thought I would learn from internet, I have followed w3schools.com I have done what they said infact I copied and pasted in to ooo saved as index.html my problem is how do i view it, I opened firefox opened index file but allit shows is what I pasted not showing up as web page any help pointing me in right direction.
View 9 Replies
View Related
Mar 19, 2011
I'm trying to crawl a directory on a website and basically download everything in it. The structure is simple enough(but there are also multiple folders), but there is one thing that makes wget choke up.Both of the links work, but they are both the same thing. So wget will download the same file twice. How can I make wget ignore the first one? but this doesn't seem to actually do anything. It will still download the duplicate URLs
View 1 Replies
View Related
Aug 17, 2010
Reading local pdf files with okular.
However, when I visited this site [IMG=http://img185.imageshack.us/img185/4708/snapshot1u.png][/IMG](consisting of a pdf file), I am unable to view the site.
Only, upon installing acroread, the site/file is then visible.
Note that BEFORE installing acroread, the site can be viewed with konqueror. [IMG=http://img718.imageshack.us/img718/1353/snapshot2hh.png][/IMG]
How can Firefox be configured to view the site without installing acroread?
View 4 Replies
View Related
Jul 28, 2009
What I'm trying to do is wget images, however, I'm not sure how to do it 100% right. What I've got is a index.html page that has images (thumbs) that link to the full size images. How do I grab the full size images?
Example of links on the page:
<a href="images/*random numbers*.jpg" target="_blank"><img border=0 width=112 height=150 src="images/tn_*random numbers*.jpg" style="position:relative;left:3px;top:3px" /></a>
I tried:
wget -A.jpg -r -l1 -np URLHERE
but only got the thumbs.
View 1 Replies
View Related
Feb 24, 2010
This is the code i used, there is no error in execution but no file is bein saved in the working directory. I'm new in java,so just started learning.
public class Hel
{
public static void main(String args[])
throws IOException
[code]....
View 5 Replies
View Related
Sep 1, 2011
I have an apache server running on my ubuntu machine. I can view them using my local ip (192.168.1.6):80/. And my friends can view the things hosted on my server using my external ip (example http://123.123.123.123:80) but when a friend links back to me to show me what they are looking at and share the moment, I can't view the link, it simply redirects to my router login page.
I had an older linksys router and this could work fine. I could click on the links with my external IP and it routes back to my server for viewing.
Remember to note that I am on the machine that has the server, and I'd like to be redirected out and back to it so we can share pictures back and fourth without me having to replace the external IP address with my local one just to view that link in the browser.
View 3 Replies
View Related
Dec 6, 2010
At my Uni, we use a web-based login for our internet connections. Its based off of Cisco, and every Wednesday night every computer on campus must re-enter their credentials to use the network.
Normally on my several computers I simply pull up the Terminal, point links to google.com using
Code:
And enter my credentials when Cisco redirects to the login page.
Literally, the process is
Code:
Then ENTER to accept the redirect, down arrow to skip over the logo image, USERNAME, ENTER, PASSWORD, ENTER, ENTER.
Naturally, this is EXTREMELY time consuming, as I have about 5 computers located around campus and must physically walk to the machines and login every single week.
My question is, How would I formulate a program that does the following;
1) checks for connectivity (i.e. is able to reach/resolve to the greater part of the internet) and
2) automatically fills in the credentials on the links login page?
View 2 Replies
View Related
Jun 19, 2011
If a wget download is interrupted (like if I have to shutdown prematurely), I get a wget.log with the partial download. How can I later resume the download using the data in wget.log? I have searched high and low (including wget manual) and cannot find how to do this. Is it so obvious that I did not see it? The wget -c option with the wget.log as the argument to the -c option does not work. What I do do is open the wget.log and copy the URL and then paste it into the command line and do another wget. This works but the download is started from the beginning, which means nothing in the wget.log is used.
View 2 Replies
View Related
Jun 15, 2011
I can view a php page only with links browser (a text browser) But when i use firefox i got an error "Content encoding error"
View 4 Replies
View Related
Feb 3, 2009
I have a personal wiki of notes, with now thousands of links in markdown format:
[link text](http://example.com)
but now that fckeditor is available for mediawiki (very beta), it has become much better to just stick with wikitext format. There are only a few conversions to do: tables, links, and bulleted lists. The lists are a fairly simple regex and fckeditor magically reformats the tables, so all I'm left with is the links. But I'm not a regex master. How do I reformat code...
View 12 Replies
View Related
May 30, 2011
I have been working in macromedia dreamviewer for editing html and php files, Just now I moved to linux system by installing xampp , my question is that I need a best html and php editor that supports both the design view and code view as like in dreamviewer.
View 7 Replies
View Related
Feb 20, 2011
I can see some soft links in /etc directory which are pointing to /etc/rc.d Directory contents.
Code:
lrwxrwxrwx. 1 root root 7 Jan 31 08:19 rc -> rc.d/rc
lrwxrwxrwx. 1 root root 10 Jan 31 08:19 rc0.d -> rc.d/rc0.d
lrwxrwxrwx. 1 root root 10 Jan 31 08:19 rc1.d -> rc.d/rc1.d
code....
Any body please tell me what is the purpose of these soft links in /etc directory ? I am using RHEL 5.4 ...
View 3 Replies
View Related
Apr 1, 2010
how to convert webpage to pdf?
I've tried the command:
$ wkhtmltopdf linuxandfriends.com linuxandfriends.pdf
but it shows:
xxx@xxx-desktop:~$ $ wkhtmltopdf linuxandfriends.com linuxandfriends.pdf
bash: $: command not found
View 4 Replies
View Related
May 20, 2010
I have kubuntu Lucid. When I open this webpage: [URL] My firefox use a lot of CPU.
View 5 Replies
View Related
Aug 4, 2010
I inadvertently blocked a web page and get the following message when I try to open it using Firefox.
"The page isn't redirecting properly Firefox has detected that the server is redirecting the request for this address in a way that will never complete. * This problem can sometimes be caused by disabling or refusing to accept cookies."
I can change users and access the web page or change computers. No other websites were affected. Is there a way in Ubuntu or Gnome to unblock a website to accept cookies?
View 6 Replies
View Related
Sep 10, 2010
I'm typing this on my linux laptop, at work. My Firefox works fine, but I cannot apt-get, or wget anything. To get my Firefox to work, I just went into the Firefox preferences, checked "Automatic proxy configuration URL" and entered the url that I have. Now Firefox works fine, but the rest of my system does not.o be a similar setting in System>Preferences>Network Proxy. There is check box for "Automatic proxy configuration" and a field for a "Autoconfiguration URL". I put the same URL that put into Firefox here and told it to apply it system-wide, but my apt still does not work. This is a big deal because I need to install software and I really don't want to start manually downloading packages, plus I need ssh.
I have googled extensively on how to get apt to work from behind a proxy, but nothing seems to be working. I don't have a specific proxy server and port; rather I have some kind of autoconfiguration URL. Plus, my system has no /etc/apt.conf file at all. Any ideas on how I can get my system to be able to access the internet? It's very strange to me that Firefox can, but apt, ping, wget, etc cannot.
View 10 Replies
View Related
Feb 21, 2010
I've no internet in my home, But I wish to install some applications (Like VLC, WINE, ...) for my system. How do I download these installations files from another PC? If you can state the links of VLC & WINE, it'll be good.
View 5 Replies
View Related
Jan 14, 2010
I would like to know if there's a way of using FileZilla or another FTP client without having a web page. My intention is to have my files on a server and download them form time to time from different computers using FileZilla's portable version. It would also serve as a Back-up copy of 'em. If there's no way of doing that, I can get a subdomain from, that is free and without a file limit?
View 4 Replies
View Related
