Red Hat / Fedora :: Parse Links From Authenticated HTTPS Page?
Oct 22, 2010
I am attempting to write a shell script that accesses a web page with a specified log-in and parses said page for download links to installation packages. Can anyone advise on the possible (and best) ways to go about this? Perl? wget? curl? I haven't been able to find any clear-cut documentation so far concerning the aforementioned -- if anyone has some favorite tutorials on parsing web data that would also be useful.
View 4 Replies
ADVERTISEMENT
Dec 6, 2010
At my Uni, we use a web-based login for our internet connections. Its based off of Cisco, and every Wednesday night every computer on campus must re-enter their credentials to use the network.
Normally on my several computers I simply pull up the Terminal, point links to google.com using
Code:
And enter my credentials when Cisco redirects to the login page.
Literally, the process is
Code:
Then ENTER to accept the redirect, down arrow to skip over the logo image, USERNAME, ENTER, PASSWORD, ENTER, ENTER.
Naturally, this is EXTREMELY time consuming, as I have about 5 computers located around campus and must physically walk to the machines and login every single week.
My question is, How would I formulate a program that does the following;
1) checks for connectivity (i.e. is able to reach/resolve to the greater part of the internet) and
2) automatically fills in the credentials on the links login page?
View 2 Replies
View Related
Apr 30, 2010
When I click on an http link in Thunderbird, nothing at all happens. There's no error message on the console, there's no new browser starting, and there's no new tab opening with the browser already running.
I've tried: sudo update-alternatives --config x-www-browser, choosing firefox.I've also tried: adding a new string value to Thunderbird's warranty-voiding config: network.protocol-handler.app.http, with a value of /usr/bin/firefox. This was recommended in various threads.But no luck.There's an entry for https - firefox on the Attachment tab of the preferences, and https links are indeed opening in Firefox. But not http.KDE 4.4.2 itself has default mail client and browser set to Thunderbird 3.0.4 and Firefox 3.6.3 (both from the repositories, no website downloads).
View 3 Replies
View Related
Jan 27, 2011
I'm creating a comment form for a website but when I try to connect the page with a database it gives me a parse error. here are the codes I wrote:
[Code]....
View 1 Replies
View Related
Feb 22, 2010
I would like to download and show a source of an webpage in stdout, but this is a https page with authentication form, which requires logging in. I tried like this:
Code:
wget -q --no-check-certificate --http-user=USERNAME --http-password=PASSWORD https://webpage.domain.com -O - However, it still downloaded only this login page, not the real webpage. Using the Firefox I can authenticate just fine. Any ideas?
View 5 Replies
View Related
Dec 1, 2010
I have a website I want to map all the links starting at a given page, and record where everything is linked. I want to record any broken links, and have a nice little hierarchy of link names when I'm done. I thought the package webcheck could do this for me but I'm not sure.
the server is windows 2003. Im interested in any means that can accomplish this task.
View 1 Replies
View Related
May 9, 2010
i have a Realtek RTL8192E Wireless LAN 802.11n PCI-E NIC card on my Samsung r580 laptop that i just installed Ubuntu studio 10.04 on. I am wondering how to get the wireless card working in Ubuntu. I saw some info on my card here *url #1 (the urls i reference are in the attached txt file called urls.txt because i couldn't post the actual urls because apparently i need to post 15 times or something which i don't have time for at the moment)* and then i went here to download ndiswrapper *url #2* and both of the links on that page don't work. I followed the instructions on this page *urls #3* to get the info on my card. here is the info when i typed "lspci -knn" into the terminal in ubuntu studio. Code: 00:00.0 Host bridge [0600]: Intel Corporation Core Processor DRAM Controller [8086:0044] (rev 12)
Kernel modules: intel-agp
00:01.0 PCI bridge [0604]: Intel Corporation Core Processor PCI Express x16 Root Port [8086:0045] (rev 12)
Kernel driver in use: pcieport
Kernel modules: shpchp
00:1a.0 USB Controller [0c03]: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller [8086:3b3c] (rev 06)
Kernel driver in use: ehci_hcd
[Code]...
View 9 Replies
View Related
Apr 15, 2011
How to parse the bunch of values displayed by the socket program into the php file so that further it can be displayed in HTML page
View 1 Replies
View Related
May 22, 2011
I have set up certain portions of my web site to be forced https:// How do I force, non https:// protocols. I know this sounds confusing, so let me give you an example.
[Code]...
View 7 Replies
View Related
Nov 23, 2009
On FC11 64 bit with Adobe flash plugin for Linux installed, I see segfault errors from "npviewer" in /var/log/messages. The only browser I have tried yet, Firefox, has glitches every now and then. Sometimes it shows the title of a page in a tab, but the page is blank. This can even happen when I try the Google main page. Is it true that npviewer has something to do with Adobe flash? Is there a way to fix the problem? If it is caused by Adobe flash, is there a different plugin that will replace Adobe flash player?
View 1 Replies
View Related
May 10, 2010
How can I find page hit and page miss ratio in linux fedora core 12?
View 3 Replies
View Related
Jun 8, 2009
I have apache httpd server on my Fedora 10I got 2 problems:First : I copied the web page files to its Document Root <var/www/html> & Disabled the default web page. But when I visit http:/localhost ，it shows up the list of files in <var/www/html> as if a ftp server browsed in web page. So how can I set http://localhost load my default web page index.html ?Second :I want to set up a web server on Internet through my router . I applied for DDNS account & input it into router correctly . I set virtual host in server to redirect any access from port 80 to 192.168.1.2:80 in LAN . Just for in case , I also download and running the DDNS software & installed it on PC 192.168.1.2 in LAN . My DDNS provider is oray.cn . It's a Chinese server provider . I don't think there is anything wrong with oray.cn . But if you need its information just visit oray.cn (Google can translate it for you). So I want to know did I miss something to set up a web server in this kind of situation
View 2 Replies
View Related
Feb 3, 2009
I have a personal wiki of notes, with now thousands of links in markdown format:
[link text](http://example.com)
but now that fckeditor is available for mediawiki (very beta), it has become much better to just stick with wikitext format. There are only a few conversions to do: tables, links, and bulleted lists. The lists are a fairly simple regex and fckeditor magically reformats the tables, so all I'm left with is the links. But I'm not a regex master. How do I reformat code...
View 12 Replies
View Related
Jun 15, 2011
I can view a php page only with links browser (a text browser) But when i use firefox i got an error "Content encoding error"
View 4 Replies
View Related
Jun 5, 2010
I have a Canoscan LiDE 30 scanner which works fine in Linux. I haven't used it in months, and never since moving from Jaunty x86_64 to Fedora 11 x86_64. This evening I suddenly need to scan two pages to send to someone via e-mail, and the recipient is desperate to receive them. Naturally, Xsane has decided this is the moment to screw me.
The problem: I cannot figure out how to tell Xsane that the page size is 8.5 11. It insists on scanning only the left side, 3.99 x 11. I cannot find a page size anywhere in any of the buttons.
In Preview I once got it to scan the entire page, but could not figure out how to save the image to file. Subsequently I have not been able to figure out how I did it. In any event, scanning from the small main window always scans 3.99 x 11. Adjusting the scan area manually in the Preview window allows me to change the size area in the small main window to 8.5 x 11, but when I then scan from the small main window it reverts to 3.99 x 11.
I have scanned the document a hundred times at least, each time trying different buttons, but nothing has succeeded in getting the full page.
View 5 Replies
View Related
Nov 11, 2009
I am trying to connect to our work server (windows), however, without succes In the log I get the message: "Failed to parse server response"
And when I close the vpn connection window I get "there were no valid vpn secrets"
I Use F10 with xfce on an aspire one.
View 2 Replies
View Related
Jul 24, 2009
I have installed Fedora 10 and centos 5.3 on 30 system in my home office. everything works fine except accessing https websites. the problem persists in both centos and fedora even after changing firefox versions. what's worse is the problem is not resolved after changing other browsers. so the problem is not browser-centric. i think it has something to do deeper in fedora and centos. also note that i have disabled firewall and selinux but in vain. the problem is still there across all the systems. it's really a show-stopper for me.
View 7 Replies
View Related
Jul 15, 2011
how to install squid3.1.x to block https sites?
View 1 Replies
View Related
Nov 1, 2009
I am a squat on advanced Apache work. I would get a basic SSL functionality to work. So URL...works fine and gets me all the login windows I designed. however currently all the images and other extensions like .pdf are also using the https routing.some image referred on that https link e.g. URL...can be displayed using https but not http.I would like to JUST limit https usage to the login window html and ALL other images pdf's not secured html ( one that do not need password ) should use HTTP NOT HTTPS.
View 6 Replies
View Related
Dec 28, 2009
I've got a basic apache2 setup running w/ multiple virtual hosts, would like to try SSL (i.e. https).
I've got the IP networking side well and truly sorted but I need guidance on the apache/ssl config side. I have installed mod_ssl.
Does anyone have a good guide for Fedora that's recent? All I can find are ubuntu and old fedora 'core' guides, so not sure how much applies to F12. The best ones I can find so far is
https://help.ubuntu.com/community/fo...er/apache2/SSL
http://httpd.apache.org/docs/2.0/ssl/ssl_howto.html
View 7 Replies
View Related
Jan 17, 2010
I have 2 web server in my office : http and https. You will find attached the httpd.conf and ssl.conf. I can acces the https server from home, but not the http one.
What I did :
configure the router to forward port 80 to my fedora 11 machine
open port 80 with system-config-network
created a virtualhost
The same exact steps have been done for port 443
I can access both server locally but only the https server remotelly.
Here are my iptables :
Code:
you can try to acces my servers using [url]
I made httpd to listen to port 8080, and done all the port forwarding/opening stuf, and it works. so is it a bug ?
Finally found my error seams like turning off UseCanonicalName to off did the trick
I really think it's a bug now. It was definitively working last week, I just added content to the main host of my website, and now i can't acces it from port 80. If someone think it's not a bug or find someting missing/wrong in my conf file.
View 2 Replies
View Related
Oct 22, 2009
I've noticed that when I open firefox I get really strange HTTP and HTTPS connections showing up in firestarter (which as I understand it is just a GUI for IPtables). They connect to various bits of a site listed as 1e100.net (when you use "lookup hostnames") such as wy-in-f18.1e100.net, they stay connected all the time as far as I can see unless I close firefox. I've heard people say they are connected to Google, but I can close all tabs after loging out of google and still see them... it's very odd.
View 3 Replies
View Related
Aug 13, 2010
Has anyone successfully kickstarted a rhel/fedora/centos over HTTPS ? In other words, is it possible to do the rhel/fedora/centos install from running apache with SSL enabled?
View 1 Replies
View Related
May 26, 2011
Fedora 15, when I click on a link in Evolution email, Firefox opens OK, but does not go to the link but to the home page.Any work-arounds please or is this a bug?
View 8 Replies
View Related
Oct 9, 2010
I have a linux server, and use symbolic links a fair amount. I'm also merging some of my php code
library to another location.
My question is, is there any way to get a list of symbolic links that point to a specific directory which I am going to be moving? that way I can manually go through them and re-point to the new location of the physical folder.
View 2 Replies
View Related
Oct 12, 2010
i am able to try ubuntu and everything works fine until i try to install. the menu comes up to the first page where it tells you to plug in your machine and make sure there is enough disk space and network connectivity. when i hit next on this page the mouse icon changes but the next page never loads. the longest i let it hang there was 2 hours. ive tried multiple times with the same result.
im running from a flash drive on an ASUS Eee PC 1001P-PU17
View 4 Replies
View Related
Mar 9, 2011
I have a problem printing to my HP printer.
What is my problem? I have a page (one page - text an graphic) to print. When I sent it to my printer it prints OK. When I sent it agian, the output is totally garbled. When I sent it again (a third time) it is OK. Sent it again (4th time) it is garbled. Sent it again ... you get the picture ;-). Alternating good and bad pages.
What is my setup? I run Fedora 14 with Cups 1.4.6. The printer is a HP Deskjet 940C. It is connected to a linksys wireless print server. It is configured in CUPS to use ipp printing. The driver I use in Cups is 'CUPS+Gutenprint v5.2.6 Simplified (color, 2-sided printing)'.
View 2 Replies
View Related
Apr 29, 2010
Recently Firefox is showing some but not all the links inside a page in a website that I use every day.Firefox had worked well in the past years with this site, so I made a few tests:- I tested the web page on Firefox 3.5.9 on Fedora 12. Some links missing.- I tested the same web page on IE8 on Windows Vista. No issues, all links there.- I tested the same web page downgrading Firefox to version 3.5.4 and downgrading the required libraries. Same issue, some links missing.- I compared the html code that the web server hands to both IE8 and Firefox. They are exactly the same.I don't know enough about html or javascript to understand why Firefox doesn't like some of this code portion.
Code:
<td align='left'>
<p class='liga'><a href="javascript:GeneraId('11')"><img src="image.gif" BORDER=0
[code]...
View 6 Replies
View Related
Jul 11, 2010
10.04; 64 bit In Firefox, the size of the fonts varies greatly from site to site. Some are too small to read, others huge. Some headings and menus overlap.Screen size: 1152 x 864
My settings are:
Proportional: serif 14
Serif: Times New Roman
Sans serif: Arial
Monospace: Courier New 14
View 1 Replies
View Related
Jul 26, 2010
All has been fine with my emails but today morning when i tried to log on I got an error message "You must be logged in to access this page, go to logon page" I dont understand why even when i supply my correct user name and password.
View 2 Replies
View Related
