Software :: Command Line Browsing That Works With JavaScript Sites?
May 9, 2011
How can I verify JavaScript on a site (not on the same server) is working from command line access of the URL?
On checking some of what was written in 2005 I find most of it isn't still relevant (if it was then - I noted the w3m-js stuff mentioned in 2005 hadn't been updated since 2003).
Since then a couple of times I've looked into it but didn't make much headway but also didn't spend a lot of time on it. So far as I could tell from other posts I'd seen others hadn't either.
Recently I found out about Mozilla's SpiderMoneky js library and that it could be linked into elinks text browser and did same on my RHEL5 system.
I found Spidermonkey rpms in the EPEL (Fedora sponsored) repository:
js-1.70-8.el5.i386.rpm
js-1.70-8.el5.x86_64.rpm
js-devel-1.70-8.el5.i386.rpm
js-devel-1.70-8.el5.x86_64.rpm
I was able to download and install using rpm then compile elinks from source to include the above. Running elinks version after that shows the ECMAScript support is compiled into the new elinks binary. Also setting various ecmas* flags in the elinks.conf does have effect so clearly it is using them. (As opposed to another system where I use the original RHEL5 provided elinks RPM it complains about the ecmas* stuff being invalid options.)
It appears that by default it has this enabled but just for good measure I added:
set ecmascript.enable = 1.
Despite that when I pull up the page I see:
This product requires use of a browser that supports JavaScript
As a test I set the above to 0 on the off chance it was backwards and saw the same thing.
I then set the following:
set ecmascript.error_reporting = 1
On pulling up the page I now see a popup box:
Quote:
JavaScript Error:
A script embedded in the current document raised the
following exception:
TypeError: Window.Focus is not a function
OK
That seems to suggest that despite the earlier message about needing a browser that supports JavaScript that it is in fact executing at least one JS but that it is getting an error. Can anyone confirm that?
Does anyone have any idea what I�d need to do to deal with the Window.Focus message?
Essentially the site is a login page and even though I am able to input username and password after opening in browser when I tell it to POST it simply returns to the same login/password page.
And of course it doesn't have to be elinks/spidermonkey. I'd be interested in finding out if anyone knows a way I can verify a site that is running JavaScript is actually responding properly from command line rather than via a browser?
The SpiderMonkey stuff from Mozilla when compiled into elinks is supposed to do that but given my results Im not sure if it is or not.
Most of the documentation I can find on JavaScript stuff appears to be aimed at developers testing their own JS code from command line rather than accessing a web page with JavaScript.
Is there a modern equivalent of "Expect", which was developed for the UNIX environment to automate access to programs which had been designed to interact only with a human?
Now with many facilities only accessible by HTML and javascript, what solutions are there to access such websites from a Perl script for example?
The need to access interactive systems by automated agents is the same now as when Don Libes originally wrote Expect, described well in his paper to the Summer 1990 Usenix Conference, Expect: Curing Those Uncontrollable Fits of Interaction.
I want my computer to access the web - I don't believe I should have to be chained to it by mouse and keyboard before it can interact with web sites. Surely there are some tools for achieving this. I've searched, but haven't been able to find any. Although I'd like to do it from a Perl script, I'd consider any language: C, PHP, anything.
I made a fresh install of Kubuntu 9.10 with KDE 4.3 last week and everything went well. Everything except the web browsers. Whenever I browsing sites the browser will freeze up. Sometimes if I wait long enough, I'll be back up and running. However, sometimes I have to force quit. I have noticed that in some instances the freezing will be isolated to one tab, while other tab are in fine working condition. what could cause this and how to make it stop? I say Web Browsers because I use Chrome and Firefox and it happens to both of them.
I recently installed 11.2 and Firefox takes several seconds to connect to each site.I pinged my machine, the gateway, the DNS servers (by IP address), and other various sites (by domain name), all without delay. But when I browse using Firefox, there's a 3-second delay while "looking up", and finally it connects. Any ideas what's causing this? I'm using Gnome and don't have another browser installed to test.
I've recently installed openSUSE 11.4 (64 bit) on my system and am experiencing severe performance issues with websites using https (any site using https). Page loads over https take anywhere between 30 seconds to 2 minutes. It's the same issue posted here Secure sites load slow or not at all -- there was no confirmed solution.
- My router/hardware configuration has not changed in a long time and I've run Ubuntu, Arch Linux, and Windows XP on the same machine within the last year and have not had any issues. - I also have a laptop running Arch Linux (kernel 2.6.38) and this problem does not occur using Firefox 4 or Chrome. To add to the madness this problem occurs while running Firefox 4 inside a Windows 7 guest via virtual box, but NOT while running IE 8 inside the same guest. - This issue occurs using Firefox 4, Chromium, Opera, Konqueror, and Arora. - I've disabled ipv6 in Firefox via about:config. - I've disabled ipv6 in yast and have attempted to use both the "ifup" and "networkmanager" options. - I am not using a proxy server. - I've attempted the fix posted in the Ubuntu forums for a similar problem [ubuntu] [SOLVED] Banking Site is very slow.
I have two Roboards that need to communicate with one another. I have sucessfully installed Ubuntu 9.04 using the 386 kernel based on instructions found online.I can use the GUI to set up an Ad-Hoc network using one Roboard ("Create New Wireless Network"), call it Manet, and connect to "Manet" using the GUI on the other Roboard and ping/ssh between the boards. However, when I try to create the same wireless network using the command line using:
ifconfig wlan2 down iwconfig wlan2 key off essid 'Manet' channel 5 ap any ifconfig wlan2 up
I don't see any entry in iwconfig under "Cell". It keeps giving me "Not Associated"When I try to enter the same information on the other Roboard to try to connect to the network, it doesn't connect and under iwconfig, I don't even see any entry for ESSID. Could somebody please tell me why it works when I use the GUI and not the command line.
Does anyone know why Nautilus would allow me to login to a server but not display any files, but when I log in via the 'ftp' command-line binary, it works and allows me to display all the files, make directories, etc.? I was able to login via FileZilla too.
Here's part of the log: Code: Response:220 Microsoft FTP Service Command:USER ---- Response:331 Password required for ----. Command:PASS *********** Response:230-Welcome to the Alentus FTP server. Response:230 User ---- logged in. Command:SYST Response:215 Windows_NT Command:FEAT Response:211-FEAT Response:SIZE Response:MDTM Response:211 END Status:Connected Status:Retrieving directory listing...
I'm trying to configure sending mail from my site under Ubuntu 10.04 LTS.I have installed LAMP and postfix. To test mail I created the file test.php with code:
PHP Code: $to = 'mymail@gmail.com'; $subject = 'The subject';
Having an odd problem running a mysqldump via crontab. I have the script running on other servers and they work fine, so not sure how to actually troubleshoot, but the script looks like the following;
If I run it as a cronjob as root, it finishes in a second and a 20k file is there. If I run it from the command line as root it does the backup (takes a few minutes) but does complete the backup and can be unzipped and read successfully.
I'm writing a Bash script to take IPTC keywords from a text file and write them, via Exiv2, to several (first batch is 100) JPEG files in a single directory. The script has one while loop inside another while loop, both terminated, but I'm pretty sure that's not my problem. I think it's how I'm incrementing the "counter" variable, although it could also be the method of parsing the text lines from the file (using cut with delimiters that have worked fine in simpler scripts).
Here's the code as I've worked it up to this point.
Code:
And yes, "keywords" checks out in Crimson Editor, Emacs GUI and nano as an ASCII file with UNIX line endings. No issues on that score.
Feeding each line consecutively into a terminal (excepting the exiv2 command) works fine: each variable echoes with the part of the text line used as a variable value as it should, even when the b variable is incremented the quick&dirty way (up arrow three commands and hit enter).
Running the above script in eval mode (sh -x) stalls after setting the b variable to one and reading in the first line of text. I'd like to know why. I'd also like some advice on another reliable method of parsing the read-in lines.
So, in finishing my nFlux slack current edition.I have set it up for users to do certain things in console and one of the things I want is a way to view slackbook-2.0 in runlevel 3 console.I cant find a pdf reader that works in command line mode and I cant figure out how to either convert slackbook 2.0 pdf into html/text Or find a slackbook download that is html or text?I tried converting it using pdftotext, which didnt work very well So, I need a command line pdf viewer or a converter that works good?
I've successfully mounted a network share with mount.cifs for the past 2 years using fstab with credfile.
[Code]....
Yesterday I moved this system to a new datacenter, but did not alter fstab or the credfile. The //server/share directory has IP rules in place, but this was updated with the new system IP while we moved the system. Now, I am mysteriously unable to automount //server/share. The local error is 13 (permission denied). The Windows server we are mounting returned a code that is defined as "username is valid but password is incorrect" Again - no changes (content or permissions) were made to my credfile or fstab entry. I've restarted netfs a few times, including rebooting the system twice. What is baffling is I can successfully mount //server/share via command line: Code: mount -t cifs //server/share /mnt/mycooldir -o username=foobar,password=1234
The username and passwords are identical in credfile and the mount options - I copied & pasted username / password from the credfile itself.
Writing script to create backup of file by adding datetime to file name. Basically test for file presence if there, cp with datetime then rm original cp works fine from command line but get cannot stat `full path to file': No such file or directory
Code:
Here are the errors: cp: cannot stat `~/html/CVP_dadamail/.dada_files/.logs/errors.txt': No such file or directory rm: cannot remove `...': No such file or directory
The for statement is a placeholder as I have same file to backup out of several directories. using "bash -x scriptname" -OR- inserting echos, I can see I've constructed the strings properly. Believing it might be related to the hidden directories, I tried setting the shopt "glob" options to no avail.
Ultimately I'll add the other directories to the for loop and then run this from a cron job, so if you see potential pitfalls knowing I'm headed in that direction...believe construct would be
I have some variables that are loaded from mysql - in mysql, the line breaks are not indicated by ' or '<br>' or anything -they are just line breaks. the variable is loaded into javascript and then inserted into a <pre> element. the line breaks are not showing up.
pre1 = pre1.replace(/>/g,">"); - this works well, naturally. but how do i get those line breaks to show up as line breaks in a browser?
Its on an older laptop, a Toshiba Sattelite M50-252. A friend of mine had this laying around, and it wasn't running windows very well. So I installed Ubuntu 9.10 on it and it was performing decently enough for browsing and mailing.
On Ubuntu 9.10 there was a problem sending large images for printing. It would make the printer (A brother HL-4050 CDN, placed on the network) say out-of-memory. Same print job from windows would not make this error. Upgrading the system to Ubuntu 10.04 worked.
Actually, I had before tried 10.04 on the machine but ended up formatting and reinstalling 9.10. This was because browsing on 10.04, no matter what browser, would simply hang randomly. A search on google could be performed, and some pages loaded. But some pages didn't load at all or only a few % of them, and the browser would just claim to be "resolving host".
On 9.10, on all 3 installs i've done on the machine, this problem was NOT to be found.
Here goes the real issue: 4 days ago I installed 10.04 to test again(6 months after its release, lots of updates has been done), and browsing worked great. The laptop has been used a lot since then and now yesterday it started stalling again. The most interesting thing is that APT-GET works fine. New software downloads with a snap. Also WGET with a single file works (although it seems to hang at the resolve once in a while).
Why on earth did it suddenly start to behave like this? Nobody with even the knowledge of using SUDO has been using the machine and it has been used ONLY for browsing. Automatic updates are disabled as well. Even weirder, this happens both using the wireless network card and cable.
I have no idea whats going on. Ubuntu 9.10 works always. 10.04 worked the second time (after a few months of updates) but started stalling after a few days. The system itself runs perfectly well, and there is nothing wrong with apt-get and so on as i said.
HPG62-144DX notebook, Windows 7 and considering Ubuntu. I installed 10.10 and tried to get my wifi running but that wouldn't work. I had a connection only sometimes and it broke up after 5 minutes. Once I got a webpage but annoyingly slooow. Got the advice to update drivers and stuff. But the wifi connection is the only one I have...
Went back to 10.4 32-bit. Booted from CD and will keep it that way until this is sorted out. Now I see my wifi hotspots directly and I have no problem to establish a connection. The icon shows 3 bars quality. Network Tools says: Wlan1 = Realtek, Transmitted bytes xxx Received bytes yyy, no errors, link speed = 1Mbps, State = active. Looks good!
The only minor thing here is that enabling/disabling my internal Atheros antanna also enables/disables my Alfa USB Wifi adapter (based on Realtek 8187) but who cares. A bigger problem is: when I start Firefox it doesn't come up with a webpage. It just keeps on saying: "loading". At the bottom of the screen it keeps saying "Looking up" for ages. Nothing further.
I have been wondering about building cheap, but usable computers to sell linux on around my city. However, my knowledge of computer parts is fairly limitied. I do know what I want to look for when it comes to certain parts, but not something such as mobo, unit case, or power unit.
If there really isn't a site, if anyone wanted to, post the kinds of cases, power units, and mobo's there are, and if possible links to their specs, and I'll start working on this myself. The only things that are a must, pci-e slot, and 2.5ghz and/or greater cpu.
Hardware compatibility:[url] [url] [url] Companies that sell linux preinstalled on computers:[url] : Many links here
First, i have no experience with javascript. I came across an interesting site and I'm curious if I could make a private webpage to call some shell commands or just open a terminal.Yes, i know this could potentially be malicious and possibly illegal. Again it's for my own private usage.
i've gotten my fedora 12 to the point where i can run python3 scripts from command line and can call up python 2.6.2 idle with the command 'idle' from command line. what command will call up python3 (3.1.2 to be exact) idle?
I need a textbrowser with Javascript Support. I have compiled the elinks stable 0.11x and the unstable 0.12x version mit JavaScript Support (js moz dev). Both browsers can be started and showed websites normaly. But no javascript, even simple tests like [URL] failed. I started elink with ./elink and typed then the url.
Are there any tricks/sites/methods to use the linux man command in a more convenient way? I love commands in terminal but for some strange reason I preferred to type man in firefox then in the terminal. The output is so long and I have to scroll forever to find what I need. Also the lack of example is a headache.
In the past week or so I've noticed some weird network behaviour. I find accessing some sites such as Amazon, Paypal, and Bigstockphoto really slow. Sometimes the page will not load at all. Other sites are fine. The problem sites are not a problem for others on my LAN at home. When I try to open the problem sites, I can see in Firestarter blocked connections coming from 2.1(8/9).xxx.xxx on various ports such as 36007. This only happens for the problem sites. I attached a typical output from firestarter.
This happens with Firfeox or Chrome. Using Ubuntu 10.10
I am trying a release of Ubuntu has have run into a problem that does not make much sense. I am receiving the following error: Syntax error on line 20 of /etc/apache2/sites-enabled/portal: Invalid command 'ProxyHTMLEnable', perhaps misspelled or defined by a module not included in the server configuration fail! I believe the modules required for this is apt-get install libapache2-mod-proxy-html and it shows under the available modules and it was enabled with a2enmod proxy-html.
The line from the config is ProxyHTMLEnable On. The release is the latest download with updates from, 32bit.
I want the gnome screenshot program to open after a 3 sec wait in select area mode.command line $ sleep 3s; gnome-screenshot --areaworksWhen I create a launcher for panel with the same commands it does nothing.I know there are many other ways to do this, GIMP, ImageMagick ....(excellent tutorial)[URL]But, I need to understand why this will not work, and why I must use a script (which I can easily create)instead
