I am looking for ways in where I could parse a web-page, say lURL... and need to parse data of the web-page. URL....Now, as can be seen the page has lot of information. I just need/want to only take the names of the packages rather than version numbers.
View 4 RepliesWe have a system called Skynet, which is basically a bunch of monitoring tools, including Nagios. What I want to do is output the status of 'critical' processes in conky. The conky part I'll worry about later (how hard can that be?), but I'm looking for some feedback on how I'm parsing the initial data. I figure that the simplest way to get the information is to query the cgi, then take what I need from the results...
Code:
wget -O - "http://user:pass@skynet/nagios/cgi-bin/status.cgi?status.cgi?host=all&servicestatustypes=16&hoststatustypes=3"| grep -i "<TD ALIGN=LEFT valign=center CLASS='statusBGCRITICAL'><A HREF='extinfo.cgi?type=2&host="
[Code]...
All I basically want is the server name and the process name, the above example giving server0/server1 and 'update status' as the service. How would you go about extracting merely these two pieces of information, bearing in mind that the server name and process are variable?
As a curious side project I'm playing with mzXML data(an xml format for holding mass spec data). A typical scan can be quite large, even up into GB size. I'm wondering how would one go about parsing an xml file in sections, one section at a time. The idea being if the computer doesn't have enough memory to load up the entire data file, work on chunks of it at a time.
View 3 Replies View Relatedi am trying to get a script that i'm calling to have information from a sql populate into rows... but i'm not getting the data to output correctly into the rows. can someone please help?
<table>
<thead>
<tr>
<th>Name</th>
<th>Help</th>
<th>Folder</th>
code....
Im trying to figure out how to display parts of a .db file created by the scorch2000 server to display a player name, games played, score and maybe more...
here is the text file format example:
playername1 password email #ofgames score setting1 setting2 setting3
playername2 password email #ofgames score setting1 setting2 setting3
playername3 password email #ofgames score setting1 setting2 setting3
playername4 password email #ofgames score setting1 setting2 setting3
playername5 password email #ofgames score setting1 setting2 setting3
I dont want to display everything, of course ^^, but how do i get the player name, the number of games he played and his score to display it in a webpage in this fasion:
Name Games Played Score
joe blow1 25 9876890
joe blow2 31 8989767
joe blow2 26 7989767
joe blow2 17 5989767
joe blow2 13 4989767
and by highest score because the log doesin't put them in in score order....
please help, i asked the maker because he has one runing already but no answer back, well the game is pretty old so i didn't really expect an answer anyways and tryed to figure it out but i dont know functions in php, this is to include in a php-nuke block (this i know how to do
here is an example of a working page at the developper website:url
I have just upgraded my old CentOS system,but something goes wrong(1) I can not enter database to MySQL from web page,and I had a "add new contact info" available there before .(2) I want to install SugarCRM to my web page,but SugarCRM can't create database with the right username and password . Other thing is OK, I can get data from MySQL from web page. Here is the package I have : php-5.1.6-3.el4s1.10 mysql-5.0.82sp1-1.el4_8
Does it because that these two packages don't match each other?
I have a few questions regarding HTML, UNIX and Javascript. I've been tasked with creating a fairly simple webpage that takes a few inputs. Each input must correspond to an argument in a UNIX command running on a server.On a UNIX server we have a script (.ksh) that takes 3 arguments. The result of the script is a data file which is FTP'ed to an external server. Let's forget about the FTP portion for now. I would like to know where I should begin.What I know so far:
1) I will need HTML to create the webpage. Skill level is high
2) I will need Javascript to make my webpage more interactive. Skill level is high.
3) I will need to understand the UNIX environment. Skill level is high.
parsing xml file using shell script and generate report in a PDF file
Xml file input:
<report>
<student name="x" father name="x1" class="first" Address="xyz">
<property name="sports" value="yes"/>
<property name="drawing" value="no"/>
[code]....
I am now working with squeeze, and my page load time on my Vista laptop, which is working off of a wireless connection, is much faster than my linux desktop, which is a direct connection.
View 5 Replies View Relatedthis is how we append a file at command line its like
cat>>file.txt
adasds
^D
but how to write the code for appending a file in a shell script i tried but its not running
cho "the contents of the file before appending"
cat ab.txt
echo `cat >> ab.txt
[code]....
I'm trying to connect to the VPN of my employer; after fix various minor issues I reach this point in which the DNS entries and the default gateway of the VPN are overwritten with the values of the eth0 device that appears by default. Therefore the vpn is not useful.
View 1 Replies View RelatedAny attempt to load a webpage gives a Cannot Resolve Hostname error. i can ping [URL], but cannot load the page. However, the page will load by typing its IP address [URL] I have been trying to figure this out for days. cat /etc/resolv.conf nameserver 192.168.1.254
View 9 Replies View RelatedI using fedora 14 and two HDD one for O.S and other for data. I manually mount the data HDD each time I put on my PC I want to write a Shell Script which will mount the data HDD on boot.
View 4 Replies View RelatedI have a tab-delimited txt file as below. It is part of the original file.Quote:
##Hello
##Welcome
#C1 C2 C3
[code]....
I need to check whether a shell script variable contains non-zero numeric data to proceed. The variable should contain numeric values, but may in fact contain zeroes, blank space or nothing. So far, I have tried various combinations of:
Code:
if test $variable
then
if test $variable -gt 0
then
echo "good data exists"
else "no good data exists"
fi
fi
It partially works, but I get either "too many arguments" or "integer expression expected".
I'm using:
Kernel 3.13.0-65-generic (i686)
Intel 945G video card
Xubuntu 14.04.3 with XFCE 4.10
Firefox 41.0.1
Google Chrome 45.0.2454.101
Dell generic usb mouse
I cannot copy a portion of an entire webpage using Google Chrome or Firefox when copying downwards.
Upwards works.
I've have this issue on the same machine with the following systems:
Debian 8 Jessie XFCe with XFCE 4.10 using Firefox or Google Chrome
Xubuntu 14.04 with XFCE 4.10 and 4.12 using Firefox or Google Chrome
Xubuntu 12.04 live cd using Firefox
This doesn't happen on the same machine with the following systems:
Debian 8 Jessie KDE using Firefox or Google Chrome
Kubuntu 15.04 live DVD using Firefox
LibreOffice Writer
LibreOffice Calc
Mousepad
[URL]
Ex. Go to google.com and paste this in the search area:
can highlight by going upwards but not downwards xfce My mouse can highlight the first line starting with the word "ssh" and the last line ending with the word "everything ..."
My mouse cursor cannot go past the last line "expressions can match many items, but evidently not everything ..."
If I scroll upward, I can copy the entire webpage.
KDE 4.x I don't have this issue.
Using Win7 on a laptop with Firefox 41.0.2 and I'm able to scroll downwards without any issues using the same mouse that was connected to the machine with Xubuntu 14.04.
Sometimes I come across fixes for linux issues on websites. I copy the information and email it to myself for future reference in case I have to reinstall the OS again. I can do a ctrl A and ctrl c but then the entire website is copied. The ads on the side, etc.
If I put my left mouse cursor on the first word in a thread and drag/highlight downwards, my mouse cursor stops line 35 on the page. If I do the same thing but backwards, my mouse cursor goes all the way up the page. This only happens on Firefox and Google Chrome. This doesnt' happen with mousepad, Libre writer or Libre calc.
I have some data ( seperated by semicolon ) with close to 240 rows in a text file temp1. temp2.txt stores 204 rows of data ( seperated by semicolon ). I want to : Sort the data in both files by field1.i.e first data field in every row. compare the data in both files and print out the rows that are not equal in seperate files. I was trying to do this with excel using vlookup, without a great deal of success. hence, i'm exploring the shell script option.
Code:
temp1.txt
1000xyz400100xyzA00680xyz0;19722.83;19565.7;157.13;11;2.74;11.00
1000xyz400100xyzA00682xyz0;7210.68;4111.53;3099.15;216.95;1.21;216.94
1000xyz430200xyzA00651xyz0;146.70;0.00;0.00;0.00;0.00;0.00
[code]....
I am in deeply need of queue (linear data structure) in shell script. How can I implement this ??
View 2 Replies View RelatedI have a script that I am using to try to measure network throughput over the ethernet ports. This is at work in order to test the performance of our onboard ethernet ports (planar) versus our pci-e (and daughter) ethernet pluggable cards.The script is very long (and calls other scripts), so I will try to only show the parts that seem to be producing this weird little bug:
Code:
#Robert de Bock's "A shell script to measure network
#throughput on Linux machines" served as the basis for
#this part of the script. Thank you for your help Robert!
[code]...
I have been trying to write a simple snip of bash shell code to import from 1 to 100 records into a Bash array.
I have a CSV file that is structured like:
record1,item1,item2,item3,item4
record2,item1,item2,item3,item4
record3,item1,item2,item3,item4
record4,item1,item2,item3,item4
And would like to get this data into corresponding arrays as such:
$record1[item1-4]
$record2[item1-4]
$record3[item1-4]
$record4[item1-4]
I am trying to connect to the web interface found at [URL] using curl. This first requires login information to be entered at [URL], but I am having an issue with the login process. I am trying to submit the following form via POST:
Code:
<form action="j_security_check" method="post" id="login_form" name="login_form">
<center> <table style="background: #cac1cf;FONT-SIZE: 12px;">
<tr> <td align="center" colspan="2">Please enter your username and password:</td>
</tr> <tr> <td align="right">Username</td>
<td> <input name="j_username" style="width: 250px" id="j_username" type="text"/> </td>
</tr> <tr>
<td align="right">Password</td>
<td> <input style="width: 250px" name="j_password" id="j_password" type="password"/> </td>
</tr> <tr> <td colspan="2" align="center">
<input value="Enter" name="enter" type="submit"/>
<input value="Clear" name="Clear" type="reset"/>
</td> </tr> </table> </center> </form>
The command that I am using for this is the following:
Code:
curl -c cookies -b cookies -L -d "j_username=user%40domain.com&j_password=pass" [URL]
The command is properly formatted as far as I can tell. I tested it with another website using a similar authentication scheme using different POST variables specific to the form and it worked fine.
When I run the above command with the -v tag, it reveals this:
Code:
* Connected to lcl.uniroma1.it (151.100.4.74) port 80 (#0)
> POST /sso/j_security_check HTTP/1.1
> User-Agent: curl/7.21.0 (i686-pc-linux-gnu) libcurl/7.21.0 OpenSSL/0.9.8o zlib/1.2.3.4 libidn/1.18
> Host: lcl.uniroma1.it
> Accept: */*
> Content-Length: 44
> Content-Type: application/x-www-form-urlencoded
>
} [data not shown]
< HTTP/1.1 408 The time allowed for the login process has been exceeded. If you wish to continue you must either click back twice and re-click the link you requested or close and re-open your browser
< Date: Sat, 29 Jan 2011 15:26:41 GMT
< Server: Apache-Coyote/1.1
< Content-Type: text/html;charset=utf-8
< Content-Length: 1554
< Connection: close
<
{ [data not shown]
103 1554 100 1554 0 52 5081 170 --:--:-- --:--:-- --:--:-- 10223*
Closing connection #0
I cannot tell why the login timeout is expired when I try to do this, and my investigation toward this end has been fruitless. I saw a brief snippet on Google that vaguely suggested that the underscores in the domain name were at fault, but replacing these with their encoded counterparts did nothing to resolve the issue (that, and underscores should be fine when sent unencoded according to the standards). I have extensively perused the man pages and have come up with nothing to adequately explain this behavior. I also talked to a friend who has worked with curl in his line of work, but he mostly has experience in the context of PHP and has not dealt with this issue before. I am running GNU/Linux 2.6.35-22-generic-pae.
I have two machine, host1 and host2, that are running Debian 3.1 in an HA setup. AFAIK, they are exactly the same. In the course of tracking down some monitoring bugs, I discovered that on host2 "netstat -s" gives
[Code]..
I have logs files from freeradius that have looks as follows:
$ grep "Login incorrect (rlm_ldap: User not found" /var/log/radius/radiusd-inner-tunnel-20090831.log
Mon Aug 31 09:25:27 2009 : Auth: Login incorrect (rlm_ldap: User not found): [John Doe] (from client oficina port 0 via TLS tunnel)
[code]....
I use the following line to get the amount of users that don't exist on ldap:
Code:
grep "Login incorrect (rlm_ldap: User not found" /var/log/radius/radiusd-inner-tunnel-20090831.log | awk '{print $14}' | sort -fu | wc -l
Now, awk on line one for example parses [John Doe] and [Joon Williams] as "[John" and that it's not what I'd want. I mean how could I do for awk looks username field as closed between squared brackets?
I am trying to parse this file and wld appreciate some assistance:
FILENAME=XUXESS.TXT
RECORD=44
S_KEY=
[code]...
The panel plugin from xfce4-mixer has a bug:s icon doesn't update as the volume is changed. This bug has already been reported.One curious thing about it is that, if you right click on the volume icon on the panel, go to 'Settings' (or 'Properties', I don't know, mine is in Portuguese) and then close the window that pops on the screen, the icon is updated.Is it possible to open and close the settings window automatically with a bash script? Like this, I could associate this script with the volume keys of my keyboard, so that the icon is updated as the the volume is changed.
View 2 Replies View RelatedI've reinstalled my system and installed apache. I've installed php5. 'a2enmod php5' returns with a message telling me that php5 is already enabled.
However, this code does not parse:
Code:
</php
phpinfo() ;
/>
I get a blank page. When I view the source code for the page, I see the php code.
How do I get php to work?
I am working on the script to parsing the log message . the followings are my task:1. Read the multiple log files, such as N1-2009-10-01, N2-2009-10-2, N3-2010-01-02....2. Parse the specific message, such as "aaaa"3. If found the "aaaa" message in the log file and export to excel file PS. i use zgrep:zgrep -a --text "aaaa" * > /home/TTS/myfileand inside file looks like:
N3.2009-11-26-03-05-02.console.log.tar.gz:2009-11-25 20:12:57,429 - aaaa
N4.2009-11-29-00-25-03.console.log.tar.gz:2009-11-28 10:42:18,209 - aaaa
N6.2009-12-01-10-05-02.console.log.tar.gz:2009-12-01 10:00:24,902 - aaaa
[code]....
I keep getting Firefox XMl Parsing Errors(64 bit firefox). It's driving me crazy. Even in safe mode this happens.
View 1 Replies View Relatedparsing the text file in perl.I have very large text file with plenty of columns and rows.how can i parse the file into Oracle database.
View 3 Replies View RelatedI want to parse the AT commands using C programmemy problem is to send message using At commands in minicom from one system to other system using socket programmingif i will send here AT on other system it should respond as OK,and if we will send AT+CMGS="ip address" "message", on other system this message has to display can any one please tell me the code in C language
View 1 Replies View Related