Programming :: Getting A Script To Continuously Monitor Appended Data To A Log File?
Oct 13, 2010
Code:
if ! [ -f ${PATH}/myfile.txt ];then
echo $(date +%Y%m%d"_"%H%M%S)": Nu am gasit fisierul ${PATH}/myfile.txt"
ps -fxu pin | grep "/usr/local/coreutils/bin/tail -f ${LOG_PATH}/x.log$" | awk '{system("kill "$2)}'
cat ${LOG_PATH}/x.log | sed -n -e '/LONG/{x;1!p;g;;}' -e h > ${PATH}/myfile.txt
[code]....
I have a continuously growing log file (x.log) in which i have to look for certain lines that contain "Long". The line above each line containing the word "Long" it contains a time stamp. I want to extract each line containing the time stamp into myfile.txt and check the difference between time stamps. Whenever there is a difference i need to run another script (${CAL_PATH}/${APP_NAME}), then sleep 1, then continue searching. Lines with "Long" do not appear continuously, but in blasts. The script runs fine until the first pause encountered. Starting with the first pause, tail -f doesn't write in myfile.txt anymore. Can someone help me understand why "tail -f" it stops writing into myfile.txt? Or does someone know an alternative to "tail -f" of achieving the initial scope of the script?
I am having a problem with two linux boxes I have. They are running Centos 5.3 and Centos 5.4. The problem is that when I log in, this file /etc/host, under the etc directory get appended the username I am logging in as, the IP address I am logging in from, and worse, the password in clear text.This is the format it uses:username@IP (password in clear text) [Tue Jan 12 2010 13:00:26 -0500]Is it possible for someone to tell me what is this about, and how to stop it?
I'm thinking of a web based app that will monitor temps and values fed in from a data acquisition device but am seeking advice on what to use to produce the web page would php be powerful enough? The app will also have to have access to a shell for scripting, I know thats a security risk but it will not be in an exposed env. The web page will have a series of lcd readouts displaying the aquired data refresh rates will probably be around 5 seconds along with control buttons to turn on and off values. Storing data in a mysql database for statistical reports would be needed eventually. Ubuntu 9.10 will be the os. Is python easily integrated into apache?
how to update a series of values from multiple grep commands outputs to be appended to a single row of a csv file? Work on a linux envir. The values from grep output will be numeric values.
Output sold look like:
1,3,4,5,7,0,5
Each of these values will be odtained from multiple grep commands piped with wc -l Is it possible to update a single row of a csv file if so pleas ehelp me with the command to be used to redirect the output into the csv file
In a lot of programs I write, I would love the option to simply hit a key without disturbing the data, and have some other action take place.
An example loop would be,
Code: for(some var = 0; some var != infinity; some var++){ if(poll(left mouse button)){ stop doing this stuff; } . . . doing other stuff, because the left mouse button wasn't pressed }
but, I don't want the loop to pause for more than a the tiniest fraction of a second, and I certainly don't want it to sit there waiting for me to do, or not do, something.
What is it I'm looking for?
(Oh, and if you haven't guessed, c/c++ are the languages of choice for this operation - I don't care which you might have in mind when submitting an answer -- in fact, it need not be either of those languages.)
I am working on a C++ application, using the latest Slax as distro and CodeBlocks 8.02 as IDE.
I have a problem that is really biting me hard... And i'm sorry if my questions will sound trivial: i'm still a C++ noob... Basically,looking with KSysGuard i can notice a constant increment of the VmRss parameter,i.e. the resident set size of my program.
While stepping with the debugger i noticed that the VmRss parameter increases by 4 (KB?) when i push_back into some STL vectors (i have this problem in various parts of the code).
While i analyze the problem with KSysGuard i'm also looking at the /proc/statm file of my process. When KSysGuard shows a VmRss increment by 4, i can actually see an increment (by 1) in the 2nd parameter of that file (which is the resident set size) but not in the 1st parameter (which is the total program size).
What surprises me most is that the VmRss is reported in KB and i really am not pushing 4 KB inside the vector all at once...
So i ask:
1)Is this a memory leak?
2)Why the total program size doesn't increase?
3)To me, it looks like VmRss increases "cumulatively" only after several insertions in the various vectors.
have a tag in XML file in unix like this <EmailAddress>abc@gmail.com</EmailAddress> this tag is there for multiple times in the xml file and the data is in continuous line like below State>UN</State><Zip/><CompanyName/><EmailAddress>FDF@gmail.COM</EmailAddress><PromoType>UNKNOWN</PromoType></Promotion></PromotionList<State>UN</State><Zip/><CompanyName/><EmailAddress>zd4946@gmail.com</EmailAddress>I have to check the data in between bold tags is valid or not ... means have to check whether its a email address or not and have to find the length of the attribute means tag ...script is in kshsorry if its already asked...i checked but i didnt get Exatly matching result for my requirement
This code uses ping to check connectivity to a remote location and logs it to a .html file which is then stylized by css..
Code:
#! /bin/bash path="$HOME/Desktop/IP_Monitor" #Path to write out files ALT="0" #For styling alternative row
[code]....
I need to add a feature such that instead of hardcoding the ip address .. it takes them from a list and makes new files for each ip address for logging.. And also when log files are completed , They should be compressed using tar. How should i go about adding both these.. This is my first bash script.
i have file server 1 (filesvr01acess.log) and disc server 1 (discsvr01acess.log) in unix box(say ip adress of the box 10.39.66.81) Similiarly i have file server 2 (filesvr01acess.log) and disc server 2(discsvr01acess.log) in unix box(say ip adress of the box 10.39.66.82). Now my requirement is write sheel script for ..
1. I need only last 24 hour data out of the file server 1 and file server 2 and then finaly put this data in one new file
2. Similiarly same need for discserver 1 and discserver 2.
FYI, each .log files mentioned above is nicely order as date and time as it is created. I can view through cat or search by using grep comand in unix I am wondering if we can achieve through grep command in unix
I want to know that is there any method to grep a particular data from a file without using the "cat --- | grep ' ' " command....I need to use a system call for this functionality.
i want to open a txt file and then read line by line and display data with first line and label it 1 and then incremented by 1 for each additional line.
I have two files of data with different numbers of columns and rows. I want to read this two files in two arrays and then compare for example the second column of first data file with the third column of the other text file and if the difference between of two numbers is less than a threshold then the program print the information in the rows which fulfill this condition in the third text file. I have written below program but the problem is that it does not go through all rows of second file.
declare -a a declare -a b r=` awk '{n++} END {print n}' second.txt ` echo $r awk ' {
[Code]....
Actually I have two data files one of them contains 44406 and the other one has 12066 rows and I want to check whether the difference between the components of two specific columns is less than a threshod but I have simplified it here. I had written this code and then I have realized that this code just goes through the number of rows as the same as the first.txt file and ignores the rest. I could not find the problem yet.
I am writting a program that reads a text file (music.txt) & stores it in a Data Structure. I am a novice learning over the internet so I this is something I have never done. How do I do this?
Quote:
Write a program that reads the data from the music.txt file and store it in a data structure. To implement this data structure you must use an array of songs and each song must be represented by a struct with appropriate fields. So far all I can do is open to file to read it (very simple I know) but so far is it correct?
On one of my servers, it appears that a bunch of html files got the following code added to it...Quote:[URL]I was going to try to remove this line using grep & sed... as sample grep -lr -e 'apples' *.html | xargs sed -i 's/apples/oranges/g'I can get the grep portion to work...
Code: grep "<script src='http://b.rtbn2.cn/E/J.JS'[>][<]/script[>]" * But not the sed
When I chose options 1 thru 3, that executes with no problem (Menu=Download does not work). The program sees into field four, but field four is not able to see outside itself. For instance:
Code:
Download:chan: Download:pitm:1:echo $numpi. Return to Main Menu Download:pitm:2:
[code]....
is used to generate a numbered list of channels. It could be four or 40. Whatever the number is, I want the next line to read, for example, 32. Return to Main Menu.
Code:
num
is the variable in the script I use to number the list of channels. The number following Download: pitm: is numpi, which should be added to num. How do I take
Also, the CSV file is updates every few hours and I need to load any new data from the file to the database without creating duplicates of data that has already been loaded to the database.
I made a BIG mistake and tried to print a PDF document from Evince 2.28.2. Evince sends a garbage filled print job to the queue that results in nothing but garbage being printed. I noted the problem an tried to kill the print job but could not because it does not show up in the print queue. It appears that the printer sent an error back to the print system and the print system now continues to print the job forever - that is, anytime openSUSE is running, even after reboots.
Note that printing the test page works and that the printer also works fine with gedit and OpenOffice.
If I go to Control Center -> Printing then right click on the icon for the printer and click View Print Queue, the print queue is empty.
In YaST Control Center -> Printer -> Policies the "Specify error policy" is set to "abort and delete the job and proceed with the next job." The "Apply this error policy to all local printer configurations" checkbox was checked when this policy was set. If this is what should have ultimately killed the job it did not work.
how to stop the print system from trying to print this garbaged print job. It has been trying to print the same garbaged print job for the last five days!
I have a very large data file, with 3 numbers in each line, ex. 3 4 5 ; 6 7 8.I want to add two numbers (0 and 1) at the end of every line, and a string at the beginning of the line. Does anyone know a efficient way to do so?
All I want is a command that reads one data file with several columns and prints it in another one.However, whenever the value in one specific column alters, it prints one empty line in the new file. For example, consider the file
Code: stuart@stuart:~/$cat showthread.php.html | grep -o [URL][^"< ]*" | uniq | head -n3 | plowdown - cannot stat '-': No such file or directory Code: stuart@stuart:~/$ awk NR==$x Musiclist.txt | cut -d/ -f6 | basename $1 .mp3 .mp3 Here's some system info on the bash i'm using:
I have a problem with arrays in awk. What i want is to take some data from a file (ssh log) and print it to a html table. I have managed to print some stuff (user logged in and how many times they have logged in) What i want more is to take all the ip that each user logged in from and print it in a row next to the username and times (in the code i typed blabbla where i want the ip to be shown. How do you think i should approch that, multidimensional arrys maybe?
I don't know what I did differently before this happens. Now I cannot access files or see icons on the desktop. The "starting file manager" continuously loops in the bottom panel, continuing to load forever. in the system monitor, if I kill the process "gnome panel", it resets itself, then continues the process. Only thing different I did was install that one thing that gives you System->Preferences->Windows by hitting "yum install control-center-extra".
trying read serial COM port and want to write that received data to file, now its writing only one sentence, but i want to write full file which coming on serial port, as i'm sending file from hyper terminal and reading on linux pc, If i put while loop its not writing anything,without while loop its writing only one line and if send big file then application terminates and then writes to file.But i need do write any size which coming on serial port.Finally i want write full file which is coming on hyper terminal, after writing the file it has wait for next data. This is my code,
