General :: Processing Log File Within Certain Dates Based On Filename
Apr 8, 2010
I am working on the script parsing specific message "TEST" from multiple file. The log file name looks like:
N3.2009-11-26-03-05-02.console.log.tar.gz
N4.2009-11-29-00-25-03.console.log.tar.gz
N6.2009-12-01-10-05-02.console.log.tar.gz
I am using the following command:
zgrep -a --text "TEST" * | awk -F"[ .,]" '{sub(".*:","",$6); sub(",.*","",$7); print $1,$6,$7,$10}
and getting
N3 2009-11-25 20:12:57 TEST
N4 2009-11-28 10:42:18 TEST
N6 2009-12-01 10:00:24 TEST
If I only want to search the log file after 2009-11-29, what shall I change the command?
View 1 Replies
ADVERTISEMENT
Jul 13, 2011
I have tried to find the solution for my problem on this site and other sites but haven't found a good enough answer yet. Maybe some of you can help me out here?What i need is a script (bash preferrably) that can delete directories based on a date in its dirname.For example.I have a bunch of directories that is named
data-20110623/
data-20110624/
data-20110625/
[code]...
View 5 Replies
View Related
Jan 22, 2009
In Linux, the files were processing based on timestamp. How to process the files based on alphabets? My application is in windows. Here I am processed the files based on alphabetical order. While coming to linux its coming wrong.
View 5 Replies
View Related
Mar 5, 2010
I have a very large directory with probably millions of small files in it. It's taking forever to run ls on the directory.
Is there an easy script that I can run to split the directory into smaller ones, based on the prefixes of the filenames. My goal is to wind up with something similar to what the Debian archives' pool directory looks like.
View 1 Replies
View Related
Sep 13, 2011
I have many files in a folder for example
Kiran.txt
Kiran1.txt
Kiran221.txt
Kiran144.txt
Time.csv
[Code]...
From this directory, I want to know how I could use grep to display files based on part of their filename - for example those starting with "Account" or those ending in ".sh".
View 4 Replies
View Related
Jan 11, 2010
I need to get the modified date on a file in linux to use in a script.I tried using 'ls -l' on the file, but this caused problems when the date turned from a single digit into a double. The reason for the problem was because I was parsing the result string on spaces.How can I get the date of the last time a file was modified so I can use it in a script? For example, if a file was modified on 1/11/2010, I need the 11.
View 2 Replies
View Related
Nov 2, 2010
I'm currently trying to organize a media server so that things will be in some kind of logical order rather than the current setup of dumping everything of a certain content type into a single folder. However, the size and diversity of content within these disorganized folders precludes me doing things manually. Does anyone know of a program or script that could sort the files into folders based on part of a filename
View 7 Replies
View Related
Jun 17, 2010
Since I'm not building a specific piece of software but a shell script, I hope this is in the right forum. At work, we use RHEL for the basic system but have Windows clients attached as well. On the Win side, there's a program that I'm trying to duplicate on the Linux side. Because of established procedures, I can't change the way files are named so please don't suggest I do that (my boss would not be happy). We have files stored on an NFS share we manipulate on either side.
The program is used to copy files from one directory to another, based on the filenames. The first two characters of the filename are ignored (they're for human-readable sorting purposes only), the next four characters are the time, and then all characters after that are ignored. The time is read and the file gets copied at that time. (This was all done in VC++ many years ago, and nobody knows where the source code is.) For example, a file named 2d0730abcd.txt would be copied from the source directory to the destination directory at 7:30am.
It seems to me that it should be fairly straightforward to build a shell script on the Linux side to do the same thing, but darned if I can figure out which magical combination of commands to use. Would the shell script end up creating a giant pile of AT commands?
View 10 Replies
View Related
Jul 6, 2010
I have a single directory of pairs of files, with the pairs sharing a string as the beginning of the filename:
SF1-27F1492R-clone01_T3_A18_001.ab1
SF1-27F1492R-clone01_T7_A20_002.ab1
SF1-27F1492R-clone02_T3_A19_003.ab1
SF1-27F1492R-clone02_T7_A21_004.ab1
...etc
I need to create a subdirectory for each pair then move the pair into the subdirectory.
I accomplished the first step using:
$find /foo -name '*T3*' -exec mkdir '{}.wrk' ;
I can use a regex to designate the pair and associate the directory, but how do I use regex in a path as the output of a move command?
View 7 Replies
View Related
Jan 23, 2011
$ uname -a
Linux a 2.6.35.10-74.fc14.i686.PAE #1 SMP Thu Dec 23 16:10:47 UTC 2010 i686 i686 i386 GNU/Linux
$ lsb_release -a
LSB Version: :core-4.0-ia32:core-4.0-noarch
[Code].....
How can I set a pattern that will output a filename equal to the original filename? E.g.
something.mp3 → something.ogg
And why isn't this implemented in SoundConverter?
PS: {Filename} doesn't work.
View 1 Replies
View Related
Apr 23, 2010
What is the difference between filename and ./filename? Under what circumstances is one preferred to the other?
View 5 Replies
View Related
Nov 28, 2010
Kernel 2.6.21.5, Slackware 12.0
I saved a page from Linuxquestions. It was saved under a filename beginning with '[' (left square bracket). And I now can't delete the file. Unfortunately I cannot send you a screenshot because opening a terminal in the GUI makes ls behave differently. I shall try to describe, assuming the file is in dir '.'. Also let '[SOLVED]foo.html' be the file in question:
Code:
$ ls
<the file is listed>
$ ls [*
/bin/ls: cannot access [*: No such file or directory
$
If I want the hdd to get rid of this file, what should I do? Any hint will be welcome.
View 2 Replies
View Related
Mar 5, 2011
I want to write a script. I have the basic form working... but I would like to add some advanced features. I have a list of .zip files that have a version number in the filename (i.e. sudoku-134.zip, sudoku-176.zip, sudoku-203.zip, etc). I would like to have a script that will find the latest version of each game, and unzip it. I want the next to latest version left untouched. But anything older, I would like the unzipped folder deleted (But leave the .zip file)
Here's what I have so far:
Code:
#!/bin/bash
cd /var/www/vhosts/server.com/httpsdocs/games/$1
for file in `ls *.zip`; do
if [ -d ${file%.*} ]; then
echo
else
mkdir ${file%.*}
cd ${file%.*}
unzip ../$file > /dev/null
cd ..
echo 'date' $file >> /var/www/vhosts/games4roku.com/private/$1.log
fi
done
I can call the script with "game-unzip public" to unzip all the public games.
Here's my files:
Code:
sudoku-134.zip
sudoku-134/
sudoku-176.zip
sudoku-176/
When I add the latest version, sudoku-203.zip, I want it to unzip it to ./sudoku-203/ and rm -rf sudoku-134
View 2 Replies
View Related
Mar 21, 2011
I am using cent os 5. When we turn on the PC I can see things which are going to be loaded and the status is [ok] in green colour. Which file linux uses for this process.
View 1 Replies
View Related
Sep 20, 2010
I'm having problem with the Samba 3.2.5 file share which host my MS-Word Document the user (user1) already restart her PC but still she cannot open the file from MS Word.
Here's the file and it's status on the samba drive:
Code:
How to reset the Samba file locking mechanism ?
View 6 Replies
View Related
Aug 14, 2010
I am using Ubuntu 10.04. I wish I could use Nautilus to change file dates, but I guess that does not work.
Is there another file manager, or something, that allows me to do this? I know about the touch command, but that's a little cumbersome for I am trying to do.
View 2 Replies
View Related
May 29, 2010
i want to know why do we need to patch files based upon diff when we can directly overwrite the old file with the new file.
View 4 Replies
View Related
Feb 28, 2011
My employer issues pdf files with everyones work schedules. I copy the content and save it as plain text in a file called unformatted (hope to be able to automate this step someday). Im working on a SED script that reduces unformatted to only display what I want to see and saves the result in a file Iïve named formatted. After that I have to manually copy formatted and save it with that days date as a filename e.g. 2011-02-25 or whatever day is scheduled in the pdf, for use on a mobile device (Nokia N900). I noticed that the date occurs on certain lines in the file so I added a line like:
sed -n 's/^Date: (201[1-9])/([0-1][0-9])/([0-3][0-9]).*/1-2-3/p' < unformatted >theDate
That creates a file theDate with the date in it that I wish to use as the filename for this particular instance. So I would like to skip the file formatted all together and have the sed- script write to a new file using the content of the Date as a filename, but how do I make that happen? And of course it would be more elegant if I could skip the intermediate theDate file as well.
View 4 Replies
View Related
Jul 14, 2011
I'm trying to create a script that will look for a "filename" under /etc/, date stamp the file and copy it to /var/www/upload
View 5 Replies
View Related
Apr 6, 2010
I need to split a filename into its filename and extension, so I can append a datestamp to the filename. I'm using bash.
View 8 Replies
View Related
Nov 20, 2009
I've installed ethernet adapter, it is made in china from a manufacturer called FOX. The driver for that adapter is supported for sco linux kernel version 2.4.x and 2.5.x .However, I'm using Centos5 but the OS didn't recognize the adapter alone, so I'm trying to follo instructions on the driver on the attached CD.
The CD contains file named "SC92031.c", the instructions tell me to do the following "Compile the driver source files and it will generate sc92031.o"
View 8 Replies
View Related
Oct 29, 2010
find / -newer -10 mtime +30.i want to check only those files which are modified yesterday.
View 1 Replies
View Related
Mar 1, 2010
New to Fedora (from Windows), I am up and running ok with packages from the repository but only half ok with Processing, the Java graphics programming front end from processing.org.Their download gave me a .tgz file which Package Manager extracted for me into a location of my choice and where there is now a "processing" shell script.This works ok and I have managed to create a launcher on the desktop. That starts ok but always with processing's default action of giving you a new and automatically named work file.In Windows an existing Processing file (.pde file) could be "opened-with" Processing. Trying to do similar in Fedora I find that I am expected to nominate an Application to open with but Processing has not installed as an application.I guess the question is how do I promote Processing to be an Application?Or is there a different approach?
View 4 Replies
View Related
Feb 22, 2010
I am getting little bit difficult in sorting the date ranges which are in a field like:
How make a sort as per the Month and date , i mean result should be as per the month and date wise. If i go for the sort -M , i am not able to get the list as per date of the particular month.
View 4 Replies
View Related
Nov 5, 2009
I have a file that stores employee login IDs, names, types, and permissions. Our software reads the information based on byte-columns, so it reads a column as any ASCII character (spaces, letters, numbers, punctuation, etc.). I want to create a web-interface for adding and removing users, and storing the data in a MySQL database. However, if I am creating the files from the MySQL output, I need a way to write to specific column locations in the file ...
User ID: Columns 1-4
User Name: Columns 6-30
Type: 32-40
Permissions: 42-45
I want to use a scripting language, preferably C-Shell, to call MySQL for the data and write the data to the correct columns of the file. I wrote a script that takes the data from the file, and dumps it into the MySQL table, so maybe I can pad the remaining space in the table column to fill with spaces ...
View 12 Replies
View Related
Oct 12, 2009
I need to compare 2 dates in european format (dd/mm/yyy). date -d<my date> %s command converts date into unix epoch (integer), thus make it easy to compare. The problem is that -d (or --date) option interprets date in US format-ie mm/dd/yyy.
View 4 Replies
View Related
Mar 20, 2010
All I see from googling examples in awk is converting current date. How do I convert a list of past or future dates for example :
Jan18'09
Aug 7'98
Jun20'11
Apr 1'10
I will be using it to compare dates in a file and act on it accordingly.
View 5 Replies
View Related
Jun 8, 2010
I was going to do a rsync -r -a -z -v -p -e sshto move some files frome server to another, but then realized all I really need are files which have dates starting June 1, 2008 to current. Is there a way to have rsync only sync those files?he directory structure that's my source goes all the way back to 2004.
View 5 Replies
View Related
Jan 30, 2009
I'm not sure if this is possible or even where to start. I assume that this can be done with an sh script using tar or similar.I have several very large zip files that contain images for all of the products in my online store. Each image is named after its 13 digit SKU (for example, 9987788000012.jpg). In order to import products into my store, all images are placed into a media directory. Unfortunately, there are over 100,000 images.
So I would like to break the images into sub-folders based on file name. For example, when I extract store_images.zip (or tar or whatever), my extract script would create directories (if they don't already exist) based on the first three digits of each image name, placing each image into the appropriate bottom level directory. For example, "9987788000012.jpg" would be placed in the following directory "media/9/9/8", with media as the root and "8" as the directory that holds any images that start with "998". Perhaps two sub-folders would be less cumbersome.Assuming this requires a script, particularly since it involves scanning image names, creating folders, and saving images to specific directories, which language would serve my needs best? PHP? Has anyone had to do something similar?
View 13 Replies
View Related
Apr 2, 2010
How to make sure that when I save a pdf file, the file extension .pdf appears in the filename? Its a silly little thing, but annoying. The file browser recognises it afterward as a pdf file though, it opens with document viewer ok.
View 9 Replies
View Related
