Programming :: How To Improve Sed Script To Split File

Aug 26, 2010

If there's another way to improve a script that I have created, since I'm not an expert! It works, and it made what I wanted, but it took a while to do it... maybe it can be improved. Here's the background. I have one file, with 244000 lines, let's call it X. I needed to split it in 1000 files, each one of 244 lines. I also needed the files to have the .arp extension. So here is what I did:

Code:
for i in {1..1000}
do
sed -n '1,244p;244q' X > $i.arp
sed -i '1,244d;' X # in this way I deleted the copied lines each time
done

View 12 Replies


ADVERTISEMENT

Programming :: Split A File To Multiple File Using Awk Or Perl?

Feb 27, 2011

I have a single file that contain multi-text something likes this:

Quote:

No. Time Source Destination Protocol Info
185 27712.068199 192.168.18.23 192.168.18.191 SMTP S: 250 2.1.5 Ok
No. Time Source Destination Protocol Info
186 27715.068293 192.168.0.50 192.168.5.2 TCP suncacao-jmxmp > 44693 [ACK] Seq=1 Ack=1 Win=64807 Len=1380

[Code].....

View 14 Replies View Related

Programming :: Split File When Integer Is Found

Jun 25, 2010

I have a file in which contains one line with a lot floating points.In the very first place and some times in the downstream, there are a few integers, surrounded by blank spaces.1 1.02-4 1.03-5 544 1.04-1 65 2.98-1 5.78-10 3.45-2 etc etc.I aim to split the file in more files each of them containing an integer and the following floatings until the next integer.

View 1 Replies View Related

Programming :: Bash: Split A Text File Into An Array?

Sep 18, 2010

I have a file (called twitterstatus.tmp) that looks like this:

Code:

<status>
<id>24854489768</id>
<text>Are we gonna ride the sun home?</text>
<id>55266987</id>

[code].....

How could I feed this into an array, with each element containing everything between the <status> </status> tags?

View 9 Replies View Related

Programming :: Split / Break Up Large Text File

Feb 18, 2011

I have a large text file with three columns. I'm trying to write a PERL script that splits the file up based on the value of the 3rd column. So every time the third column reads 0, a new file is created and all the data up until the next 0 is found is written to that new file. This should happen over and over until the initial file has been entirely split up.

ex data:
000
2024
2243
2143
96962871
97972878
000
2034
3034
3352

So with the data above, the file would be split into two files:
data_1.txt would contain
000
2024
2243
2143
96962871
97972878

and data_2.txt would contain
230
2034
3034
3352

View 10 Replies View Related

Programming :: Split Open Same File And Edit Only 1 Window?

May 14, 2011

whether it is possible to split open a file and edit only one of the open windows.

View 2 Replies View Related

Software :: Split A File, Without Using 'split'?

May 20, 2011

Im in a unique situation where a box has a 400G file, on FreeBSD, without thesplit' utility available

View 11 Replies View Related

Programming :: Will Multi-Threading Improve Performance?

May 18, 2011

So I have built a program that takes a picture from two cameras every second and converts them both to jpeg format. The problem is that currently it takes ~2 seconds to convert a single raw photo to jpeg format, thus every second I add another raw photo (30 MB) to ram waiting to be converted to jpeg. So, theoretically the conversion to jpeg is running on a single core with hyperthreading, would I see better performance running the exact same process (a program pulling from a queue and converting to jpeg) running as a single process, or two concurrent processes? (both processes running on the same core, (so 1 thread on one clock cycle, the other on the other... (or one thread running on 1 core and the other on another core. What other steps would you take to improve the performance so there would no longer be a race condition?

-Currently using QT

View 5 Replies View Related

Programming :: Created Python Programs - Making Changes To Improve?

Dec 17, 2008

I have list of programs which I have created during the past few days, all the programs are attached in txt files, and if anyone can do favor, and double check if they work, and what changes I can make to make it look different, or to improve it.

View 9 Replies View Related

Programming :: Split A String By Every Nth Characters?

Jan 17, 2011

splitting a string by every nth characters. I'm using Python 2.7.1 because I'm using older libraries, if that matters.

For example, if this is my input:

Quote:

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed ac elit nibh, vitae venenatis ligula. Vestibulum a varius turpis.

Splitting it by every 10th character should produce this list:

Quote:

[ "Lorem ipsu", "m dolor si", "t amet, co", "nsectetur ", "adipiscing", " elit. Sed", " ac elit n", "ibh, vitae", " venenatis", " ligula. V", "estibulum ", "a varius t", "urpis." ]

View 6 Replies View Related

Programming :: Catching The Output Of 'split'?

Mar 10, 2010

How do I catch the output of split and redirect it to another directory?for example,if my working directory is 'Documents' and I split a file called text.one into 4 files of 100 lines each (xaa, xab, xac, xad), how would I get those split files to be written into 'Directory/subdirectory' instead of 'Directory'?And is it possible to rename those split files so that the split name is suffixed with the original file's name e.g instead of xaa, xab... can they be written as text.one.xaa, text.one.xab..?I've thought about using '>' to send the output to a new directory but it doesn't work; and I've thought about piping the results to another command but I don't know what that other command should be.

View 2 Replies View Related

Programming :: Split A Pattern In Perl?

May 17, 2010

I am trying to split a pattern in perl and so far I cannot get it to work. I have a pattern that looks like this:

76|2455311|2455312|00:00:00|00:00:00|Once|0|Donkey | |

I always need to print out the 8th field. So in this case donkey. Here is what I have so far:

Code:
#!/usr/bin/perl
use strict;
use warnings;

[Code].....

View 6 Replies View Related

Programming :: Perl - Use Of Uninitialized Value In Split?

Apr 14, 2011

I'm currently teaching myself perl. I'm trying to write a program that unscrambles words by comparing each element in the array. There is an input file where you type the words to be unscrambled and there is a word list file containing approximately 1300 words. After everything has been processed the program is supposed to paste those words to an output file.

Code:
#!/usr/local/bin/perl
#use strict; #always add this in the beginning of code.
#use warnings; #always add this in the beginning of code.
#open(INFILE, '<', 'sample.txt'); # For reading
#open(INFILE, '>', 'sample.txt'); # For writing
#open(INFILE, '>>', 'sample.txt'); # To append .....

View 4 Replies View Related

Programming :: How To Grep Pattern Which Is Split In 2 Lines?

Dec 9, 2010

I need to grep a pattern which can be present in one line or could be split in 2 lines.Normal grep wont work in this case. Can anyone please help on this?There are 100's of files in which i need to search for this pattern so time is also a constrain.

View 5 Replies View Related

Programming :: Split Fields In A Perl Array?

Dec 16, 2010

I have an array called @logons. How can I step thru the array and split the fields? This is what I have so far, but doesnt work. I got the feeling I the split statement syntax is incorrect.

Code:

print @logons;
foreach my $logons(@logons){
($userid, $ip) = split(',',$logons);

[code]....

Update: Appears the data in @logons has a column header from the mysql query which I used to populate it with. So that code which I was testing does indeed work.

View 10 Replies View Related

Programming :: Split String Into An Array/list Of Lines In C++?

Jun 4, 2010

How can i split a string like this,

Code:
This is my first line.
This is my second line.
This is my third line.
into,

Code:
"This is my first line.", "This is my second line.", "This is my third line."
in C++.

i.e. split the code at every new line

View 11 Replies View Related

General :: Split A 7 GB .VOB File For DVD Authoring?

Jan 13, 2011

I have a 7 GB VOB file which I created from a DVD using ffmpeg dump to remove CSS protection (it is legal where I live to do so). Now, I want to create a DVD/.iso that will be understood by regular DVD players/appliances. How do I do it?

View 1 Replies View Related

Software :: Split A File By Section?

Aug 27, 2010

How would I go about splitting a file by section? Imagine the file looks like this:

Lots of text 1
Lots of text 2
[HEY, SPLIT HERE]

[code]....

I want to use a command that would split this file, but look for the text "[HEY, SPLIT HERE]" to get the split points.

View 2 Replies View Related

Programming :: Split Multi Line Record Into Multiple Files With Awk?

Nov 11, 2009

I have a large file 'NS0923.csv' with data like the following. There are two records in this multi-record sample.

Code:

E60898,4578910,03/06/09,BEN BOYD RD,61,82,,,127,3,,52000.3046.001,3155,4.00,,PLT,1356,1.00,05/06/09,Y,Y,0551
,,,,,,,,,,,,4057,1.00,CLEAN CAR SHARE SIGN,LAB,0551,1.00,,,,

[code]....

2. I still have to create a file 'transaction.csv' that should retrieve data from $13 - $15 with the identifying column $1. Required output:

Code:

E60898,4057,1.00,CLEAN CAR SHARE SIGN

3. And finally another file 'quantity.csv'. Retrieving data from $16 - $18 with identifier $1. Required output:

Code:

E60898,PLT,1356,1.00
E60898,LAB,0551,1.00
E60898,LAB,3065,1.00

[code]....

View 10 Replies View Related

Programming :: Split Mysql Date Query Or Hide Some Output?

Feb 22, 2011

So I've got a rather vast database, one of the columns is date in the following format: DD/MM/YY HH:MM:SS. This is starting to cause problems with a php page I'm writing which asks the user for a 'start date'. Would it be better for me to split the date column into date and say time? Or is there a way of using distinct and masking the times.

View 10 Replies View Related

General :: Split A File Into Multiple Files Using AWK?

Aug 5, 2010

I have a file with 5 columns. Column 4 contains numbers.Is it possible to split the file into multiple files using a condition for the contents of column 4 i.e if column 4 contains a value between 0-10 then print the lines to a new file called less_than_10.txt

View 1 Replies View Related

General :: Split A File Into Two - The First Being The First Two Lines And The Second The Rest?

Nov 1, 2010

I'd like to split a file into two, where the first file is the first two lines and the second is the remaining lines (third line to EOF).

View 2 Replies View Related

Software :: Use Csplit To Split Up A Large File?

Jan 11, 2010

I use csplit to split up a large file and I get file xx01, xx02 and so on. I use a for loop to loop through the files.

Code:
for f in "xx**"
do
echo test
echo $f

[Code].....

View 3 Replies View Related

Software :: Decompressing A Split File Archive ?

Aug 14, 2009

I have a huge rar compressed split file archive at my webspace but not enough space to decompress the file.

Is it possible to decompress the split file archive and deleting already decompressed parts on the fly? Currently, I'm using winrar 3.70 beta 2 but it seems that it hasn't such an option.

View 1 Replies View Related

General :: Split A Video File Into Smaller Chunks?

Sep 1, 2011

Tool like Media File Segmenter for Linux

I know that one can use ffmpeg to extract a smallfile.avi from a largfile.avi. But What I am looking for is an tool/command to split a large file into several files of a given size.

View 1 Replies View Related

Ubuntu :: Command To Split A File Into Multiple Files?

Nov 22, 2010

I have a log file on ubuntu 10.04 that has 500 lines of log data in it. What command could I use in a terminal to split the single 500-line file into generate ten files each with 50-lines of log files each?

View 2 Replies View Related

Ubuntu Multimedia :: Split Mpeg File Using Ffmpeg?

Jan 29, 2011

i try to split mpeg file using ffmpeg. The splitting itself works OK, but the quality is lower. What should I do in order to keep the same video quality?

The way I used ffmpeg:

Code:
ffmpeg -i in.mpeg -ss 00:00:00 -t 00:02:58 out.mpeg

View 6 Replies View Related

General :: Split Huge File Into Small Parts And Compress Them?

May 30, 2011

I've a file with a size of 6GB. I would like to compress this file and split them into smaller files. I was also thinking in use bzip2 to compress it, because if offers a good compression rate. How can I split this file into small ones to compress it?

View 5 Replies View Related

General :: Installation Utilities Split Root File System

Jan 21, 2011

standard Linux installation utilities split the root file-system and the home file-system on two separate but relatively equal-sized partitions? For example, when I put fedora on an 80GB disk, it automatically gave the root file-system 32GB and home 30GB and the swap 8GB of space. However, since my home file-system has a directory with 28GB of files in it, why is my root file-system reading 100% usage? Is the home FS overlaid on top of the root FS? Is there an advantage to doing this? I just made a boot partition (50mb or so), a root partition (90% of the disk space) and a swap (4%-5% disk space).

View 5 Replies View Related

General :: Split A Large File To Download On A Windows Machine?

Apr 16, 2011

I am removing some old graphics from my server and one of the gallery programs have created two enormous directories that I cannot even open with FTP.

I tried to tar each directory and the first came out to about 37gb and the second keeps failing (its bigger one would assume).

How can I archive and split these into smaller files?

View 13 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved