Ubuntu :: Text File 3 Million Url Into Chunks Of 5,000?
Dec 16, 2010I have a text file with 3 million urls that I want split into chunks of 5,000.
Anyone have idiot proof simple instructions to accomplish this in the command line?
ADVERTISEMENT
General :: Move 1 File To A Directory Containing 3 Million Files?
Jul 25, 2011the system currently have a directory with all the invalid files. how bad is it to move a single file to a directory containing 3 million files already?
View 2 Replies View RelatedFedora :: Starting File Manager Opens Up A Million And One Times In FC12
Feb 27, 2010Starting File Manager opens up a million and one times in FC12
Is there a way to stop it?
General :: Split A Video File Into Smaller Chunks?
Sep 1, 2011Tool like Media File Segmenter for Linux
I know that one can use ffmpeg to extract a smallfile.avi from a largfile.avi. But What I am looking for is an tool/command to split a large file into several files of a given size.
Software :: Remove Chunks From A Video File Programatically?
Oct 22, 2009I need to remove sections from video files (from the middle and the end) on the command-line. Generally these will be mp4 and avi files.
For instance, I have a .mp4 file which is 32:30 minutes long. I'd like to remove from 2:49 to 3:20, and remove the last 60 seconds.
Any ideas on how I can achieve this?
General :: Check Small Chunks Compared To Original File?
Feb 21, 2011i want to upload my iso collection to adrive(.)comi have a slow upload and i want to split each iso file in chunks of 100 MB so they upload while every browsing session of mine.i figured i should use split and cat commands to do that.but i cant afford to upload some corrupt archives, so how may i go about checking the small chunks to the original file before uploading
View 7 Replies View RelatedUbuntu :: Sort The Output To A Text File So That It Prints To The Text File At 1 Process Per Line?
Feb 6, 2011im trying to output a list of running processes via a shell script. At the moment i got this which outputs the processes to a text file called out.
echo $(ps aux) >>out
The problem is though, the processes are all just one big block of text which makes it hard to read. Does anyone know how to sort the output to a text file so that it prints to the text file at 1 process per line? I know its probably simple but im very new to linux.
Programming :: Remove Lines In A Text File Based On Another Text File?
Jan 28, 2009I have a text file called file1.txt containing many lines eg.
line1
line2
line3
line4
line5
line6
Then i have another text file called file2.txt contains
3
5
6
Is there a command to remove the lines in file1.txt based on the keywords in file2.txt? note: It should remove line3,line5,line6 based on 3,5,6
Programming :: 1 Million Bits Of Data To 1000x1000 Gif ?
Aug 14, 2010I'd like to represent data in a graphic form and one example is a million bits of data represented as a square .gif of 1 million pixels.
I'm posting here rather than [Art & Imaging] as I'd like to dump 0s and 1s directly into gif|jpg|png or other format, rather than using an application. Even with an application I'm not sure of an efficient way to channel the data.
Ubuntu :: Add / Remove Bits Of Text From A Text File
Dec 6, 2010I am looking for a way to keep a log and make if then statements if a line exitsts in the log. I also am looking for a way to make a simple loop, like goto line number, and I also am wondering how to add/remove bits of text from a text file (plugins line in server.properties)
View 5 Replies View RelatedFedora :: F14 Gnome Text/plain Versus Text/html File Type
Apr 2, 2011I put a text file on my desktop and added a couple lines of text with gedit. File type shows text/plain. Double-click opens the file in gedit which is what I want. I'm using the file to temporarily hold some snips of code that I copy from file to file, but when I copy some html into the file and save it, now file properties show it's text/html and a double-click opens the file in firefox, which isn't what I want. Is there some way to keep the file type from changing itself?
View 6 Replies View RelatedGeneral :: Replace Text In One File With Text From Another File Using Sed?
Apr 28, 2010How could I replace text in one file with text from another file using sed?
The text in each of the files would be surrounded by a starting and ending delimiter or a starting tag, say like /* */ so to easily find them.
Software :: Use Sed To Include A Text File In The Beginning Of Other Text Files Inside A Folder And Its Subfolders?
Jun 1, 2010Can I use sed to include a text file in the beginning of other text files inside a folder and its subfolders? So it should be recursive.
View 4 Replies View RelatedProgramming :: Adding Lines Of Text To Beginning Of Text File
Jan 19, 2009I need to insert 3-4 lines of text to the beginning of a text file. The file is a largish MYSQL dump, the result of a backup shell script. This shell script should insert the required text.I've wrestled with sed, but lost.
View 2 Replies View RelatedProgramming :: Delete Line Of Text From Text File Via Shell?
Jan 13, 2010I have to delete a certain line of text from the a textfile via ubuntu's shell scripting.I have done research, and it seems that most people advocate the usage of sed /d option. sed makes does not edit the text file. Hence, most options I discovered involved the use of a temporary variable/textfile and then overwriting the old file with the temporary new file. Is there anyway whereby I can bypass the use of temporary storage containers? I hope there is any magical combination of commands to edit the file directly.
View 3 Replies View RelatedProgramming :: Exporting Glade Text View To Text File?
Jan 8, 2011I want to display something in my text view widget in glade using c code. that's all right.
now I need to attach a save button beneath the text view.so that on click the text view content should save as a txt file..
Programming :: Formatting Fields And Text Being Displayed From Text File?
Feb 9, 2011I want to display the contents of a particular log file (simple text file, I mean in Linux). But there is a problem: The contents need to be organized in a fixed format. Have a look at this log file:
sampleLog.txt
Code:
User Name: XYZ
Reported Problems Description: Blah! Blah! Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah!
[code]....
So, while displaying the contents of above file on a web page, I want to format the field names found in the log file: User Name:, Reported Problems Description:, and Remarks:. These fields may contain a variable length of text and no specific line number is assumed for them to appear on.
The desired output should look like this:
User Name: XYZ
Reported Problems Description: Blah! Blah! Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah! Blah!Blah!
[code]....
Well, what I am trying to do may sound wierd to some of you. The filed "Reported Problems Description:" can possible contain text which embeds colon (.
Programming :: Add Text Before Line Number In Text File?
May 3, 2010a sed command to add a text before line number in text file? I have text file with 500 lines, and i want to add 3 more lines with text after line 300, OR before line 302, isn't no problem.
View 16 Replies View RelatedUbuntu :: How To Copy And Paste Large Chunks Of Data
Jun 16, 2011I want to copy about 40GB - to a partiton. There are two hard drives in my box one won't boot but I can aaccess it and mount partitions and I aim to move data from it to a new bootable hard drive. Doing a simple cp copy command may not be the best way to copy and paste such a large chunk? Also I want to backup the data I plan to copy/paste using a USB hard drive to backup. But I could also paste data from the backup to the new drive instead of from old internal hd to new hd. - that's another option.
View 1 Replies View RelatedGeneral :: Copy Data In Chunks And With Timed Breaks?
May 2, 2011I have a hard drive with a bad PCB board. It stays on when not under heavy load and it will restart if I copy too much data off it. So far I have had good luck doing folders under 500 MB in size if I copy one folder to my good hard drive, wait five minutes, copy another, etc.
If I mount the bad drive and try to copy a folder of several GBs in size it will start and then stop as the hard drive restarts. When I try to mount the drive again Linux says it can't read the superblock. I have several folders with over 30 GB of data in many different folders.
What I am looking for is a way of copying a folder in Linux such that the commands grab the whole folder in chunks with a timed break in-between.
Programming :: [C] Parsing Lines Into Chunks And Writing Each Chunk?
Sep 10, 2010My C foo is terrible! I am working with some code which reads lines from a file and then reformats the lines and writes them to a new file.The input lines look like this:
Code:
+[NEOTEST?]
+[NEOTEST]
[code]...
Programming :: Python - Parsing Data In Chunks / Sections?
Nov 5, 2010As a curious side project I'm playing with mzXML data(an xml format for holding mass spec data). A typical scan can be quite large, even up into GB size. I'm wondering how would one go about parsing an xml file in sections, one section at a time. The idea being if the computer doesn't have enough memory to load up the entire data file, work on chunks of it at a time.
View 3 Replies View RelatedServer :: Scp Truncate Text File Busy - Copying File Is Not A Running Binary?
Jun 14, 2010I am having problems with scp during a backup operationI added a ps -ef before and after the scp operation used during the backup.The backup is a script to backup a Zimbra ServerI am including the code segment that I am having problems
Code:
# DRCP Section. To scp newly created archives to a remote system
if [ "$DRCP" = "yes" ]
[code]...
Programming :: Script To Copy Paste Text From One File To Another (overwriting Part Of The File)?
Apr 19, 2011I have a .txt-file with ~50.000 lines of numbers, generated by a mathematics program. From this file, I need line ~ 1.100 to line ~16.000 (these lines are always the same btw, this may make the solution easier, dunno) to be copy/pasted to another file, where the lines ~500 to ~15.000 (also, every time the same) should be overwritten by the aforementioned lines...I haven't found or come up with anything that works yet, mostly I find solutions to copy everything from one file to another but I can't find something to specifically overwrite a part of a file with part of another.
View 4 Replies View RelatedRed Hat / Fedora :: Convert Plain Text File To Html File Without Using Perl?
Jun 9, 2010I am looking for some source package which will convert plain text file to html file without using perl.
I mainly need to do this on an ARM platform, so if I get sources I can cross compile it.
General :: Convert An HTML Email Saved As A Text File To A PDF File From The Command Line?
Aug 23, 2011I need to be able to convert HTML email messages saved as text files (.eml or .msg) to PDF documents, one PDF per email, retaining formatting and images.
Are there any Linux tools that will allow me to do this from the command line (so it can be scripted)?
Software :: Check The Contents Of A Text File For A Specific String And Remove It From The File From The Command Prompt?
Oct 14, 2010I want to be able to check the contents of a text file for a specific string and remove it from the file from the command prompt. I would basically be searching through a number of files and if a specific string is found I would like it removed automatically. pretty much a find and replace, were the replace is nothing. any one got any ideas on how you would do this. I already have the search part sorted just need to be able to remove the string I don't want from the multiple files.
View 4 Replies View RelatedGeneral :: How To Verify If The File Is Binary Or Text Without To Open The File
Sep 7, 2010how to verify if the file is binary or text without to open the file
View 2 Replies View RelatedRed Hat / Fedora :: Edit A Text File To Delete All Commas In The File?
Jan 4, 2011i want to find a command line way to edit a text file to delete all commas in the file. i do not want to replace them w/ anything.
View 2 Replies View RelatedGeneral :: Change Password Using A Script File And Text File?
Jun 26, 2011This is for educational purpose. In fact it is my lab tutorial for a subject.I want to capture the users password when he changes his password. Both new and old.This is the script i have come up with:
Code:
#!/bin/bash
echo "Changing password for user $USER."
[code]...