Debian :: Deleting Data Before Specific Date In SQLite Database
Jun 22, 2015
This is a continuation of the post in [URL].... . What has happened is that I have a huge log of 600 MB + and do not know from when the data is in there.
Code: Select all┌─[shirish@debian] - [~/.config/quassel-irc.org] - [9714]
└─[$] ll -h quassel-storage.sqlite
-rw------- 1 shirish shirish 647M Jun 22 21:15 quassel-storage.sqlite
So I need to know if there is a way to get just the first five or ten entries listed as one can do using head, tail etc. I did try just using head but it was unsuccessful. The second thing would be deleting some days, weeks or months data from the existing sqlite log. I did see URL... but in my case I am deleting old entries in the sqlite log and also do not know if sqlite makes backups of the data or not ?
View 4 Replies
ADVERTISEMENT
Jun 12, 2010
I want to download some specific information(age of the building, value, square feet, etc.) from a county auditor's website:[url]
For every property in the county and ultimately match it to a .dbf file I already have containing geographic information for each parcel.
The website only displays information for a single address at a time in response to a query form asking for either the parcel ID# or street address. I have a table of all the county's parcel ID#'s and valid addresses-about 350,000 or so of them.
I imagine there must be some way to automatically crawl the website inputting the information from my tables into the form and gathering specific information in some sort of format that could then be matched to corresponding information in my .dbf file.
View 1 Replies
View Related
Apr 8, 2010
I'm sure I'm missing something pretty obvious, but I can't for the life of me stop my pysqlite scripts crashing out with a database is locked error. I have two scripts, one to load data into the database, and one to read data out, but both will frequently, and instantly, crash depending on what the other is doing with the database at any given time.I've got the timeout on both scripts set to 30 seconds: cx = sqlite.connect("database.sql", timeout=30.0)and think I can see some evidence of the timeouts in that i get what appears to be a timing stamp (e.g 0.12343827e10 1) dumped occasionally in the middle of my curses formatted output screen, but no delay that ever gets remotely near the 30 second timeout, but still one of the other keeps crashing again and again from this. I'm running RHEL5.4 on a 64 bit HS21 IBM blade, and have heard some mention about issues about multi-threading and am not sure if this might be relevant.
Packages in use are sqlite-3.3.6-5 and python-sqlite-1.1.7-1.2.1, and upgrading to newer versions outside of RedHat's official provisions is not a great option for me. Possible, but not desirable due to the environment in general.I have had autocommit=1 on previously on both scripts, but have since disabled on both, and am now cx.commit()ing on the inserting script and not committing on the select script. Ultimately as I only ever have one script actually making any modifications, I don't really see why this locking should ever ever happen
View 3 Replies
View Related
Aug 20, 2009
I'm pretty new to linux, and I'm facing a problem with an ext3 partition on an external hdd. I'm not sure whether the hdd is about to crash or not, however I've had a few problems accessing it in the past.
I have a second external hdd, the exact same drive, that has the exact same partition configuration, but holds different data. So, my question is; is it possible to backup the partition structure of the second working drive, and using this information to rewrite the partition structure of the failing hdd without damaging the data stored on that drive?
View 2 Replies
View Related
Nov 5, 2009
I had a program run riot and it has created hundreds of spurious files in one directory. Fortunately they are all dated 4th November so are easily identified. What bash command can I use from the console to delete them all?
View 2 Replies
View Related
Jun 16, 2014
app deployment on Linux/debian and I'm using Debreate to create .deb packages which works fine. I install the software itself to /usr/bin but want to install the program's database to /home/username/myapp/ The problem is it that I don't know how to add the env variable 'username' to the target path. What is the exact syntax for this installation path?
View 3 Replies
View Related
Apr 7, 2011
i have a problem about deleting a line from a text file which contains two specific patterns. i am using "sed -i "/$name/ d" peop.txt" but i must use one more variable which is surname.
"
burak:ak:3242:2342:dsa@a.com
gokhan:an:432:4234:da@a.com
"
and this is the code of text file. and the second question when i use "/$name/ d" it deletes not only the names which are macthing with $name but also all words that contain $name. so how can i fix these problems_?
View 2 Replies
View Related
Jun 6, 2010
I have a file which contains milion of records. It contains 12 columns seperated by "||" (delimeter).
First two fields contain first name and last name of a person. Now my requirement is to delete all those records from this file for which:
First two fields does not contain any alphabet.
For e.g i have below mentioned records in file:
gaurav||gandhi||123||456||789
#a%bcd||123abc||89|90||91
12345||@@@||89||123||234
***||!!!!||98||76||90
Now, last two lines should be removed from this file since first two fields does not contain any alphabet for these two records.
View 12 Replies
View Related
Apr 26, 2011
I just got an email from google saying my site contained malware. It has a line in it: "<script src='http://whitepix.info/3'></script>". I've noticed its recursively in all my .html and .txt files in my website. Can I make a linux script to run that will go through all my .html and txt files recursively and delete that line from them? I don't know how it got in all of them.
View 6 Replies
View Related
Sep 4, 2010
Is it possible to find programs that were installed on a specific date or within a specific date range? If so, how?
View 6 Replies
View Related
May 26, 2011
I wanna copy all folders and files created from 01.01.2011 until today to new placeie:cp -r /home/moviecar/public_html/wp-content/uploads/ /home/teaser/public_html/wp-content/uploads
View 4 Replies
View Related
Mar 18, 2010
Is there any way to install ubuntu on a drive without deleting the current data on it:
I have a software raid array set up and it has a few folders in it like /rtorrent, /cod4, but nothing that would conflict with a new ubuntu install.
And its formatted as ext3
Is there any way I can install Ubuntu Server 9.10 onto that raid array keeping it INTACT as a raid array AND preserving the data on it?
And is it easy to boot from a software RAID array?
View 2 Replies
View Related
Jun 1, 2010
I had to recently reinstall ubuntu because 10.04 started acting up on me. I reinstalled 9.04 but I don't know how to mount my RAID drive without messing with the data that's already on there. I have the UUID for the RAID but fstab isn't able to find it. I also previously used RAID software but I don't remember which one I used. how to mount my drive so that ubuntu can see it?
View 5 Replies
View Related
Jan 10, 2011
I copied a back up of my windows 'my documents' fold and all of its' sub folders into my linux (Mint Debian) Documents directory. I found that many of my files can be found in more that one directory so, what I want to do is to find all the dups and deal with them. Is there a good linux application to resolve this 'duplicates' problem. (I don't want to touch the linux system files.)
View 2 Replies
View Related
Dec 15, 2010
I used to use CCleaner so I could keep specific cookies from being deleted while I deleted all others. Is there any way I can do this with Ubuntu? Firefox doesn't seem to allow it other than manual deletion which is not as fast an automated as CCleaner made the task.
View 1 Replies
View Related
Feb 18, 2011
I use ubuntu lucid 10.4. I would like to monitor stock prices in realtime with a web browser and generate spreadsheets. Is there a program to scrape the data from the screen and put it into an openoffice spreadsheet so that I can categorize the data appropriately? I would like to do this in realtime if possible. Perhaps a firefox addon or chrome extension. I have searched for this for a while and think I may have to write my own code, which would be okay, but I imagine that there is some open source code out there that would work or can be changed a little to suit my needs.
View 3 Replies
View Related
May 29, 2010
I have a LAMP server. I know sql but I'm currently learning PHP.
Correct me if I'm wrong, but you're supposed to use PHP to insert/select data from the database, right? If so, SQL shouldn't need a port at all.
Apache uses port 80, but it's listening for connections. MySQL uses port 3306, but I've never logged into it from anywhere besides 127.0.0.1/localhost. I have mysqladmin installed and it demands that I give it an IP so I used localhost.
I'm not interested in doing anything remote, so can I block this port? When I say "block" I mean on the router, not locally through iptables. Obviously I have to foward port 80 because that's how people would connect to my server. But once they connect and send something, my server would interpret the data locally and send it back on port 80.
View 8 Replies
View Related
Feb 19, 2011
We purchased a new database system at work last October, ditching the old system because of a lack of support from the vendor. This is a retail Point of Sale and Backoffice database system. I am not sure what system the new one runs on, but the system we replaced was a Firebird data base. The reason I am posting is because we are now in need of the information contained in the old database which was not completely imported into the new system. Unfortunately, we parted company with the old vendor under extremely hostile conditions, and they are not a source of help for this problem, nor are the new vendors.
Basically the problem is this: The database in on a Windows XP system and I found a copy of SQL Manager Lite 2008 on the system, which after quite a bit of studying, I figured out how to extract the database into a removable file. I have this file (178MB) on a USB stick in a file called Backoffice.fbd. I can get into this database with MySQL. All I want to be able to do get into the database and create tab deliminated spreadsheet files for each of the database sections (Customers, Repairs, Sales History, stock files, etc.) Is it possible to do this with Ubuntu and MySQL and if so, can an expert suggest one or two things to get me started.
View 3 Replies
View Related
May 29, 2011
Please tell me spesification if i want buid mail server on ubuntu 10.04 with good features :
1. For MTA ??
2. For Mail Filtering ??
3. For MDA ??
3. For Webmail ??
4. For Mailling List ??
View 3 Replies
View Related
Mar 4, 2010
I have try to sync my MySQL Server database and HLDS Data on lan,one is windows server 2008 and one is Ubuntu Linux 9.10 i have try to use the remote address(192.168.0.4:3306) but can't connect and say the error code is 10060 i have check the connect is normal and ok,the accont is can let any address to contro.
View 1 Replies
View Related
Jul 19, 2010
I have set up a MySQL database which has only three fields for user-name, password and index number. But there is a LOT of data (thousands of columns) which would take too long to enter manually. I'm sure MySQL must have a file format whereby a single large file containing different data types can be successfully automatically imported and the various data elements distributed to their intended fields. Does anyone know which characters MySQL uses as field seperators for this formatting of data, or is there a program already written which can take raw data and organize it into a SQL compatible file?
View 8 Replies
View Related
Apr 13, 2011
I have a need of a database, and the information to go into it. I know how I want to organise my data for optimal cross referencing, but what I know is merely what I know and I do not know if what I know is what is known...
Madness to say... looking at my database I see this is the best way to organise the data, but what I do not know is how the computer will respond to my methodical madness.
Is it quicker to have one table with many fields or many tables with few fields?
We've got information for 10 users with 17 idiosyncrasies.
So, would one table with 17 columns and 10 rows... or... a group of 50 tables with one column and 3 rows and one table with 4 columns and 5 rows...
Be more efficient concerning:
QUERIES...?
Searching?
Comparison?
Insertion?
Deletion?
Modification?
The queries and modifications will be daily, and constant. These numbers are really much larger but the math is easier for me to articulate on a smaller scale. I use Perl, php, and C with SQL for management.
View 14 Replies
View Related
Aug 26, 2010
I have a CSV called source1 with data like:
Date12:00:00 AM12:30:00 AM01:00:00 AM01:30:00 AM02:00:00 AM02:30:00 AM03:00:00 AM ...
07/31/1051.5252.4852.6452.863.3663.8445.6 ...
08/01/1049.4449.9261.2860.1652.6449.1247.52 ...
08/02/1049.1248.9648.9650.7260.1658.0851.04 ...
08/03/1060.3260.6459.260.9637.9233.2832.8 ...
[Code].....
Also, the CSV file is updates every few hours and I need to load any new data from the file to the database without creating duplicates of data that has already been loaded to the database.
View 6 Replies
View Related
Jan 4, 2011
I wrote a hack script that outputs the following every so often: Code: 01/04/11 10:33:02: 97,1413,1447,2860 I must leave the data format the same --but I want a special number from it. In this case it's 97 and it's always going to be the first in the 4 columns of comma delimited items. I can extract with this:
Code: cat datafile | awk -F" " {'print $3'} | awk -F"," {'print $1'} But that's really sloppy. Can someone point out a better way of doing this (with awk) and tell me why?
View 3 Replies
View Related
Oct 14, 2010
Elsewhere is my question about 11.3. I have had to abandon that and 11.3 as my RAM is too small. Now, for the first time in many years, I find it necessary to extract specific data from received .pdf files. According to OpenOffice, editing of these files is only possible from version 3.2. My concern is whether this later vesion will be compatible with 11.2.OpenOffice installed is 3.1.1.4-1.1.4-i586. The same question has been directed to their Forum.
View 9 Replies
View Related
Jul 18, 2009
how can I create RAID 1+0 using two drives (one is with data and second one is new). Is it possible to synchronize data drive with empty drive and create RAID 1+0 ?
View 3 Replies
View Related
Jul 5, 2015
MP3's wiped out by debian randomly without you initiating it to do so?It has just happend to me again for the third time. it didn't touch the .ogg files, only the mp3's is it deleting. last program I used before shutting it down last time was OGMrip but i don't see how that could even touch the mp3's...
View 13 Replies
View Related
Jan 23, 2010
I'm trying to connect to the VPN of my employer; after fix various minor issues I reach this point in which the DNS entries and the default gateway of the VPN are overwritten with the values of the eth0 device that appears by default. Therefore the vpn is not useful.
View 1 Replies
View Related
Sep 22, 2010
I'm looking for a method for modifying some jpg photo files last modification date with the corresponding timestamp creation date of each file.The reason is that shotwell import pictures in folders according to last modification date which is stupid on my opinion.
View 2 Replies
View Related
Aug 1, 2011
As a photographer I'm constantly taking photos and storing them in folders. Now occasionally I'm using two cameras (either for different settings or an assistant is also taking photos) which means that for one event I can have differently named images.Both cameras have the same time set (which always helps in Windows) but in Ubuntu when trying to sort my folder by date taken I can't.The options I'm given are to sort them: Manually, by Name, by Size, by Type, by Modification date and by Emblem.Now none of those are helpful to me once I've done a few edits to the images.So please if anyone knows, how do you organise a folder with images taken on different cameras by Date Taken rather than Date Edited?
View 3 Replies
View Related
