Ubuntu :: Crawling Online Database And Placing Specific Data Into A Table?

Jun 12, 2010

I want to download some specific information(age of the building, value, square feet, etc.) from a county auditor's website:[url]

For every property in the county and ultimately match it to a .dbf file I already have containing geographic information for each parcel.

The website only displays information for a single address at a time in response to a query form asking for either the parcel ID# or street address. I have a table of all the county's parcel ID#'s and valid addresses-about 350,000 or so of them.

I imagine there must be some way to automatically crawl the website inputting the information from my tables into the form and gathering specific information in some sort of format that could then be matched to corresponding information in my .dbf file.

View 1 Replies


Debian :: Deleting Data Before Specific Date In SQLite Database

Jun 22, 2015

This is a continuation of the post in [URL].... . What has happened is that I have a huge log of 600 MB + and do not know from when the data is in there.

Code: Select all┌─[shirish@debian] - [~/.config/quassel-irc.org] - [9714]
└─[$] ll -h quassel-storage.sqlite                                                                                                   
-rw------- 1 shirish shirish 647M Jun 22 21:15 quassel-storage.sqlite

So I need to know if there is a way to get just the first five or ten entries listed as one can do using head, tail etc. I did try just using head but it was unsuccessful. The second thing would be deleting some days, weeks or months data from the existing sqlite log. I did see URL... but in my case I am deleting old entries in the sqlite log and also do not know if sqlite makes backups of the data or not ?

View 4 Replies View Related

Networking :: Placing Squid ACL's In A MySQL Database?

Jan 11, 2011

I'm using Squid in our company network, to block access to certain websites. Some websites are blocked for all computers, except for a few. These computers are grouped in an ACL, in squid.conf

Since the group contains only a few computers, this is no big deal and it works fine. But now we wish to expand this to more computers and regulate access to certain websites per computer more detailed. This means that the ACL list in squid.conf will grow significantly and I don't think that is a good thing.

The best solution would be to move all the ACL's from squid.conf, into a MySQL database. However, I have no idea how to do that.

As far as I know, I need external_acl_type to do this.

View 7 Replies View Related

Ubuntu :: Opening Many Programs And Placing Them In Specific Monitors / Workspaces?

Jun 16, 2011

I am fairly new to Ubuntu and was wondering if anybody knows of a way to open up a number of programs and placing them in specific spots programmatically. Basically, I'm trying to avoid having to open my IDE, multiple terminal windows, browsers, etc... and then having to place them all in the exact position I want when my machine boots up. Ideally, I could say:Program A, is placed on Monitor 1, workspace 1, at position 0, 0, with height and width 600 x 400. Program B, is placed on Monitor 2, workspace 2, at position 600, 500, with height and width 1000 x 600

View 1 Replies View Related

Ubuntu :: Password Protect A Table In A Database?

Oct 3, 2010

For my IPT assignment i need to make a database for a company and basically my only problem is i can't work out how to password protect a single table in the database.

I tried clicking encrypt with password but that encrypts the entire database.

I am using MS office 2007.

View 1 Replies View Related

Software :: Generate Online Reports From MYSQL Database?

May 6, 2010

I work for a not for profit research organisation that works in the clinical sector. Currently I create summary reports for each of our studies that are then made available through our website. These reports are generated from data that is stored in a MYSQL database residing on a RHL Enterprise server. The data analysis however is performed using Microsoft Excel and then I use excel to create the final report pages, which are finally PDF'd.

This approach has served me well however I am currently working to port the data analysis to R and have the analysis performed on the server side. Now I have to consider how to generate reports. Here is my question. Could anyone recommend software that I could use to prepare and review reports generated directly from the data residing in the MYSQL database? I have no experience with this area as my background is in microbiology.

View 1 Replies View Related

General :: Compare Oracle Database Table Contains Using Scripts?

Dec 26, 2010

How to compare oracle database table contains using (Perl/Shell)scripts.

View 4 Replies View Related

Server :: Can't Insert A Record In A Table On Postgresql Database?

Sep 2, 2010

my database (PostgreSQL) has ever funtioned OK, but today don't let me insert a new row in a table and the record itsn't duplicated. I did a vacuum full and reindex the database and the problem continue. I don't know what the fuck is happening

View 2 Replies View Related

Programming :: Save Input From An Online Form To A File/database?

Jan 27, 2010

Browsing some websites I've found a code for online form where a user provides name, number, etc. Everything is created in html/javascript. I'm just wondering whether it's possible to collect this input and present it in a database form so that I'd be able to see who's provided data and all the details they entered.Actually, it doesn't have to be a proper database (it would probably require php/mysql). It could be a weekly/monthly report (a text file) of people who provided details. The website is hosted by a third party company.This is an html bit:

<body id="main_body" >
<img id="top" src="top.png" alt="">


View 4 Replies View Related

Programming :: Make An Online PHP Contact / Phone Book With Simple PHP (no Database)?

Jul 5, 2011

I would like to unzip a simple PHP code files, to have a online PHP contact / phone book. Simply, slow, and not database oriented over complicated setups into settings. I have a PHP / web provider (free), not apache. WITHOUT SQL (like before it may exists) something like this [URL]

View 14 Replies View Related

Server :: Database Table Doesn't Exist [error Code: 1146]

Jun 18, 2010

Recently I got a very rare database issue, it says: Error: Couldn't read status information for table clients_copy () mysqldump: Couldn't execute 'show create table `clients_copy`': Table 'adm_retail.clients_copy' doesn't exist (1146) Error: Couldn't read status information for table dt_mx_emp ()


View 2 Replies View Related

Programming :: Make Shell Script To Use Sqlplus To Update Some Database Table?

Feb 8, 2010

How can I make shell script to use sqlplus to update some database table? This is what I'd like to make:

- login to db server (I have create ssh-keygen to bypass the login session)
- login sqlplus / as sysdba
- update status set status='END' where status='BEGIN';
- commit;
- quit;

I'm using oracle 10g database and SLES 9.0

View 3 Replies View Related

Software :: Mysql Logging For Specific Table Activity?

Sep 21, 2009

How do you guys to do just that? I know the option for global logging, with parameters --log on service run or log-bin and err-log for inside my.cnf. But what i am looking for is a way to log specifically a table activity, any activity, be it select or update queries.

View 1 Replies View Related

Programming :: Parse HTML And Print Specific Table?

May 13, 2009

I'm trying to write a script that will spider a particular webpage that shows the current inventory for their products. I need to figure out the optimal method of parsing the web page, and extracting the <td> line for the "qty" for "Product 2":


<table border="0" width="100%" cellspacing="1" cellpadding="3">
<td align="left" style="background-color: #EAEAFF; border-bottom-style: solid; border-bottom-width: 1" nowrap width="20%" height="50">
<p align="left"><font face="Arial" size="2"><b>Evaluation


View 4 Replies View Related

General :: Error: Cannot Connect To The Database Because: INSERT Command Denied To User 'webuser'@'localhost' For Table 'visitor'

May 6, 2011

Error: Cannot connect to the database because: INSERT command denied to user 'webuser'@'localhost' for table 'visitor'


View 3 Replies View Related

Ubuntu :: Simply Edit Table Data For MySQL Db?

Feb 18, 2010

I have tried a few packages but cannot find an easy intuitive interface for editing tables in a mySQL database. I just need to simply edit the table field data, import and export multiple rows, and filter the table data so only the rows are returned based on a string that I search for. The tables I edit have several thousand rows and some up to 30,000. I do not know how to write queries and it seems all these packages require that you know how to write sql queries to do what I need to do. On the mac I used Sequel Pro, which is dead easy to use and is mostly point and click to do all the above. Since my mySQL experience is very limited, I really need something simple like this.

I have tried:

MySQL Workbench
Navicat (lite version)
MySQL Query Browser

how to do what I need to do with the above packages.

View 7 Replies View Related

Ubuntu :: Output Data From Text File Into A Table?

Apr 13, 2010

I'm having a slight dilemma on reading data from a text file and outputting it into a table then displaying it. Basically I'm writing a shell script that takes information from text files then outputs the data into a table with 4 headings. The extracting of the data is fine, but creating a table i'm having problems with. My code extracts the data outputs the string to another file which works fineThe text file looks like this

mr smith 1 purchase oct 2007
mrs smith 2 purchase nov 2006
i want it to look like this


View 7 Replies View Related

Ubuntu Servers :: Asterisk Realtime "Table Cc_sip_buddies Not Found In Database"?

Nov 25, 2010

I'm trying to configure realtime in my asterisk server and I'm running into this problem:

res_config_mysql.c: Table cc_sip_buddies not found in database. This table should exist if you're using realtime.


View 1 Replies View Related

Programming :: Getting Table Data From Web Pages?

Jul 18, 2011

I am writing a program and I need to be able to grab data from web pages.The data I am looking for is on wiki pages with basic tables.A simple example would be like grabbing all of the episode data from a TV show of something similar.

View 5 Replies View Related

Ubuntu :: Recover Data From RAID 1 Where Partition Table Has Been Deleted?

Jan 12, 2010

I have 8.04 running mdadm raid 1. I selected the wrong drive in gparted and managed to hose my partition tables.

View 7 Replies View Related

Ubuntu :: Fixing A Deleted Partition Table / Data Recovery?

Jan 27, 2010

I erased my partition table. Can anyone recommend a good method of reconstructing it? And if this is impossible, can anyone recommend a good method of data recovery? I had an ntfs partition with windows 7 and a larger ext3 partition that ran Debian.

I'm running Test-disk on the SystemRescueCD at the moment (cross your fingers).

View 1 Replies View Related

General :: Partition Table Raw Data Using Fdisk

Apr 27, 2010

had trouble viewing partition table using fdisk, now realised i just cudnt view the whole table from Rescue terminal, please remove this thread, i can't find how ))

View 1 Replies View Related

Server :: Can't View PostgreSQL Table Data?

Dec 10, 2010

For some reason I am unable to view my database tables for my Wiki & I can't understand what I am doing wrong or what I'm missing. I know for sure there's table data on my 'wiki' database but for some reason I don't know how to list it.

psql (8.4.5)
Type "help" for help.


View 1 Replies View Related

Server :: Removing Old Table Data From MySQL?

Jul 6, 2009

When a user logs into my webmail application, it creates entries in a table on MySQL called "identities" which works great however once the user is deleted fro Linux with the "userdel -r" command, the data still sits in MySQL. My question is how I can I remove the table data from old users? It appears as show below:


View 1 Replies View Related

Programming :: Output Data To An Ascii Table?

Oct 18, 2010

I've got lines of data in the following format:
space1=number of times error has occured
space2=IP address

I've set this out nicely with printf and made it email me, the problem is - it's not entirely clear what each column/space is and the IP and occurances can sometimes seem confusing. Is there any (easy) way to output this into an ascii like table? There will always be 5 occurances, and the format will always be the same

View 1 Replies View Related

Ubuntu :: Screen Data Scraping Into A Database?

Feb 18, 2011

I use ubuntu lucid 10.4. I would like to monitor stock prices in realtime with a web browser and generate spreadsheets. Is there a program to scrape the data from the screen and put it into an openoffice spreadsheet so that I can categorize the data appropriately? I would like to do this in realtime if possible. Perhaps a firefox addon or chrome extension. I have searched for this for a while and think I may have to write my own code, which would be okay, but I imagine that there is some open source code out there that would work or can be changed a little to suit my needs.

View 3 Replies View Related

Hardware :: Restore Partition Table Or Recover Data?

Mar 27, 2009

I was putting the cover back on my Antec p180b, and I guess it got stuck and gave it a hard bump (pretty much broke the cover). As a result, one of my hard drives, a Seagate Barracuda ST3750640AS, got messed up or something. All the other hard drives are fine. It's in an LVM with another hard drive, so now I can't boot up into my computer. So I booted into the installation CD:


# find /dev/sd[a-c][1-3]


This led me to believe the partition was messed up. So I ran cfdisk, and it said something about a missing partition table or something. Additionally, instead of showing the single partition on it, it displays, from my recollection, Pri*Log. To my knowledge, this is the only problem with the hard drive. So now I need to either somehow create or restore the partition table without overwriting the data. Or get a new hard drive, and some how recover the data (LVM, partitions, and all).

View 4 Replies View Related

Programming :: Copying Data To Clipboard Using OSF/Motif, C++, And XRT Table?

Dec 23, 2010

I am working on an application in Motif and C++, which uses an XRT Table. With the XRT Table being an infrequently used product, it is hard to find good documentation on it, and one area in particular is sorely lacking... a good explanation on how to copy text from the table to the clipboard used by other X11 applications. I've come across an example application that demonstrates how to copy text to the clipboard, but I cannot seem to merge that knowledge with what I'm provided with the XRT Table API. Does anyone have any knowledge in using the XRT Table, and in particular, with copying selected fields within the table to the clipboard?

View 3 Replies View Related

Ubuntu Servers :: Mailserver With Data Store On Database?

May 29, 2011

Please tell me spesification if i want buid mail server on ubuntu 10.04 with good features :

1. For MTA ??
2. For Mail Filtering ??
3. For MDA ??
3. For Webmail ??
4. For Mailling List ??

View 3 Replies View Related

General :: Read Data From Text File And Output Into A Table?

Apr 12, 2010

I'm having a slight dilemma on reading data from a text file and outputting it into a table then displaying it. Basically I'm writing a shell script that takes information from text files then outputs the data into a table with 4 headings.he extracting of the data is fine, but creating a table i'm having problems with. I think it is possible to do it using the awk function, but so far i'm having a lot of difficulties.

View 14 Replies View Related

Copyrights 2005-15 www.BigResource.com, All rights reserved