Programming :: Database - Efficiency - Organising Data For Speed
Apr 13, 2011
I have a need of a database, and the information to go into it. I know how I want to organise my data for optimal cross referencing, but what I know is merely what I know and I do not know if what I know is what is known...
Madness to say... looking at my database I see this is the best way to organise the data, but what I do not know is how the computer will respond to my methodical madness.
Is it quicker to have one table with many fields or many tables with few fields?
We've got information for 10 users with 17 idiosyncrasies.
So, would one table with 17 columns and 10 rows... or... a group of 50 tables with one column and 3 rows and one table with 4 columns and 5 rows...
Be more efficient concerning:
QUERIES...?
Searching?
Comparison?
Insertion?
Deletion?
Modification?
The queries and modifications will be daily, and constant. These numbers are really much larger but the math is easier for me to articulate on a smaller scale. I use Perl, php, and C with SQL for management.
View 14 Replies
ADVERTISEMENT
Jul 19, 2010
I have set up a MySQL database which has only three fields for user-name, password and index number. But there is a LOT of data (thousands of columns) which would take too long to enter manually. I'm sure MySQL must have a file format whereby a single large file containing different data types can be successfully automatically imported and the various data elements distributed to their intended fields. Does anyone know which characters MySQL uses as field seperators for this formatting of data, or is there a program already written which can take raw data and organize it into a SQL compatible file?
View 8 Replies
View Related
Aug 26, 2010
I have a CSV called source1 with data like:
Date12:00:00 AM12:30:00 AM01:00:00 AM01:30:00 AM02:00:00 AM02:30:00 AM03:00:00 AM ...
07/31/1051.5252.4852.6452.863.3663.8445.6 ...
08/01/1049.4449.9261.2860.1652.6449.1247.52 ...
08/02/1049.1248.9648.9650.7260.1658.0851.04 ...
08/03/1060.3260.6459.260.9637.9233.2832.8 ...
[Code].....
Also, the CSV file is updates every few hours and I need to load any new data from the file to the database without creating duplicates of data that has already been loaded to the database.
View 6 Replies
View Related
Jul 11, 2010
Does anybody know if the Printers database is up to speed with the latest? I am looking for 3 in 1, Print, Copy,Scan or 4 in 1 Printer that I can get for under $150.00 that is compatible with Linux printing and Windows 7. Since I have upgraded my machine I now want a printer that will function under both operating system...
View 2 Replies
View Related
Feb 18, 2011
I use ubuntu lucid 10.4. I would like to monitor stock prices in realtime with a web browser and generate spreadsheets. Is there a program to scrape the data from the screen and put it into an openoffice spreadsheet so that I can categorize the data appropriately? I would like to do this in realtime if possible. Perhaps a firefox addon or chrome extension. I have searched for this for a while and think I may have to write my own code, which would be okay, but I imagine that there is some open source code out there that would work or can be changed a little to suit my needs.
View 3 Replies
View Related
May 29, 2010
I have a LAMP server. I know sql but I'm currently learning PHP.
Correct me if I'm wrong, but you're supposed to use PHP to insert/select data from the database, right? If so, SQL shouldn't need a port at all.
Apache uses port 80, but it's listening for connections. MySQL uses port 3306, but I've never logged into it from anywhere besides 127.0.0.1/localhost. I have mysqladmin installed and it demands that I give it an IP so I used localhost.
I'm not interested in doing anything remote, so can I block this port? When I say "block" I mean on the router, not locally through iptables. Obviously I have to foward port 80 because that's how people would connect to my server. But once they connect and send something, my server would interpret the data locally and send it back on port 80.
View 8 Replies
View Related
Feb 19, 2011
We purchased a new database system at work last October, ditching the old system because of a lack of support from the vendor. This is a retail Point of Sale and Backoffice database system. I am not sure what system the new one runs on, but the system we replaced was a Firebird data base. The reason I am posting is because we are now in need of the information contained in the old database which was not completely imported into the new system. Unfortunately, we parted company with the old vendor under extremely hostile conditions, and they are not a source of help for this problem, nor are the new vendors.
Basically the problem is this: The database in on a Windows XP system and I found a copy of SQL Manager Lite 2008 on the system, which after quite a bit of studying, I figured out how to extract the database into a removable file. I have this file (178MB) on a USB stick in a file called Backoffice.fbd. I can get into this database with MySQL. All I want to be able to do get into the database and create tab deliminated spreadsheet files for each of the database sections (Customers, Repairs, Sales History, stock files, etc.) Is it possible to do this with Ubuntu and MySQL and if so, can an expert suggest one or two things to get me started.
View 3 Replies
View Related
May 29, 2011
Please tell me spesification if i want buid mail server on ubuntu 10.04 with good features :
1. For MTA ??
2. For Mail Filtering ??
3. For MDA ??
3. For Webmail ??
4. For Mailling List ??
View 3 Replies
View Related
Mar 4, 2010
I have try to sync my MySQL Server database and HLDS Data on lan,one is windows server 2008 and one is Ubuntu Linux 9.10 i have try to use the remote address(192.168.0.4:3306) but can't connect and say the error code is 10060 i have check the connect is normal and ok,the accont is can let any address to contro.
View 1 Replies
View Related
Jun 13, 2010
My DVD player attached to my TV is picky. Burn CD's (with avi files) at 8X and it plays them. 16X and it complains about bad disk. Every time. In karmic, I can only get cdrecord to burn at 16x.
Here's the command:
cdrecord -dev=/dev/scd0 -speed=8 -dao -pad -v something.iso
And it burns at 16x instead of 8x. Command issued with root privilege. Identical hardware under CentOS 5.x and it burns at 8x, like I asked it to. I'm all SATA if it matters. What do I need to do to get the version of cdrecord with karmic to burn a data CD at 8x? For whatever reason, CDs burned at 16x just don't work in the DVD player attached to my TV.
View 1 Replies
View Related
Jun 22, 2015
This is a continuation of the post in [URL].... . What has happened is that I have a huge log of 600 MB + and do not know from when the data is in there.
Code: Select all┌─[shirish@debian] - [~/.config/quassel-irc.org] - [9714]
└─[$] ll -h quassel-storage.sqlite
-rw------- 1 shirish shirish 647M Jun 22 21:15 quassel-storage.sqlite
So I need to know if there is a way to get just the first five or ten entries listed as one can do using head, tail etc. I did try just using head but it was unsuccessful. The second thing would be deleting some days, weeks or months data from the existing sqlite log. I did see URL... but in my case I am deleting old entries in the sqlite log and also do not know if sqlite makes backups of the data or not ?
View 4 Replies
View Related
Oct 30, 2010
My machine has 4 SATA 2 West Digital 1TB disks. I made 2 partitions on each of them, 500GB for each partition. When I started using them I check their I/O using iozone. The first partition has 100MB/s for read, 70MB/s for write. And the second partition has 80MB/s for read, 55MB/s for write. All 4 disks has the same result.
As I use on, the I/O speed on each partition decrease, to different extend. For example, for the 4 first partitions, the write speed varies from 69MB/s to 56MB/s. And I have same amount of data on each of them, all used 11%.
My guess for this is the disk block allocation policy. This is caused because some disk starts writing from inner location while others writes on the outer edge, even though amount of data on each disk is the same.
View 3 Replies
View Related
Mar 11, 2011
I have searched but I have been unable to find the data that controls the speed of Zaz, does anyone know how to hack it so that an eighty-plus year old can play?
View 3 Replies
View Related
Jun 12, 2010
I want to download some specific information(age of the building, value, square feet, etc.) from a county auditor's website:[url]
For every property in the county and ultimately match it to a .dbf file I already have containing geographic information for each parcel.
The website only displays information for a single address at a time in response to a query form asking for either the parcel ID# or street address. I have a table of all the county's parcel ID#'s and valid addresses-about 350,000 or so of them.
I imagine there must be some way to automatically crawl the website inputting the information from my tables into the form and gathering specific information in some sort of format that could then be matched to corresponding information in my .dbf file.
View 1 Replies
View Related
Nov 16, 2009
How to find a data transfer speed of a system using squid?
View 4 Replies
View Related
Aug 3, 2010
I have mounted a mirrored array on my linux machine. I used the Nvidia raid controller in my bios and mounted the resulting raid drive.
under /dev
the 2 drives sdb (2tb) and sdc (2tb) are symbolic links to
/dev/mapper
nvidia_dcabdggcp1
I then created a file system on nvidia_dcabdggcp1 and mounted it to /share
the output of my df -h is
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
897G 8.0G 843G 1% /
/dev/sda1 99M 19M 75M 21% /boot
[Code]....
Is there a way to check to make sure that my mirror array is actually working correctly without unmounting/remounting the sdc drive somewhere to see if it's a mirror of sdb.
View 2 Replies
View Related
Jun 11, 2009
I am using read() in c++ to get data from a serial port. However, if no data is available on the serial port the function blocks until dta arrives.Example code:
//------------------------------------------------------------
char m_readBuffer[255] = {0};
char* p_curChar = m_readBuffer;
[code]...
View 1 Replies
View Related
May 7, 2010
I have applied a patch in linux kernel version-2.6.31(fedora core 12)source code.Now I want to check whether the performance of the memory management part has been enhanced. So how to test the efficiency of this new modified code?
View 1 Replies
View Related
Mar 4, 2010
I am installing a custom 8.04 live disk (basically, a mirror of my whole system with user data intact, sans all non-OS files) from a USB key with remastersys for the .iso creation, and UNetbootin for the bootable USB on a brand new 120GB PATA WD HDD. Both do nicely so far, so I have a working livedisk to use until I need to install Ubuntu to the drive.
I had a pure linux box, but I need to add XP with dual booting now- I have to use Autodesk Inventor 2010 software for my college class on my laptop, so I don't drive 30 miles to use the 1 computer lab equipped with that software. I'm not new to Linux, but I am new to more in-depth partitioning. I've taken the lead and looked into things- read this good guide, among others:
HTML Code:
http://www.psychocats.net/ubuntu/partitioning and noticed that there is a way to more deftly use partitions so that personal files can be shared access and write between Windows and Linux partitions- with this:
HTML Code:
http://www.fs-driver.org/ Ubuntu is still my main OS, but being able to access all my media/data files between the 2 systems would be nice. Problem is, until now, I've put everything on a single partition because I didn't know better. Now I do, but am a bit confused with all the guides as to what's most efficient, especially in my case where full RAM speed is crucial to running a single program.
Here's what I know I need to do: 1. The Windows XP install I know needs from 20-30GB for Inventor 2010 LT to work well. I don't need anything else in XP spacewise- it's just being added for Inventor. 2. I'd like to create a separate /home partition for Ubuntu this time to save my user data, making future upgrades much more painless (I will be getting Lucid soon). How that works when upgrading, though, I don't know yet..
3. I'd like both OSes to share all my personal files (docs, pics, music, Inventor design files) if it is an efficient choice that works without problems.
4. Finally, because 2GB is minimum for Inventor to run decently, I need to maximize the speed of my RAM for it- from my reading, these so-called "swap" partitions can somehow be added for buffering this- people seem to sugguest the swap be half the size of the RAM for fastest speed, and some say add separate /usr or other partitions. I'm not clear on what would be most efficient for me.
I have limited HDD space- because of my laptop's BIOS, this single 120GB drive is the biggest I can get on my laptop, so efficient partitioning would make a huge difference for me. Before this, a 60GB HDD was in this. I'd like to see some added space for my data storage, but still keep things as fast as possible for Inventor when I use it, and Ubuntu.
View 3 Replies
View Related
May 9, 2010
I have some data files that should be distributed with my program. Using dist_pkgdata_DATA in Makefile.am, I get these files installed to /usr/local/data/share/package-name. The problem is that data is read-only, and my program needs to modify it. Playing with dist_sharedstate_DATA, dist_localstate_DATA, dist-data_DATA varibles, I got different installation directories, like /usr/local/com, usr/local/var, but data is always read-only.
How can I distribute modifiable data files with my package? I need some common directory for all users, or maybe local data in a user directory.
View 1 Replies
View Related
Jul 20, 2010
Can someone tell me if there a difference between running a 1000 watt computer PSU and a 1000 watt light bulb? For instance, Im sure if you burn a 1000 watt light bulb you'd burn the maximum amount of energy all the time (1000 watts). Using the full 1000 watts might be substantially more costly at the end of the month if you didn't need all the light produced all the time, but of course as long as the light was turned on it would burn the 1000 watts.
Now my question about a computer, while 1000 watt is probably an overkill, I'm thinking I should get a bigger wattage PSU than my current 400 watt power supply. If I got a higher wattage PSU, is there a chance that the wattage rating would burn the power based on the immediate computer load (components installed and intensity of the immediate applications) rather than a constant use based on the 1000 watt rating? During off peak times when I might not have many USB devices plugged in and not be running graphic intensive applications, would it be possible that the 1000 watt PSU would be less bucks (or equal to) the cost of the 400 watt PSU? Or would the 1000 watt PSU cost the same amount for the 24 hour operation of the computer as running a 1000 watt light bulb for the month.By the way, I'm looking at purchasing an 800 watt PSU and I'll be upgrading my 88000gts graphics card soon. I just replaced the case with an AXP 600 that has lots of room and cooling facility. I probably don't need the 800 watts at present, but with time I will be replacing the CPU and motherboard.Is there a chance (or scenario) where a higher wattage PSU might actually be more cost efficient at the end of the month and possible burn less electrical dollars because of less strain to keep up?
View 5 Replies
View Related
Aug 27, 2010
What I have works, but wondering what is the 'right' way to replace the digits with the letters given in this loop? somehow use a case or multiple sed? i thought of a multiple sed or a case but couldn't get it to work
Code:
# ...
bcv=$(echo $line | awk -F" " '{ print $1 }' | sed 's/1/q/g;s/2/w/g;s/3/e/g') # and so on
Code:
while read line
do
bcv=$(echo $line | awk -F" " '{ print $1 }')
if [ $bcv == "" ]
[code].....
View 12 Replies
View Related
Jan 27, 2010
What database can I use for c++?,this is my first week programming in c++.
View 14 Replies
View Related
Feb 10, 2010
sql statement. I am trying to check if there is such a value in the database.
Code:
string NewMovie = "ww";
string queryText ;
queryText = "Select * from movie_info WHERE movie_title = '"+ NewTitle +"'";
MYSQL *conn;
conn=mysql_init(NULL);
mysql_real_connect(conn,host,username,password,database,0,NULL,0);
[Code]......
return 0; The problem i am facing is how do i check if the value is found. I read up and found that a query will return a value of TRUE if the query is a success and a FAIL if there is an error. How do i call these values and then based the check on it?
View 1 Replies
View Related
Apr 7, 2011
How to create a database using c language it includes structures, pointers, arrays and switch..
View 4 Replies
View Related
Apr 26, 2011
I have a php scriptI want it to ping list of ips from a databse(using fping) and based on the status of the values to put them in a field(status) into the database(0 if down,1 if up)i executed tghe script and it gives me this error:Thread 1 - 17:51:01 26-04-2011 4.2.2.2 alive Couldn't execute query.I cant see what 's wrongthis is the source of the php script:
<?php
require_once("conf.php");
$connection1 = mysql_connect($h, $u, $p) or die("Couldn't connect.");
[code]....
View 1 Replies
View Related
Apr 26, 2010
I have created a database which stores students grades for different stages of a project. One of the stages of the project is the specification part. I have a simple bit of html code which is going to be used as the searching facility. I want the user to be able to enter their ID and then it will display only their results. At the moment, it is displaying the results for EVERY student because I cant seem to find the correct syntax for my statement.
Heres the HTML code
<html>
<head>
</head>
<body>
<body bgcolor="#6881bb">
<center>
[Code]....
At the moment when i click the button, no matter what I enter every students marks appear on the screen.
I think, but obviously dont know for sure because if i did i would know how to solve the problem, the code that i need to change is in green.
View 3 Replies
View Related
Aug 9, 2010
How to shorten the long URL without using database(i.e. without storing url entries in DB)?
View 2 Replies
View Related
Jan 5, 2009
I am trying to unload file from a database. Which contains few lines with the character below. Rest of the data was unloaded appropriately.
Code:
a) What does this below character means?
b) How can i remove it,
I already have
Code:
sed '/^$/d'
c) Will this effect the file by any means (If I am guessing properly, this is the eof notation)
View 5 Replies
View Related
May 12, 2011
i get some trouble setting up good environment in linux.i have problem regarding connecting php(under linux) to a sybase server(under windows)is there anyway connecting this two technologies?.
View 1 Replies
View Related
