Ubuntu Servers :: 10.04 LTS - Mysql Fills Up / With Invisible Files?
Jul 23, 2010
I'm having the oddest problem. I use Ubuntu 10 LTS on 3 Amazon EC2 "large" instances, for Drupal hosting. All three servers are seeing the same issue, where root gradually fills up with files that I cannot see by any means. ls -a , du , nothing seems to see these files except for df. And when the drive gets full (after about a week), the server behaves as if the disk is full... so I believe that df is correct here. The moment I restart mysql, all that invisible data disappears, and everything is fine again.
The MySQL datadir is on a separate device (600GB EBS mounted at /ebs ), so it's definitely not MySQL data. And /tmp doesn't have anything visible going on; certainly not something that would take up 9gb.
I suspect that something is causing the kernel to not release file handlers correctly. For all I know this could be happening with all programs, but MySQL is the only thing running that would use enough temp space to be noticed. Each server has some applications that happen on it uniquely, but since it's happening on all of them I figure it's the common elements that count. The servers are a clean install, running Apache2 (PHP 5.3), MySQL, and SSHD. All three servers were installed from the official AMI.
I just got Ubuntu to install, which is great. However, during the part of the installation that involved setting up software, something went wrong. I used the alternate installer and toward the end of that step, it told me the step failed. I simply skipped the step because of this. The result: I've got Ubuntu going, but it's only the command line. I need some help getting GNOME installed from here. I searched and saw people saying to use sudo apt-get install ubuntu-desktop, but that just fills my screen with messages about missing files.
How do I restore MySQL Databases from an old hdd with Ubuntu on it which won't boot? Information below is not necessary just explaining how I ended up in this situation. Today the harddrive crashed on one of my development servers and I have no recent backup of the MySQL databases on the server.
The stuff on the server weren't horrible important but it would still be nice if I were able to recover some of the files. This is the thing, I don't think the harddrive is entirely dead because it comes to a screen saying harddrive error something enter to continue then it says GRUB in the upper left corner before the computer crashes/reboots.
So I installed Ubuntu server on a new HDD and now I want to attempt to recover the databases from the old HDD by mounting it in Ubuntu but before trying I would like to know who one does that. As I've understood it's a bit more complicated then one might thing because MySQL uses binaries and not plain-files.
I've got a NAS running and I'd like to somehow make some of the folders and files invisible to certain users only. For example, if I 'ls' a directory, I want to see files 'a', 'b', and 'c'. But if another user does 'ls' in the same directory, I only want them to be able to see 'a' listed.I know I can use 'chmod +700' to make certain files not able to be read/written, but the filename would still appear in a 'ls'.I know I can put certain files inside of a '.hidden' file in the folder, but then it would be hiEdit : I'd also like to mention that the users that connect to the NAS could be coming from Windows or Mac operating systems. So hopefully the solution would work for users from those systems also..
Yesterday I installed 11.4. First it did run very nice but now I am facing an odd problem: I am mounting on my new 11.4 box a folder via nfsv4 from an opensuse 11.2 server (updated to kernel 2.6.33.6).
I got some folders where the 11.4 cannot see files which are defenitely present on the server. They are completely invisible to the client! In one particular case I have eg. 108 files in the folder on the server, but the 11.4 box only sees 107. One is missing. It does not show up using ls and I also can't access it blindly using eg. cat. The file does not differ from all the others in that folder regarding permissions/ownership/acls etc. It is also not big (1728 bytes) nor is it a special file (link/socket etc.just a plain C header file). That single file is just not visible when mounting with nfsv4 on the 11.4 box. When mounting it with nfs3 instead the file is visible. But for obvious reasons I want to stick with nfsv4.
I restarted all nfs related daemons on both the server and the client a couple of times but it does not make any difference. I also cannot find any problems in any log files on the server or client up to now. I rebooted the client but not the server (I can't do that right now as it is in heavy production).
I do not see these problems with other opensuse boxes running 11.0/11.2 or 11.3 in my network. They can see/access these files quite nicely. This is really strange. Does any have a clue what is going on here or how I can narrow that problem down?
I have a separate data partition on my F12 box with one dir for my children and subdirs for each of them. because they had no rw- rights and because they sometimes use one of the other logins to work for school I changed the permissions for their dir so that anyone has access. I used
Code:
# chmod -R 666 [their directory]
after that Nautilus displayed an empty folder even with 'show hidden files' on.however, with
Code:
ls -lh
on the dir and subdirs all the files seem to be present (luckily).
I have installed Mysql in Ubuntu 9, for the use of roundcube database.After installing iam getting the error like this
* Stopping MySQL database server mysqld [ OK ] * Starting MySQL database server mysqld [ OK ] * Checking for corrupt, not cleanly closed and upgrade needing tables.
So because of this in the roundcube configuration its giving the error message that MYSQL is not installed. So Kindly give me a idea how to solve this.
I am trying to get mysql to start at boot without any success.
The mysqld scripts works fine when run from the command line, but it does not work when i use the links created by chkconfig. I checked the boot.log and found that mysql starts but then it stops or gets shutdown. This is the log message:
Starting mysqld daemon with databases from /data/mysql [ OK ] Starting cups: [ OK ] STOPPING server from pid file /var/run/mysqld/mysqld.pid starting DenyHosts: /usr/bin/denyhosts.py --daemon --config=/usr/share/denyho sts/denyhosts.cfg 090727 04:35:47 mysqld ended
System:Thunderbird v3.0.5Ubuntu Lucid LynxEverything works fine with Thunderbird until I view the Inbox.When I start thunderbird the "Whats New in Thunderbird" tab is shown. As soon as I click on the Inbox tab the RAM is filled to 97% and the system slows down immediately. After killing thunderbird everything works fine.
The rest are below a MB. This system is not a dual boot so 241Gb is ext4 and 8.9Gb is Extended and 8.9GB is Swap. This system has been loaded for about a month, when I initially loaded it there was 230GB free.
Being a noob to gnome. i was playing around with rhythmbox and suddenly found i could not close it. I had lost the title bar and the quit selection in the file menu was grayed out. Alt-tab seemed to work but rythmbox stayed on top (so it essentially didn't work). I finally had to go to cl and kill -9. Not the optimal way to shut down an app.So, to recap... rythmbox fills screen with it's menubar at top and it's status bar at bottom
I was reading [URL] which as the following in "Warning": Warning It is not a good idea to configure InnoDB to use data files or log files on NFS volumes. Otherwise, the files might be locked by other processes and become unavailable for use by MySQL. What does that mean, and how can one configure or check to ensure the above is being followed?
I was curious about the constantly blinking HDD led on my netbook, and I found out, that the modem-manager daemon constantly spamming my logs.The affected logs are syslog, daemon.log and debug.he modem-manager service drops a line every 2 second (actual time) to these 3 logfile.It is just a conncetion information, like this:
I was just copying a large (50GB) file from one mounted partition to another mounted partition (a USB drive), but before the operation completed, my root filesystem, on a separate partition, filled up.Because it filled up I also couldn't get past the login when I rebooted. I think this is because there is no room to load temporary files. I'm expanding the root partition to temporarily fix this. how can I avoid my root file system filling up when copying a massive file between mounted partitions? the file is being cached in root during the transfer.
fc10 86_64Every time I login and do not run any programs, the swap space used goes from 300 MB to 6GB. Memory stays at about 320 MB (out of 4 GB). I takes several minutes to fill the swap space, and when it gets full, it then goes back to 300 MB. Then the system runs ok.The system monitor shows no processes (other than itself) running, but cpu usage is about 20% on 1 of the 2 cpus
This last time i managed to get it to install but it starts to load and the little Fedora hourglass fills up to the top and then it hard locks the machine. So.. I trashed the install and but ubuntu on.. but i wanted to give it another go, this time downloading the live CD rather then the DVD and see if i have better luck with it. My system is:
I7 920 with ASUS Mainboard :Asus P6T DELUXE V2 Physical Memory :12288MB (6 x 2048 DDR3-SDRAM ) Hard Disk :Seagate ST95005620AS (500GB) (clean drive not raid) Video Card 1 :NVIDIA GeForce GTX 285 Video Card 2 :NVIDIA GeForce GTX 285
I have no logs at this time since, i wiped the original install out, i am just finishing out the download of the live CD and will try again. The qustion is is something i have an ovious issue, like the 2 video cards or something incompatable etc?
I've just checked my apache error log and it's filled with this: Code: [error] [client 127.0.0.1] File does not exist: /srv/www/htdocs/announce Every 8 minutes or so.
I'm running rTorrent as daemon on same machine, and I suspect it's trying to access something like http://localhost/announce. But that's just my guess, is it some misconfiguration of rTorrent, and how do I fix that? Or should I just ignore all those errors.
I think this goes here, but I'm not sure. I decided that XAMPP had been troublesome enough. MySQL never worked. So I decided to instal the LAMP stack offered by YaST. I went about installing it thinking that it would all work. But it seems that I was wrong. So I try to start mysql, and here's what I get:
Code: the-matrix:~ # mysql start ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/mysql/mysql.sock' (2) or Code: the-matrix:~ # rcmysql start Starting service MySQL warning: /var/mysql/mysql.sock didn't appear within 30 seconds chmod: cannot access `/var/run/mysql/mysqld.pid': No such file or directory
i am using liferay5.2(mysql included in the download pack) on fedora. while liferay is working fine but i cannot connect to mysql.i am getting the error
[ [root@localhost ~]# ln -s /var/lib/mysql/mysql.sock /tmp [root@localhost ~]# /etc/init.d/mysqld start Timeout error occurred trying to start MySQL Daemon.
[code]....
i didnt find the mysql.sock file in the location /var/lib/mysql/mysql.sock. i cannot find the portal-ext.properties file also to make intial settings.
I'm trying to start my MySQL server, and it fails if the /etc/mysql/my.cnf file is there. If it isn't, then it fails - syslog shows me this:
Code: Jun 5 11:02:53 myhost /etc/init.d/mysql[21733]: 0 processes alive and '/usr/bin/mysqladmin --defaults-file=/etc/mysql/debian.cnf ping' resulted in Jun 5 11:02:53 myhost /etc/init.d/mysql[21733]: #007/usr/bin/mysqladmin: connect to server at 'localhost' failed
I have probably found a bug in the Ubuntu php5 package. At first I thought it's a problem with Zend Framework, which I use, then I thought it's a php issue, but now it seems to be a problem with Ubuntu's php packages. My problem is that under certain conditions, php is going to read records from the mysql database table infinite times. For a much more detailed description of the bug,[URL]..
I've tried on an x86 Ubuntu Desktop edition, and an x64 Ubuntu Server edition, both 10.04, and both had this bug. I have set up a test system (x86 Ubuntu Server edition 10.04), and compiled apache2 and php5 from source, but used the mysql-server package from the repository. And I couldn't reproduce the bug. However, after copying the self-compiled libphp5.so file from the test system to the desktop that produces the error, I could still reproduce the error on the desktop. This suggests me that the problem is either not in php, or - more probably - there are multiple php binaries used in the repository version, and therefore it doesn't matter that I've copied my libphp5.so because mysql functions are somewhere else. I've found a mysql.so file in /usr/lib/php5/20090626+lfs coming from the php5-mysql package. Does that have anything to do with this issue?
Is there a php,mysql built in?What folder do i put my website?What command do i need to use to start and stop apache?If there isnt php,mysql built in how do i install it ?
I'm using ubuntu 10.04 LTS I install mysql..Code: sudo apt-get install mysql-server.I set up my password and confirm,I type mysql at the terminal and i get this back.
My mysql server won't start on my machine. It simply fails with no errors. Code: sudo /etc/init.d/mysql restart * Stopping MySQL database server mysqld [ OK ] * Starting MySQL database server mysqld [fail]
When I run cat /var/log/mysql.err the file is empty, thinking this might be a permissions issue I tried chowning to a mysql user. Here's the current permissions. Code: ls -alh /var/log/mysql* -rw-r----- 1 mysql adm 0 2009-09-30 11:08 /var/log/mysql.err -rw-r----- 1 mysql adm 0 2010-01-15 09:07 /var/log/mysql.log -rw-r----- 1 mysql adm 20 2009-11-25 07:35 /var/log/mysql.log.1.gz -rw-r----- 1 mysql adm 20 2009-11-24 07:59 /var/log/mysql.log.2.gz -rw-r----- 1 mysql adm 20 2009-11-23 07:56 /var/log/mysql.log.3.gz -rw-r----- 1 mysql adm 20 2009-11-22 07:54 /var/log/mysql.log.4.gz -rw-r----- 1 mysql adm 20 2009-11-21 07:47 /var/log/mysql.log.5.gz -rw-r----- 1 mysql adm 20 2009-11-20 07:43 /var/log/mysql.log.6.gz -rw-r----- 1 mysql adm 20 2009-11-19 07:35 /var/log/mysql.log.7.gz
/var/log/mysql: total 8.0K drwxrwsrwx 2 mysql adm 4.0K 2009-09-30 11:08 . drwxr-xr-x 16 root root 4.0K 2010-01-15 10:24 .. Still having the same issue, mysql server is still failing and /var/log/mysql.err is still empty.
