Hi all

I have just purchased a server from iweb.ca
CPU GenuineIntel, Intel(R) Pentium(R) 4 CPU 3.06GHz
Version psa v8.0.1_build80061018.17 os_FedoraCore 4
OS Linux 2.6.17-1.2142_FC4smp
And have installed software that has been running on servers for many tears ie links and webadverts.

However the server keeps crashing and going off line.
The tell me to up the memory from 512 to I Gig so I do that at my cost.
The server still starts to used too much memory and requires constant reboots to stop it from going offline, as the memory slowly creeps up.
They install a new motherboard the memory I now stable but still keeps keeps going off line.
The now reply see below.

Can anyone enlighten me as to what is going on here as the same applications run fine on the old Raq4, for years with no errors.
Is this just BS as there seems to be a lot of it around now days on the web as this is the second dedicated server I have purchased as the first from AIT was just a load of rubbish with constant HD failures.
Replay to mail as to why the server is going off line

Any help would be apriciated

Thanks Norvin

################################# iweb reply
Hi,
It appears to be a memory issue with mysqld :

Dec 17 02:23:33 british-banners kernel: 3134 pages pagetables
Dec 17 02:23:33 british-banners kernel: Out of Memory: Kill process 1840
(mysqld) score 16381 and children.
Dec 17 02:23:33 british-banners kernel: Out of memory: Killed process
1840 (mysqld).
Dec 17 02:23:33 british-banners kernel: Out of Memory: Kill process 1847
(mysqld) score 16381 and children.
Dec 17 02:23:33 british-banners kernel: Out of memory: Killed process
1847 (mysqld).
Dec 17 02:23:33 british-banners kernel: printk: 2 messages suppressed.

I would recommend you to install some monitoring softwares such as the
ones provided at http://rfxnetworks.com/proj.php

However, please keep in mind that we do not offer support for those
softwares.

Sincerely,

--
=========================================
Luc Tellier, SysAdmin [iWeb]
Support / Client Hub : http://Hub.iWeb.ca
http://www.iWeb.ca
===========================

If by "the server keeps crashing" you mean that the physical hardware itself turns off, that sounds like a hardware issue. Try running memtest86+ and see if you can find the bad memory.

If you mean that the software referred to as a "server" quits unexpectedly, it would be nice to know which daemon specifically quits and the exit code when it quits.
From what I see though, it looks like a memory access violation.

Some questions:
Why are you running a development kernel? (An outdated one, no less.)
Does your system actually have multiple CPU cores? You are running an SMP kernel, which is supposed to run on multi-core systems (not that that should cause problems).
What version of the particular daemon that crashes is running? Perhaps there is a known bug that has since been fixed.
Have you looked at your firewall logs? This could be attempts to exploit a buffer overflow vulnerability.

Thank you kindly for your imput and time, they have changed the memory but is slowly creeps up after a few days then the server goes off line.
They seem to think it is a sqld problem and I may have something to do with it thats the funny part I have only just purchsed it from them with nothing running apart from webadverts that does not use sql.
Oh and Plesk
Thanks again for your time
Kind regards
Norvin

The more likely case is that you have something that's running on your server that eats up memory (whether it leaks or just consumes a lot of memory). Your system is running out of memory and the kernel out of memory (OOM) killer kicks in and kills processes that attempt to allocate memory. In your case it's mysqld; it doesn't mean that it's the direct cause of your problems, but it could be related. When you run out of memory and begin swapping heavily, your system slows to a crawl, and that's probably why it needs a reboot.

Unless your system is actually hard crashing and not just crawling to a halt, I would say it isn't a hardware problem, but a software one. Try monitoring the memory usage of the processes running on there. You can try ssh'ing to your server and running 'top'.

Adrian

Oops, didn't see that. mysqld is requesting additional memory and getting killed because there isn't any left. If "goes off line" means that the physical hardware ends up off or the kernel becomes unresponsive, then the problem is probably not mysqld (or it is multiple problems).

There are at least a million different possible causes. There are too obstacles that will prevent me from putting any more thought into your problem. First, you are running an old development kernel. Switch to a development kernel now. There is never a reason to run a development kernel on a server.
Second, you did not answer my questions. You did slightly clarify your initial post, but I still don't know how many CPU cores you have, or which version of mysqld you are running. I don't even know if "reboot" means restarting the physical system itself or the daemon, or what "goes off line" means.

Development kernel? I'm not too familiar with Fedora's naming scheme, but at least the 2.6.17 part of the kernel name isn't a development kernel.

Adrian

Hi,
Thanks again for the help, and sorry to be so vague, however this is the report I am getting from the server as it goes offline

MySQL 4.1.20
***** Nagios 1.0 *****

Notification Type: PROBLEM
Host: cl-t018-340cl
State: DOWN
Address: 64.15.155.173
Info: CRITICAL - Plugin timed out after 10 seconds

Date/Time: Thu Dec 20 17:00:01 EST 2006

I have to do a hard reboot to get it back on line every two days.
The server is as dedicated server purchased from iWeb.ca
They have added more memory to 1Gig changed the mother board and again changed the memory, all at my expense, I may point out this is a hosted Dedicated server in Canada I am in the UK and have paid 3 months in advance.
The memory is slowly creeping up, till after about two days totals out, then, off line with the report above.
They have asked me if I am running any sql well as said it is a new server and I am not running any sql apart from what they have installed with Plesk 8.
The Tech departments have said there seems to be an sql loop and what do I know about it.
I have noticed that when I shell in and top or ps ax I see a migration taking place what is this doing a kill on the PID has no effect.
Well I can’t help them they are renting the server to me, It seems to be a problem now days as this is the third company I have a attempted to hire a dedicated server from with error and huge lose of time and money.

It seems now days that there is a lot of BS with sites offering Dedicated Servers and not supplying the goods.
I have been running an old Raq4 out of Docklands London for the last 6 years with no problems and 99% reliability, and need to upgrade to a faster server.
I have now spent about £1000 on bum servers in the US with AIT.com and now Iweb.ca and some other company that just took payment and I never heard from them again.
What is the Internet coming to?

Cheers for any time given here I am about pack up and go home as the few customers I had are getting pis&^$ off and going elsewhere as the server is always going down, and I am spending time migrating sites from one server to the next.

Thanks again all
For you time
Norvin
Psax below
PID TTY STAT TIME COMMAND
1 ? Ss 0:01 init [3]
2 ? S 0:00 [migration/0]
3 ? SN 2:15 [ksoftirqd/0]
4 ? S 0:00 [watchdog/0]
5 ? S 0:00 [migration/1]
6 ? SN 0:00 [ksoftirqd/1]
7 ? S 0:00 [watchdog/1]
8 ? S< 0:00 [events/0]
9 ? S< 0:00 [events/1]
10 ? S< 0:00 [khelper]
11 ? S< 0:00 [kthread]
14 ? S< 0:00 [kblockd/0]
15 ? S< 0:00 [kblockd/1]
16 ? S< 0:00 [kacpid]
94 ? S< 0:00 [khubd]
96 ? S< 0:00 [kseriod]
159 ? S 0:00 [pdflush]
160 ? S 0:00 [pdflush]
161 ? S 0:00 [kswapd0]
162 ? S< 0:00 [aio/0]
163 ? S< 0:00 [aio/1]
325 ? S< 0:00 [kpsmoused]
341 ? S< 0:06 [kjournald]
525 ? S<s 0:00 udevd -d
743 ? Ss 0:00 kmodule -d
902 ? S< 0:00 [kauditd]
1329 ? S< 0:00 [kjournald]
1332 ? S< 0:00 [kjournald]
1616 ? Ss 0:04 syslogd -m 0
1618 ? Ss 0:00 klogd -x
1635 ? Ssl 0:01 /usr/sbin/named -u named -c /etc/named.conf -u named
1676 ? Ss 0:00 /usr/sbin/sshd
1684 ? Ss 0:01 xinetd -stayalive -pidfile /var/run/xinetd.pid
1744 ? S 0:00 /bin/sh /usr/bin/mysqld_safe --defaults-file=/etc/my.
1777 ? Sl 0:27 /usr/libexec/mysqld --defaults-file=/etc/my.cnf --bas
1846 ? S 0:00 /usr/bin/postmaster -p 5432 -D /var/lib/pgsql/data
1848 ? S 0:00 postgres: logger process
1850 ? S 0:00 postgres: writer process
1851 ? S 0:00 postgres: stats buffer process
1852 ? S 0:00 postgres: stats collector process
1880 ? S 0:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrl
1882 ? S 0:00 /usr/sbin/courierlogger imapd
1890 ? S 0:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrl
1892 ? S 0:00 /usr/sbin/courierlogger imapd-ssl
1898 ? S 0:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrl
1900 ? S 0:00 /usr/sbin/courierlogger pop3d
1907 ? S 0:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrl
1909 ? S 0:00 /usr/sbin/courierlogger pop3d-ssl
1917 ? S 0:08 qmail-send
1919 ? S 0:04 splogger qmail
1920 ? S 0:00 qmail-lspawn ./Maildir/
1921 ? S 0:00 qmail-rspawn
1922 ? S 0:00 qmail-clean
2006 ? Ss 0:02 /usr/sbin/httpd
2079 ? Ss 0:00 /usr/bin/spamd --username=popuser --daemonize --helpe
2081 ? Ss 0:00 /usr/bin/spamd --username=popuser --daemonize --helpe
2082 ? S 0:00 spamd child
2083 ? S 0:00 spamd child
2084 ? S 0:00 spamd child
2085 ? S 0:00 spamd child
2086 ? S 0:00 spamd child
2087 ? S 0:00 spamd child
2088 ? S 0:00 spamd child
2089 ? S 0:00 spamd child
2090 ? S 0:00 spamd child
2091 ? S 0:00 spamd child
2111 ? Ss 0:00 /usr/local/psa/admin/bin/httpsd
2115 ? S 0:02 /usr/local/psa/admin/bin/httpsd
2116 ? S 0:01 /usr/local/psa/admin/bin/httpsd
2117 ? S 0:02 /usr/local/psa/admin/bin/httpsd
2118 ? S 0:01 /usr/local/psa/admin/bin/httpsd
2119 ? S 0:01 /usr/local/psa/admin/bin/httpsd
2141 ? S 0:02 /usr/local/psa/admin/bin/httpsd
2142 ? Ss 0:56 /opt/drweb/drwebd
2176 ? Ss 0:00 crond
2183 ? Ss 0:00 /usr/bin/python /usr/lib/mailman/bin/mailmanctl -s -q
2192 tty1 Ss+ 0:00 /sbin/mingetty tty1
2193 tty2 Ss+ 0:00 /sbin/mingetty tty2
2194 tty3 Ss+ 0:00 /sbin/mingetty tty3
2195 tty4 Ss+ 0:00 /sbin/mingetty tty4
2200 tty5 Ss+ 0:00 /sbin/mingetty tty5
2209 tty6 Ss+ 0:00 /sbin/mingetty tty6
2210 ? Ss 0:01 /usr/local/psa/admin/bin/php /usr/local/psa/admin/bin
2211 ? Ssl 0:14 /usr/local/psa/admin/bin/modules/watchdog/monit -Ic /
2218 ? S 0:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner
2221 ? S 0:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner
2223 ? S 0:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner
2229 ? S 0:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner
2232 ? S 0:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner
2239 ? S 0:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner
2243 ? S 0:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner
2246 ? S 0:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner
2658 ? S 0:01 /usr/local/psa/admin/bin/httpsd
2681 ? S 0:01 /usr/local/psa/admin/bin/httpsd
2682 ? S 0:02 /usr/local/psa/admin/bin/httpsd
2683 ? S 0:01 /usr/local/psa/admin/bin/httpsd
29062 ? S 0:00 /usr/sbin/httpd
29063 ? S 0:00 /usr/sbin/httpd
29065 ? S 0:00 /usr/sbin/httpd
29066 ? S 0:00 /usr/sbin/httpd
29067 ? S 0:00 /usr/sbin/httpd
29068 ? S 0:00 /usr/sbin/httpd
29069 ? S 0:01 /usr/sbin/httpd
29070 ? S 0:01 /usr/sbin/httpd
29085 ? S 0:01 /usr/sbin/httpd
29089 ? S 0:00 /usr/sbin/httpd
29091 ? S 0:01 /usr/sbin/httpd
29092 ? S 0:00 /usr/sbin/httpd
29169 ? S 0:01 /usr/sbin/httpd
29200 ? S 0:00 /usr/sbin/httpd
29201 ? S 0:00 /usr/sbin/httpd
29202 ? S 0:00 /usr/sbin/httpd
9813 ? S 0:00 /usr/sbin/httpd
13033 ? S 0:00 /usr/sbin/httpd
13034 ? S 0:00 /usr/sbin/httpd
13036 ? S 0:00 /usr/sbin/httpd
13038 ? S 0:00 /usr/sbin/httpd
19399 ? S 0:00 /opt/drweb/drwebd
19400 ? S 0:00 /opt/drweb/drwebd
19401 ? S 0:00 /opt/drweb/drwebd
19402 ? S 0:00 /opt/drweb/drwebd
19403 ? S 0:00 /opt/drweb/drwebd
19404 ? S 0:00 /opt/drweb/drwebd
19405 ? S 0:00 /opt/drweb/drwebd
19406 ? S 0:00 /opt/drweb/drwebd
19407 ? S 0:00 /opt/drweb/drwebd
19408 ? S 0:00 /opt/drweb/drwebd
19409 ? S 0:00 /opt/drweb/drwebd
19410 ? S 0:00 /opt/drweb/drwebd
19411 ? S 0:00 /opt/drweb/drwebd
19412 ? S 0:00 /opt/drweb/drwebd
19413 ? S 0:00 /opt/drweb/drwebd
19414 ? S 0:00 /opt/drweb/drwebd
19731 ? Ss 0:00 /var/qmail/bin/qmail-smtpd /var/qmail/bin/smtp_auth /
19824 ? S 0:00 qmail-remote attcanada.net ting_tinshiahn_w@attcanad
19832 ? Ss 0:00 /var/qmail/bin/qmail-smtpd /var/qmail/bin/smtp_auth /
19838 ? S 0:00 qmail-remote attcanada.net shirlr@attcanada.net
19839 ? Ss 0:00 sshd: root@pts/0
19841 pts/0 Ss 0:00 -bash
19889 ? S 0:00 /usr/sbin/pop3login /usr/lib/courier-imap/authlib/aut
19890 ? S 0:00 /usr/sbin/pop3login /usr/lib/courier-imap/authlib/aut
19891 pts/0 R+ 0:00 ps ax

That top output doesn't give memory usage information. Try instead using ps aux
D'oh! Misread the kernel version. I was right about it being outdated though. You might consider upgrading to a 2.6.19 kernel.

If there is a problem with one or a dozen programs, it should not cause the system to become entirely unresponsive. It is possible that this is a continuation of a problem that was already resolved: the system gets a hard shutdown, resulting in corrupted data, resulting in continued problems (more hard shutdowns, more corruption). You might reformat and start over with a minimum of necessities on the system... of course, that may require physical access to the server.

I thank you kindly for your time with this matter and have passed the info onto the Techs that should be able to sort it.
Below is a printout after about 12 hours of up time with the memory almost full and about to go off line, and below that, a ps aux after a hard reboot.
I have advised them to wipe and re image the disk as I have a feeling that Plesk is doing something with mysql.

Before server off line
root@british-banners ~]# ps aux
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 0.0 1744 580 ? Ss Dec22 0:01 init [3]
root 2 0.0 0.0 0 0 ? S Dec22 0:00 [migration/0]
root 3 0.1 0.0 0 0 ? SN Dec22 2:15 [ksoftirqd/0]
root 4 0.0 0.0 0 0 ? S Dec22 0:00 [watchdog/0]
root 5 0.0 0.0 0 0 ? S Dec22 0:00 [migration/1]
root 6 0.0 0.0 0 0 ? SN Dec22 0:00 [ksoftirqd/1]
root 7 0.0 0.0 0 0 ? S Dec22 0:00 [watchdog/1]
root 8 0.0 0.0 0 0 ? S< Dec22 0:00 [events/0]
root 9 0.0 0.0 0 0 ? S< Dec22 0:00 [events/1]
root 10 0.0 0.0 0 0 ? S< Dec22 0:00 [khelper]
root 11 0.0 0.0 0 0 ? S< Dec22 0:00 [kthread]
root 14 0.0 0.0 0 0 ? S< Dec22 0:00 [kblockd/0]
root 15 0.0 0.0 0 0 ? S< Dec22 0:00 [kblockd/1]
root 16 0.0 0.0 0 0 ? S< Dec22 0:00 [kacpid]
root 94 0.0 0.0 0 0 ? S< Dec22 0:00 [khubd]
root 96 0.0 0.0 0 0 ? S< Dec22 0:00 [kseriod]
root 159 0.0 0.0 0 0 ? S Dec22 0:00 [pdflush]
root 160 0.0 0.0 0 0 ? S Dec22 0:00 [pdflush]
root 161 0.0 0.0 0 0 ? S Dec22 0:00 [kswapd0]
root 162 0.0 0.0 0 0 ? S< Dec22 0:00 [aio/0]
root 163 0.0 0.0 0 0 ? S< Dec22 0:00 [aio/1]
root 325 0.0 0.0 0 0 ? S< Dec22 0:00 [kpsmoused]
root 341 0.0 0.0 0 0 ? S< Dec22 0:06 [kjournald]
root 525 0.0 0.0 1648 432 ? S<s Dec22 0:00 udevd -d
root 743 0.0 0.1 3084 1244 ? Ss Dec22 0:00 kmodule -d
root 902 0.0 0.0 0 0 ? S< Dec22 0:00 [kauditd]
root 1329 0.0 0.0 0 0 ? S< Dec22 0:00 [kjournald]
root 1332 0.0 0.0 0 0 ? S< Dec22 0:00 [kjournald]
root 1616 0.0 0.0 1616 568 ? Ss Dec22 0:05 syslogd -m 0
root 1618 0.0 0.0 1564 392 ? Ss Dec22 0:00 klogd -x
named 1635 0.0 0.3 48008 3112 ? Ssl Dec22 0:02 /usr/sbin/named
root 1676 0.0 0.1 4400 1068 ? Ss Dec22 0:00 /usr/sbin/sshd
root 1684 0.0 0.0 2172 812 ? Ss Dec22 0:01 xinetd -stayali
postgres 1846 0.0 0.2 19704 3004 ? S Dec22 0:00 /usr/bin/postma
root 1880 0.0 0.0 3840 780 ? S Dec22 0:00 /usr/lib/courie
root 1882 0.0 0.0 3744 664 ? S Dec22 0:00 /usr/sbin/couri
root 1890 0.0 0.0 3844 784 ? S Dec22 0:00 /usr/lib/courie
root 1892 0.0 0.0 3744 664 ? S Dec22 0:00 /usr/sbin/couri
root 1898 0.0 0.0 3840 780 ? S Dec22 0:00 /usr/lib/courie
root 1900 0.0 0.0 3748 664 ? S Dec22 0:00 /usr/sbin/couri
root 1907 0.0 0.0 3844 784 ? S Dec22 0:00 /usr/lib/courie
root 1909 0.0 0.0 3748 664 ? S Dec22 0:00 /usr/sbin/couri
qmails 1917 0.0 0.0 1600 496 ? S Dec22 0:09 qmail-send
qmaill 1919 0.0 0.0 1556 460 ? S Dec22 0:05 splogger qmail
root 1920 0.0 0.0 1584 372 ? S Dec22 0:00 qmail-lspawn ./
qmailr 1921 0.0 0.0 1976 788 ? S Dec22 0:00 qmail-rspawn
qmailq 1922 0.0 0.0 1552 348 ? S Dec22 0:00 qmail-clean
root 2006 0.0 1.7 34276 18324 ? Ss Dec22 0:03 /usr/sbin/httpd
popuser 2079 0.0 2.1 26620 21916 ? Ss Dec22 0:00 /usr/bin/spamd
popuser 2081 0.0 2.1 26624 21916 ? Ss Dec22 0:00 /usr/bin/spamd
popuser 2082 0.0 1.9 26620 20152 ? S Dec22 0:00 spamd child
popuser 2083 0.0 1.9 26620 20020 ? S Dec22 0:00 spamd child
popuser 2084 0.0 1.9 26620 20020 ? S Dec22 0:00 spamd child
popuser 2085 0.0 1.9 26620 20020 ? S Dec22 0:00 spamd child
popuser 2086 0.0 1.9 26620 20020 ? S Dec22 0:00 spamd child
popuser 2087 0.0 1.9 26624 20152 ? S Dec22 0:00 spamd child
popuser 2088 0.0 1.9 26624 20020 ? S Dec22 0:00 spamd child
popuser 2089 0.0 1.9 26624 20020 ? S Dec22 0:00 spamd child
popuser 2090 0.0 1.9 26624 20020 ? S Dec22 0:00 spamd child
popuser 2091 0.0 1.9 26624 20020 ? S Dec22 0:00 spamd child
root 2111 0.0 0.5 48084 5152 ? Ss Dec22 0:00 /usr/local/psa/
psaadm 2115 0.0 2.3 57752 24528 ? S Dec22 0:02 /usr/local/psa/
psaadm 2116 0.0 2.0 55204 21264 ? S Dec22 0:02 /usr/local/psa/
psaadm 2117 0.0 2.5 55108 25724 ? S Dec22 0:02 /usr/local/psa/
psaadm 2118 0.0 1.3 52796 13804 ? S Dec22 0:01 /usr/local/psa/
psaadm 2119 0.0 1.9 55248 19788 ? S Dec22 0:01 /usr/local/psa/
psaadm 2141 0.0 2.3 55168 24496 ? S Dec22 0:02 /usr/local/psa/
drweb 2142 0.0 1.2 18552 12812 ? Ss Dec22 1:02 /opt/drweb/drwe
root 2176 0.0 0.0 4772 944 ? Ss Dec22 0:00 crond
mailman 2183 0.0 0.4 12220 4908 ? Ss Dec22 0:00 /usr/bin/python
root 2192 0.0 0.0 1548 428 tty1 Ss+ Dec22 0:00 /sbin/mingetty
root 2193 0.0 0.0 1548 428 tty2 Ss+ Dec22 0:00 /sbin/mingetty
root 2194 0.0 0.0 1552 432 tty3 Ss+ Dec22 0:00 /sbin/mingetty
root 2195 0.0 0.0 1552 432 tty4 Ss+ Dec22 0:00 /sbin/mingetty
root 2200 0.0 0.0 1552 428 tty5 Ss+ Dec22 0:00 /sbin/mingetty
root 2209 0.0 0.0 1548 428 tty6 Ss+ Dec22 0:00 /sbin/mingetty
root 2210 0.0 0.5 17212 6032 ? Ss Dec22 0:01 /usr/local/psa/
root 2211 0.0 0.2 14848 2308 ? Ssl Dec22 0:18 /usr/local/psa/
mailman 2218 0.0 0.6 12112 6704 ? S Dec22 0:00 /usr/bin/python
mailman 2221 0.0 0.6 12032 6720 ? S Dec22 0:00 /usr/bin/python
mailman 2223 0.0 0.6 12060 6720 ? S Dec22 0:00 /usr/bin/python
mailman 2229 0.0 0.6 12112 6704 ? S Dec22 0:00 /usr/bin/python
mailman 2232 0.0 0.6 12100 6748 ? S Dec22 0:00 /usr/bin/python
mailman 2239 0.0 0.6 12052 6788 ? S Dec22 0:00 /usr/bin/python
mailman 2243 0.0 0.6 12112 6704 ? S Dec22 0:00 /usr/bin/python
mailman 2246 0.0 0.6 12116 6708 ? S Dec22 0:00 /usr/bin/python
psaadm 2658 0.0 1.9 55008 19832 ? S Dec22 0:02 /usr/local/psa/
psaadm 2681 0.0 2.1 55028 22260 ? S Dec22 0:02 /usr/local/psa/
psaadm 2682 0.0 2.2 55488 23204 ? S Dec22 0:03 /usr/local/psa/
psaadm 2683 0.0 2.1 55284 22464 ? S Dec22 0:02 /usr/local/psa/
drweb 21936 0.0 1.1 18552 11952 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21937 0.0 1.1 18552 12188 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21938 0.0 1.1 18552 12200 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21939 0.0 1.1 18552 12176 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21940 0.0 1.1 18552 11700 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21941 0.0 1.1 18552 11956 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21942 0.0 1.1 18552 12176 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21943 0.0 1.1 18552 11700 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21944 0.0 1.1 18552 11700 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21945 0.0 1.1 18552 11956 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21946 0.0 1.1 18552 12208 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21947 0.0 1.1 18552 12188 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21948 0.0 1.1 18552 11700 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21949 0.0 1.1 18552 12208 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21950 0.0 1.1 18552 11956 ? S 00:17 0:00 /opt/drweb/drwe
drweb 21951 0.0 1.1 18552 11956 ? S 00:17 0:00 /opt/drweb/drwe
postgres 23224 0.0 0.0 9620 560 ? S 01:16 0:00 postgres: logge
mysql 23273 0.0 2.9 129760 30060 ? Sl 01:19 0:09 /usr/libexec/my
postgres 23444 0.0 0.0 19704 856 ? S 01:24 0:00 postgres: write
postgres 23445 0.0 0.0 10620 548 ? S 01:24 0:00 postgres: stats
postgres 23446 0.0 0.0 9796 712 ? S 01:24 0:00 postgres: stats
root 26938 0.0 0.9 26452 9328 ? S 04:13 0:00 /usr/sbin/httpd
apache 26969 0.0 1.1 34276 12228 ? S 04:13 0:00 /usr/sbin/httpd
apache 26970 0.0 1.1 34276 12196 ? S 04:13 0:00 /usr/sbin/httpd
apache 26971 0.0 1.1 34276 12196 ? S 04:13 0:00 /usr/sbin/httpd
apache 26972 0.0 1.1 34276 12192 ? S 04:13 0:00 /usr/sbin/httpd
apache 26973 0.0 1.1 34276 12188 ? S 04:13 0:00 /usr/sbin/httpd
apache 26974 0.0 1.2 34384 12568 ? S 04:13 0:00 /usr/sbin/httpd
apache 26975 0.0 1.1 34276 12232 ? S 04:13 0:00 /usr/sbin/httpd
apache 26976 0.0 1.1 34276 12188 ? S 04:13 0:00 /usr/sbin/httpd
root 2473 0.2 0.2 8748 2876 ? Ss 05:21 0:00 sshd: root@pts/
root 2475 0.0 0.1 4732 1448 pts/0 Ss 05:21 0:00 -bash
root 2502 0.0 0.0 4668 880 pts/0 R+ 05:22 0:00 ps aux
######################
######################
After reboot

USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 0.0 1740 576 ? Ss 05:58 0:00 init [3]
root 2 0.0 0.0 0 0 ? S 05:58 0:00 [migration/0]
root 3 0.0 0.0 0 0 ? SN 05:58 0:00 [ksoftirqd/0]
root 4 0.0 0.0 0 0 ? S 05:58 0:00 [watchdog/0]
root 5 0.0 0.0 0 0 ? S 05:58 0:00 [migration/1]
root 6 0.0 0.0 0 0 ? SN 05:58 0:00 [ksoftirqd/1]
root 7 0.0 0.0 0 0 ? S 05:58 0:00 [watchdog/1]
root 8 0.0 0.0 0 0 ? S< 05:58 0:00 [events/0]
root 9 0.0 0.0 0 0 ? S< 05:58 0:00 [events/1]
root 10 0.0 0.0 0 0 ? S< 05:58 0:00 [khelper]
root 11 0.0 0.0 0 0 ? S< 05:58 0:00 [kthread]
root 14 0.0 0.0 0 0 ? S< 05:58 0:00 [kblockd/0]
root 15 0.0 0.0 0 0 ? S< 05:58 0:00 [kblockd/1]
root 16 0.0 0.0 0 0 ? S< 05:58 0:00 [kacpid]
root 94 0.0 0.0 0 0 ? S< 05:58 0:00 [khubd]
root 96 0.0 0.0 0 0 ? S< 05:58 0:00 [kseriod]
root 159 0.0 0.0 0 0 ? S 05:58 0:00 [pdflush]
root 160 0.0 0.0 0 0 ? S 05:58 0:00 [pdflush]
root 161 0.0 0.0 0 0 ? S 05:58 0:00 [kswapd0]
root 162 0.0 0.0 0 0 ? S< 05:58 0:00 [aio/0]
root 163 0.0 0.0 0 0 ? S< 05:58 0:00 [aio/1]
root 325 0.0 0.0 0 0 ? S< 05:58 0:00 [kpsmoused]
root 341 0.0 0.0 0 0 ? S< 05:58 0:00 [kjournald]
root 525 0.0 0.0 1648 428 ? S<s 05:58 0:00 udevd -d
root 743 0.0 0.1 3084 1240 ? Ss 05:58 0:00 kmodule -d
root 1232 0.0 0.0 0 0 ? S< 05:58 0:00 [kauditd]
root 1419 0.0 0.0 0 0 ? S< 05:58 0:00 [kjournald]
root 1422 0.0 0.0 0 0 ? S< 05:58 0:00 [kjournald]
root 1709 0.0 0.0 1616 572 ? Ss 05:58 0:00 syslogd -m 0
root 1711 0.0 0.0 1568 400 ? Ss 05:58 0:00 klogd -x
named 1728 0.0 0.3 48012 3116 ? Ssl 05:58 0:00 /usr/sbin/named -u named -c /etc/named.
root 1769 0.0 0.1 4400 1064 ? Ss 05:58 0:00 /usr/sbin/sshd
root 1777 0.0 0.0 2172 812 ? Ss 05:58 0:00 xinetd -stayalive -pidfile /var/run/xin
root 1837 0.0 0.1 4596 1236 ? S 05:58 0:00 /bin/sh /usr/bin/mysqld_safe --defaults
mysql 1870 0.0 2.2 128684 23024 ? Sl 05:58 0:00 /usr/libexec/mysqld --defaults-file=/et
postgres 1939 0.0 0.2 19700 3000 ? S 05:58 0:00 /usr/bin/postmaster -p 5432 -D /var/lib
postgres 1941 0.0 0.0 9616 552 ? S 05:58 0:00 postgres: logger process
postgres 1943 0.0 0.0 19700 852 ? S 05:58 0:00 postgres: writer process
postgres 1944 0.0 0.0 10616 544 ? S 05:58 0:00 postgres: stats buffer process
postgres 1945 0.0 0.0 9792 708 ? S 05:58 0:00 postgres: stats collector process
root 1968 0.0 0.0 3844 768 ? S 05:58 0:00 /usr/lib/courier-imap/couriertcpd -addr
root 1970 0.0 0.0 3612 472 ? S 05:58 0:00 /usr/sbin/courierlogger imapd
root 1978 0.0 0.0 3844 772 ? S 05:58 0:00 /usr/lib/courier-imap/couriertcpd -addr
root 1980 0.0 0.0 3616 476 ? S 05:58 0:00 /usr/sbin/courierlogger imapd-ssl
root 1986 0.0 0.0 3840 780 ? S 05:58 0:00 /usr/lib/courier-imap/couriertcpd -addr
root 1988 0.0 0.0 3748 664 ? S 05:58 0:00 /usr/sbin/courierlogger pop3d
root 1995 0.0 0.0 3844 768 ? S 05:58 0:00 /usr/lib/courier-imap/couriertcpd -addr
root 1997 0.0 0.0 3616 476 ? S 05:58 0:00 /usr/sbin/courierlogger pop3d-ssl
qmails 2005 0.0 0.0 1604 488 ? S 05:58 0:00 qmail-send
qmaill 2007 0.0 0.0 1556 452 ? S 05:58 0:00 splogger qmail
root 2008 0.0 0.0 1588 372 ? S 05:58 0:00 qmail-lspawn ./Maildir/
qmailr 2009 0.0 0.0 1584 424 ? S 05:58 0:00 qmail-rspawn
qmailq 2010 0.0 0.0 1552 348 ? S 05:58 0:00 qmail-clean
root 2068 0.0 1.4 30944 14780 ? Ss 05:58 0:00 /usr/sbin/httpd
root 2081 0.0 0.5 22044 5792 ? S 05:58 0:00 /usr/sbin/httpd
apache 2098 0.0 0.9 30944 9296 ? S 05:58 0:00 /usr/sbin/httpd
apache 2099 0.0 0.9 30944 9308 ? S 05:58 0:00 /usr/sbin/httpd
apache 2100 0.0 0.9 30944 9280 ? S 05:58 0:00 /usr/sbin/httpd
apache 2101 0.0 0.9 30944 9316 ? S 05:58 0:00 /usr/sbin/httpd
apache 2102 0.0 0.9 30944 9296 ? S 05:58 0:00 /usr/sbin/httpd
apache 2103 0.0 0.9 30944 9320 ? S 05:58 0:00 /usr/sbin/httpd
apache 2104 0.0 0.9 30944 9296 ? S 05:58 0:00 /usr/sbin/httpd
apache 2105 0.0 0.9 30944 9296 ? S 05:58 0:00 /usr/sbin/httpd
qmailr 2108 0.0 0.0 3784 916 ? S 05:58 0:00 qmail-remote steinag.ch barbabranorry@
popuser 2114 0.0 2.1 26628 21920 ? Ss 05:58 0:00 /usr/bin/spamd --username=popuser --dae
popuser 2116 0.0 2.1 26624 21912 ? Ss 05:58 0:00 /usr/bin/spamd --username=popuser --dae
popuser 2117 0.0 1.9 26628 20164 ? S 05:58 0:00 spamd child
popuser 2118 0.0 1.9 26628 20032 ? S 05:58 0:00 spamd child
popuser 2119 0.0 1.9 26628 20032 ? S 05:58 0:00 spamd child
popuser 2120 0.0 1.9 26628 20032 ? S 05:58 0:00 spamd child
popuser 2121 0.0 1.9 26628 20032 ? S 05:58 0:00 spamd child
popuser 2122 0.0 1.9 26624 20156 ? S 05:58 0:00 spamd child
popuser 2123 0.0 1.9 26624 20024 ? S 05:58 0:00 spamd child
popuser 2124 0.0 1.9 26624 20024 ? S 05:58 0:00 spamd child
popuser 2125 0.0 1.9 26624 20024 ? S 05:58 0:00 spamd child
popuser 2126 0.0 1.9 26624 20024 ? S 05:58 0:00 spamd child
root 2145 0.0 0.5 48088 5152 ? Ss 05:58 0:00 /usr/local/psa/admin/bin/httpsd
psaadm 2150 0.0 0.9 52452 9448 ? S 05:58 0:00 /usr/local/psa/admin/bin/httpsd
psaadm 2151 0.0 1.5 55504 16012 ? S 05:58 0:00 /usr/local/psa/admin/bin/httpsd
psaadm 2152 0.0 1.1 53152 11940 ? S 05:58 0:00 /usr/local/psa/admin/bin/httpsd
psaadm 2153 0.0 2.1 57332 21940 ? S 05:58 0:00 /usr/local/psa/admin/bin/httpsd
psaadm 2154 0.0 0.2 48088 2548 ? S 05:58 0:00 /usr/local/psa/admin/bin/httpsd
psaadm 2168 0.0 0.2 48088 2544 ? S 05:58 0:00 /usr/local/psa/admin/bin/httpsd
drweb 2169 0.0 1.1 18536 11796 ? Ss 05:58 0:00 /opt/drweb/drwebd
drweb 2170 0.0 1.1 18536 11708 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2171 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2172 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2173 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2174 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2176 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2177 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2178 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2180 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2181 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2183 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2184 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2185 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2188 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2189 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
drweb 2190 0.0 1.1 18536 11712 ? S 05:58 0:00 /opt/drweb/drwebd
root 2203 0.0 0.0 4768 948 ? Ss 05:58 0:00 crond
mailman 2210 0.0 0.4 12212 4712 ? Ss 05:58 0:00 /usr/bin/python /usr/lib/mailman/bin/ma
root 2219 0.0 0.0 1552 428 tty1 Ss+ 05:58 0:00 /sbin/mingetty tty1
root 2220 0.0 0.0 1548 428 tty2 Ss+ 05:58 0:00 /sbin/mingetty tty2
root 2221 0.0 0.0 1552 428 tty3 Ss+ 05:58 0:00 /sbin/mingetty tty3
root 2222 0.0 0.0 1552 432 tty4 Ss+ 05:58 0:00 /sbin/mingetty tty4
root 2223 0.0 0.0 1552 428 tty5 Ss+ 05:58 0:00 /sbin/mingetty tty5
root 2224 0.0 0.0 1552 428 tty6 Ss+ 05:58 0:00 /sbin/mingetty tty6
root 2225 0.0 0.5 17208 6032 ? Ss 05:58 0:00 /usr/local/psa/admin/bin/php /usr/local
root 2226 0.0 0.1 14716 1612 ? Ssl 05:58 0:00 /usr/local/psa/admin/bin/modules/watchd
mailman 2343 0.0 0.6 12116 6708 ? S 05:58 0:00 /usr/bin/python /usr/lib/mailman/bin/qr
mailman 2345 0.0 0.6 12032 6720 ? S 05:58 0:00 /usr/bin/python /usr/lib/mailman/bin/qr
mailman 2346 0.0 0.6 12056 6720 ? S 05:58 0:00 /usr/bin/python /usr/lib/mailman/bin/qr
mailman 2347 0.0 0.6 12112 6704 ? S 05:58 0:00 /usr/bin/python /usr/lib/mailman/bin/qr
mailman 2351 0.0 0.6 12100 6748 ? S 05:58 0:00 /usr/bin/python /usr/lib/mailman/bin/qr
mailman 2352 0.0 0.6 12052 6784 ? S 05:58 0:00 /usr/bin/python /usr/lib/mailman/bin/qr
mailman 2353 0.0 0.6 12116 6708 ? S 05:58 0:00 /usr/bin/python /usr/lib/mailman/bin/qr
mailman 2354 0.0 0.6 12112 6704 ? S 05:58 0:00 /usr/bin/python /usr/lib/mailman/bin/qr
qmailr 2533 0.0 0.0 3780 912 ? S 05:59 0:00 qmail-remote restoration.com brestorat
qmailr 2579 0.0 0.0 3780 912 ? S 06:00 0:00 qmail-remote my.kazanova.info humdemps
qmailr 2645 0.0 0.0 3784 916 ? S 06:01 0:00 qmail-remote capresa.com anonymous@brit
qmailr 2674 0.0 0.0 3780 912 ? S 06:02 0:00 qmail-remote freewwweb.com anonymous@br
qmailr 2684 0.0 0.0 3780 920 ? S 06:02 0:00 qmail-remote www-trax.com anonymous@bri
qmailr 2741 0.0 0.0 3780 908 ? S 06:03 0:00 qmail-remote marybyczek.com anonymous@b
qmailr 2907 0.0 0.0 3784 920 ? S 06:07 0:00 qmail-remote tenpm.com anonymous@britis
psaadm 2937 0.0 0.2 48088 2544 ? S 06:07 0:00 /usr/local/psa/admin/bin/httpsd
psaadm 2939 0.0 0.2 48088 2544 ? S 06:07 0:00 /usr/local/psa/admin/bin/httpsd
psaadm 2940 0.0 0.2 48088 2544 ? S 06:07 0:00 /usr/local/psa/admin/bin/httpsd
qmailr 2975 0.0 0.0 3780 912 ? S 06:08 0:00 qmail-remote morija.com anonymous@briti
root 2985 0.0 0.2 8748 2876 ? Ss 06:08 0:00 sshd: root@pts/0
root 3000 0.0 0.1 4732 1448 pts/0 Ss 06:08 0:00 -bash
qmailr 3125 0.0 0.0 3780 912 ? S 06:11 0:00 qmail-remote top-baccarat-info.com anon
qmailr 3131 0.0 0.0 3780 912 ? S 06:11 0:00 qmail-remote lottery-results-info.com a
qmailr 3139 0.0 0.0 3780 912 ? S 06:11 0:00 qmail-remote mahjong-info.com anonymous
qmailr 3192 0.0 0.0 3784 920 ? S 06:13 0:00 qmail-remote permanent-daylight.net lg
qmailr 3210 0.0 0.0 3780 916 ? S 06:13 0:00 qmail-remote amomortgage.com dubmansyp
qmailr 3326 0.0 0.0 3784 916 ? S 06:16 0:00 qmail-remote attcanada.net ting_tinshi
qmaild 3360 0.0 0.0 3804 860 ? Ss 06:17 0:00 /var/qmail/bin/qmail-smtpd /var/qmail/b
root 3377 0.0 0.0 4668 872 pts/0 R+ 06:18 0:00 ps aux
[root@british-banners ~]#
Sorry to fill the forum with all this text
Happy Xmas

After looking at that a few times, I don't see anything at all out of the ordinary about the memory usage. I suppose it is possible that mysqld tries executing a query that requires a lot of RAM, more than your server has, and mysqld dies. But that should have no impact on the other processes or the responsiveness of the system in general.

I can't tell you what the problem is.

What are the values of

'min-spare'
'max-spare'

in /usr/bin/spamd

Can you reduce the number of spamd children being spawned by default and the min and max spare and check how it goes?
Also disabled persistent connetions in php.ini and restart apache.

Just a shot in the dark

Thanks
HyTC
==================================
Mail Me If Contacting Privately Is That Necessary.
==================================

Hi thanks again,

I really am getting it with this one I have a site that has been running DBman flat file for years, ok I have moved him to the server at iweb and guess what, DBman is the problem as when the server went down again out of memory it just happened to be running that site.
This is their reply the client name is pcraven, So I have at great expence and time moved the offending site using DBman off the iweb server
##########
Hi,

Here is processes that were using the most resources on your
server, a
minute before the crash. From "ps" command:

root 1888 0.0 0.0 2176 812 ? Ss 00:18 0:00
xinetd
-stayalive -pidfile /var/run/xinetd.pid
pcraven 27926 29.3 15.8 166812 162836 ? Ss 18:25 4:08 \_
proftpd: pcraven - 209.172.34.206: IDLE
pcraven 27982 30.3 10.9 116572 112520 ? Rs 18:29 3:04 \_
proftpd: pcraven - 209.172.34.206: IDLE
pcraven 28052 31.0 4.3 49124 45084 ? Rs 18:36 1:14 \_
proftpd: pcraven - 209.172.34.206: IDLE
pcraven 28091 28.8 0.4 8284 4232 ? Ss 18:39 0:02 \_
proftpd: pcraven - 209.172.34.206: IDLE

And from "top":

28091 pcraven 15 0 54940 49m 2304 S 35.2 5.0 1:36.05
in.proftpd
28052 pcraven 15 0 95900 89m 2304 S 27.4 8.9 2:48.95
in.proftpd
27926 pcraven 15 0 208m 204m 2304 R 23.4 20.4 5:43.14
in.proftpd
27982 pcraven 16 0 159m 155m 2308 R 21.5 15.5 4:38.44
in.proftpd

So this is clearly related to the FTP account of the user
"pcraven". You
should investigate this user and suspend its account in order to
see if
it could solves the problem.

Regards,

###########
I have taken this site off line lost customers and guess what the server is down again out of memory and the offending site pcraven is running like RR on the old Raq4.
This has gone on for a few months now repeated requests to change the server have fallen on deaf ears, or even requests to reimage the system.

Oh what to do, take a look at iweb.ca site all the guarantees and no down time, but they have been the cause of almost the loss of my business and 2 months work and still the server I paid for in advance will only run for 10 Hours before going off line.
What is the net coming too.

Thanks again for you help chaps I will put the advice you have given into effect.
It looks like again I have lost money paying for servers that don’t work I will have to go back to using UK servers, and pay again.

Happy new year to all and thanks kindly for all the time given

Norvin

I'm not sure what your situation is, but have you thought of colocating a server locally? Many local service providers will charge you a monthly "rack space" fee and maybe a "free" reboot once a month or so. The best part is that you can physically touch your server anytime you like and bring in your own outside help if things come up that you can't solve.

Hi,

You should put a memory limit on proftpd so it doesn't use up all your resources. I suspect you have a directory with a very large number of files in it (maybe an unchecked Maildir). A user is going into that directory and getting the listing of files, and that is causing proftp to eat up all the memory on the server.

Hope that helps,

Alex
--
Gossamer Threads Inc.