Mailing List Archive: Cherokee: users

strange logs in cherokee error log

Index | Next | Previous | View Threaded

jorge.sarmiento at gmail

Aug 31, 2009, 10:40 AM

Post #1 of 12 (724 views)
Permalink

strange logs in cherokee error log

Hi everyone!

I have a php site running under apache, and after a server resource
saturation (it had 8 Gb ram + 8 Gb swap all used to 100%) I found the
following error log.

Looks like a list of memory addresses and the php libraries - any idea
what this is means? something crashed and this is a memory dump?

(...)
2af3f8108000-2af3f8109000 rw-p 2af3f8108000 00:00 0
2af3f8109000-2af3f8121000 r-xp 00000000 08:05 9896235
/lib64/libaudit.so.0.0.0
2af3f8121000-2af3f8320000 ---p 00018000 08:05 9896235
/lib64/libaudit.so.0.0.0
2af3f8320000-2af3f8322000 rw-p 00217000 08:05 9896235
/lib64/libaudit.so.0.0.0
2af3f8322000-2af3f832d000 r-xp 00000000 08:05 18153984
/usr/lib64/php/modules/ldap.so
2af3f832d000-2af3f852d000 ---p 0000b000 08:05 18153984
/usr/lib64/php/modules/ldap.so
2af3f852d000-2af3f852e000 rw-p 0000b000 08:05 18153984
/usr/lib64/php/modules/ldap.so
2af3f853a000-2af3f8552000 r-xp 00000000 08:05 18121505
/usr/lib64/libsasl2.so.2.0.22
2af3f8552000-2af3f8752000 ---p 00018000 08:05 18121505
/usr/lib64/libsasl2.so.2.0.22
2af3f8752000-2af3f8753000 rw-p 00018000 08:05 18121505
/usr/lib64/libsasl2.so.2.0.22
2af3f8753000-2af3f878b000 r-xp 00000000 08:05 18121506
/usr/lib64/libldap-2.3.so.0.2.31
2af3f878b000-2af3f898b000 ---p 00038000 08:05 18121506
/usr/lib64/libldap-2.3.so.0.2.31
2af3f898b000-2af3f898d000 rw-p 00038000 08:05 18121506
/usr/lib64/libldap-2.3.so.0.2.31
2af3f898d000-2af3f899a000 r-xp 00000000 08:05 18121504
/usr/lib64/liblber-2.3.so.0.2.31
2af3f899a000-2af3f8b9a000 ---p 0000d000 08:05 18121504
/usr/lib64/liblber-2.3.so.0.2.31
2af3f8b9a000-2af3f8b9b000 rw-p 0000d000 08:05 18121504
/usr/lib64/liblber-2.3.so.0.2.31
2af3f8b9b000-2af3f8d3d000 r-xp 00000000 08:05 18154935
/usr/lib64/php/modules/mbstring.so
2af3f8d3d000-2af3f8f3c000 ---p 001a2000 08:05 18154935
/usr/lib64/php/modules/mbstring.so
2af3f8f3c000-2af3f8f62000 rw-p 001a1000 08:05 18154935
/usr/lib64/php/modules/mbstring.so
2af3f8f62000-2af3f8f6a000 r-xp 00000000 08:05 18154965
/usr/lib64/php/modules/mcrypt.so
2af3f8f6a000-2af3f916a000 ---p 00008000 08:05 18154965
/usr/lib64/php/modules/mcrypt.so
2af3f916a000-2af3f916b000 rw-p 00008000 08:05 18154965
/usr/lib64/php/modules/mcrypt.so
2af3f9177000-2af3f91a0000 r-xp 00000000 08:05 18121445
/usr/lib64/libmcrypt.so.4.4.8
2af3f91a0000-2af3f939f000 ---p 00029000 08:05 18121445
/usr/lib64/libmcrypt.so.4.4.8
2af3f939f000-2af3f93a2000 rw-p 00028000 08:05 18121445
/usr/lib64/libmcrypt.so.4.4.8
2af3f93a2000-2af3f93a8000 rw-p 2af3f93a2000 00:00 0
(...)
_______________________________________________
Cherokee mailing list
Cherokee [at] lists
http://lists.octality.com/listinfo/cherokee

alvaro at alobbs

Aug 31, 2009, 11:45 AM

Post #2 of 12 (700 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

On 31-ago-09, at 19:40, Jorge Sarmiento wrote:

> I have a php site running under apache, and after a server resource
> saturation (it had 8 Gb ram + 8 Gb swap all used to 100%) I found the
> following error log.
>
> Looks like a list of memory addresses and the php libraries - any idea
> what this is means? something crashed and this is a memory dump?

My guess.. something hogs your 8Gb, and there are PHP child processes
running out of memory and crashing because of that.

--
Greetings, alo
http://www.alobbs.com/

_______________________________________________
Cherokee mailing list
Cherokee [at] lists
http://lists.octality.com/listinfo/cherokee

pubcrawler.com at gmail

Aug 31, 2009, 11:53 AM

Post #3 of 12 (699 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

Jorge,

Your issue is with PHP and Apache correct? How about using Cherokee
instead of Apache :) ?

Is this a reoccurring issue - and how long does it take for this
amount of RAM to be consumed?

-Paul

On Mon, Aug 31, 2009 at 2:45 PM, Alvaro Lopez Ortega<alvaro [at] alobbs> wrote:
> On 31-ago-09, at 19:40, Jorge Sarmiento wrote:
>
>> I have a php site running under apache, and after a server resource
>> saturation (it had 8 Gb ram + 8 Gb swap all used to 100%) I found the
>> following error log.
>>
>> Looks like a list of memory addresses and the php libraries - any idea
>> what this is means? something crashed and this is a memory dump?
>
>
> My guess.. something hogs your 8Gb, and there are PHP child processes
> running out of memory and crashing because of that.
>
> --
> Greetings, alo
> http://www.alobbs.com/
>
> _______________________________________________
> Cherokee mailing list
> Cherokee [at] lists
> http://lists.octality.com/listinfo/cherokee
>
_______________________________________________
Cherokee mailing list
Cherokee [at] lists
http://lists.octality.com/listinfo/cherokee

jorge.sarmiento at gmail

Sep 1, 2009, 1:14 AM

Post #4 of 12 (692 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

I am using Cherokee, sorry for the terrible mistake while writing.

This issue has ocurred 3 times in 2 different servers, both with
CentOS 5.3 x64 minimal installation with almost all services down,
everything was installed from CentOS official repositories (except a
couple of libraries from rpmforge) and Cherokee was compiled from
trunk.

problem is: after php-fcgi crashes (for some strange reason) memory
usage jumps and processor usage raises to almost 100%.
Today I fixed it by restarting MySQL and cherokee services (after
about 15 minutes for server to respond).

any ideas on how to debug this or where to start checking for the problem?

thanks for your time,

Jorge S.

On Mon, Aug 31, 2009 at 1:53 PM, pub crawler<pubcrawler.com [at] gmail> wrote:
> Jorge,
>
> Your issue is with PHP and Apache correct? How about using Cherokee
> instead of Apache :) ?
>
> Is this a reoccurring issue - and how long does it take for this
> amount of RAM to be consumed?
>
> -Paul
>
> On Mon, Aug 31, 2009 at 2:45 PM, Alvaro Lopez Ortega<alvaro [at] alobbs> wrote:
>> On 31-ago-09, at 19:40, Jorge Sarmiento wrote:
>>
>>> I have a php site running under apache, and after a server resource
>>> saturation (it had 8 Gb ram + 8 Gb swap all used to 100%) I found the
>>> following error log.
>>>
>>> Looks like a list of memory addresses and the php libraries - any idea
>>> what this is means? something crashed and this is a memory dump?
>>
>>
>> My guess.. something hogs your 8Gb, and there are PHP child processes
>> running out of memory and crashing because of that.
>>
>> --
>> Greetings, alo
>> http://www.alobbs.com/
>>
>> _______________________________________________
>> Cherokee mailing list
>> Cherokee [at] lists
>> http://lists.octality.com/listinfo/cherokee
>>
>
_______________________________________________
Cherokee mailing list
Cherokee [at] lists
http://lists.octality.com/listinfo/cherokee

abarrera at neurosecurity

Sep 1, 2009, 1:20 AM

Post #5 of 12 (693 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

On Tuesday 01 September 2009 10:14:53 Jorge Sarmiento wrote:
> problem is: after php-fcgi crashes (for some strange reason) memory
> usage jumps and processor usage raises to almost 100%.
> Today I fixed it by restarting MySQL and cherokee services (after
> about 15 minutes for server to respond).

What version on php-fcgi are you using? What version of Cherokee are you
using?

I experienced similar problems and it was a conjunction of a faulty php-cgi
and an old version of cherokee.

--
http://www.neurosecurity.com

"We must be the change we wish to see in the world"
Mahatma Gandhi
_______________________________________________
Cherokee mailing list
Cherokee [at] lists
http://lists.octality.com/listinfo/cherokee

abarrera at neurosecurity

Sep 1, 2009, 1:20 AM

Post #6 of 12 (692 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

jorge.sarmiento at gmail

Sep 1, 2009, 1:24 AM

Post #7 of 12 (696 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

Version are:

php-5.1.6-23.2.el5_3 (CentOS 5.3 latest package)

cherokee-0.99.22

Jorge S.

On Tue, Sep 1, 2009 at 3:20 AM, Alejandro
Barrera<abarrera [at] neurosecurity> wrote:
> On Tuesday 01 September 2009 10:14:53 Jorge Sarmiento wrote:
>> problem is: after php-fcgi crashes (for some strange reason) memory
>> usage jumps and processor usage raises to almost 100%.
>> Today I fixed it by restarting MySQL and cherokee services (after
>> about 15 minutes for server to respond).
>
> What version on php-fcgi are you using? What version of Cherokee are you
> using?
>
> I experienced similar problems and it was a conjunction of a faulty php-cgi
> and an old version of cherokee.
>
> --
> http://www.neurosecurity.com
>
> "We must be the change we wish to see in the world"
> Mahatma Gandhi
>
_______________________________________________
Cherokee mailing list
Cherokee [at] lists
http://lists.octality.com/listinfo/cherokee

jorge.sarmiento at gmail

Sep 1, 2009, 1:24 AM

Post #8 of 12 (697 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

abarrera at neurosecurity

Sep 1, 2009, 1:37 AM

Post #9 of 12 (695 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

On Tuesday 01 September 2009 10:24:47 Jorge Sarmiento wrote:
> php-5.1.6-23.2.el5_3 (CentOS 5.3 latest package)

I know it's a pain in the ass but, could you try a newer php version? They're
on the 5.2.10. Try if you can a different version, maybe in the 5.1.x range but
x > 6. Can't remember which version I had gave me problems, but it might go
away with a newer one. I'm currently using 5.2.10 myself and it's not giving
me any problems.

--
http://www.neurosecurity.com

"We must be the change we wish to see in the world"
Mahatma Gandhi
_______________________________________________
Cherokee mailing list
Cherokee [at] lists
http://lists.octality.com/listinfo/cherokee

abarrera at neurosecurity

Sep 1, 2009, 1:37 AM

Post #10 of 12 (696 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

alvaro at octality

Sep 1, 2009, 1:40 AM

Post #11 of 12 (702 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

On 01-sep-09, at 10:24, Jorge Sarmiento wrote:

> Version are:
>
> php-5.1.6-23.2.el5_3 (CentOS 5.3 latest package)
> cherokee-0.99.22

Cherokee 0.99.23 was shipped with a number of improvements in the
spawning mechanism. That something that would most probably help here.
However, it won't fix the source of the problem (some hoggy process
eating all your server memory).

BTW, I'm releasing Cherokee 0.99.24 within the next few hours. If
you're thinking of updating, just bare for the new version.

Cheers!

--
Octality
http://www.octality.com/

_______________________________________________
Cherokee mailing list
Cherokee [at] lists
http://lists.octality.com/listinfo/cherokee

jorge.sarmiento at gmail

Sep 1, 2009, 2:03 AM

Post #12 of 12 (693 views)
Permalink

Re: strange logs in cherokee error log [In reply to]

I will update later (it's 4am here) and report the results.

thanks for your help!

Jorge S.

On Tue, Sep 1, 2009 at 3:40 AM, Alvaro Lopez Ortega<alvaro [at] octality> wrote:
> On 01-sep-09, at 10:24, Jorge Sarmiento wrote:
>
>> Version are:
>>
>> php-5.1.6-23.2.el5_3 (CentOS 5.3 latest package)
>> cherokee-0.99.22
>
>
> Cherokee 0.99.23 was shipped with a number of improvements in the spawning
> mechanism. That something that would most probably help here. However, it
> won't fix the source of the problem (some hoggy process eating all your
> server memory).
>
> BTW, I'm releasing Cherokee 0.99.24 within the next few hours. If you're
> thinking of updating, just bare for the new version.
>
> Cheers!
>
> --
> Octality
> http://www.octality.com/
>
>
_______________________________________________
Cherokee mailing list
Cherokee [at] lists
http://lists.octality.com/listinfo/cherokee

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads