Mailing List Archive: MythTV: Dev

Having run time problems?

Index | Next | Previous | View Threaded

danielk at cuymedia

Jun 20, 2012, 7:10 AM

Post #1 of 8 (637 views)
Permalink

Having run time problems?

If you are having problems running the latest MythTV master
please do this:

sudo rm -Rf /usr/local/include/mythtv
sudo rm -Rf /usr/local/lib/mythtv

sudo rm -Rf /usr/local/share/mythtv
sudo rm -Rf /usr/local/lib/libmyth*
sudo rm -Rf /usr/local/bin/myth*

Then do a distclean in both the mythtv and the mythplugins
directories before rebuilding & reinstalling.

The first two rm's are necessary for most since we rarely
do a make uninstall before doing a git pull and rebuild
and install so cruft builds up. The next three rm's
eliminate any chance of old code in /usr/local causing
problems.

If you've ever installed from packages then repeat the
rm's above with /usr/local replaced with /usr. If you've
installed in some other location like opt, clean that
out likewise.

We're hearing reports of large virtual memory use, high CPU
use and crashes with code from the last week or so. But a
few of these have been fixed with a cleanup proceedure like
the one outlined above.

-- Daniel
_______________________________________________
mythtv-dev mailing list
mythtv-dev [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-dev

tom at redpepperracing

Jun 23, 2012, 2:02 PM

Post #2 of 8 (578 views)
Permalink

Re: Having run time problems? [In reply to]

On Wed, Jun 20, 2012 at 10:10 AM, danielk <danielk [at] cuymedia> wrote:
> If you are having problems running the latest MythTV master
> please do this:
>
> sudo rm -Rf /usr/local/include/mythtv
> sudo rm -Rf /usr/local/lib/mythtv
>
> sudo rm -Rf /usr/local/share/mythtv
> sudo rm -Rf /usr/local/lib/libmyth*
> sudo rm -Rf /usr/local/bin/myth*
>
> Then do a distclean in both the mythtv and the mythplugins
> directories before rebuilding & reinstalling.
>
> The first two rm's are necessary for most since we rarely
> do a make uninstall before doing a git pull and rebuild
> and install so cruft builds up. The next three rm's
> eliminate any chance of old code in /usr/local causing
> problems.
>
> If you've ever installed from packages then repeat the
> rm's above with /usr/local replaced with /usr. If you've
> installed in some other location like opt, clean that
> out likewise.
>
> We're hearing reports of large virtual memory use, high CPU
> use and crashes with code from the last week or so. But a
> few of these have been fixed with a cleanup proceedure like
> the one outlined above.
>
> -- Daniel

Should this be considered normal after following the above?

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
4552 root 20 0 9349m 6.6g 5208 S 265.2 84.2 870:57.86 mythbackend

Basically doing the above made no difference. I'm not sure why no one
else is seeing this. All I have to do is watch recordings and the
memory used and CPU skyrockets.

Tom
_______________________________________________
mythtv-dev mailing list
mythtv-dev [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-dev

stuart at tase

Jun 23, 2012, 2:39 PM

Post #3 of 8 (575 views)
Permalink

Re: Having run time problems? [In reply to]

On Saturday 23 Jun 2012 17:02:19 Tom Lichti wrote:
> On Wed, Jun 20, 2012 at 10:10 AM, danielk <danielk [at] cuymedia> wrote:
> > We're hearing reports of large virtual memory use, high CPU
> > use and crashes with code from the last week or so. But a
> > few of these have been fixed with a cleanup proceedure like
> > the one outlined above.
> >
> > -- Daniel
>
> Should this be considered normal after following the above?
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 4552 root 20 0 9349m 6.6g 5208 S 265.2 84.2 870:57.86 mythbackend
>
> Basically doing the above made no difference. I'm not sure why no one
> else is seeing this. All I have to do is watch recordings and the
> memory used and CPU skyrockets.

You aren't the only one seeing it. When Daniel said "a few of these have been
fixed" he was referring to the crashes. The memory/cpu issues remains and can
be reproduced by several people including devs, but we're having a hard time
figuring out the cause.

It's not 'normal', it's a bug which we're working on fixing, or we will be
just as soon as we can find it.
--
Stuart Morgan
_______________________________________________
mythtv-dev mailing list
mythtv-dev [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-dev

jyavenard at gmail

Jun 23, 2012, 4:17 PM

Post #4 of 8 (573 views)
Permalink

Re: Having run time problems? [In reply to]

Hi

On Saturday, 23 June 2012, Stuart Morgan wrote:

>
> You aren't the only one seeing it. When Daniel said "a few of these have
> been
> fixed" he was referring to the crashes. The memory/cpu issues remains and
> can
> be reproduced by several people including devs, but we're having a hard
> time
> figuring out the cause.
>
> It's not 'normal', it's a bug which we're working on fixing, or we will be
> just as soon as we can find it.
>
>
Someone in the user list mentioned that reverting a commit about using
reference counter fixed the high CPU usage for him.. Worth looking into.

stuart at tase

Jun 24, 2012, 1:12 AM

Post #5 of 8 (571 views)
Permalink

Re: Having run time problems? [In reply to]

On Sunday 24 Jun 2012 09:17:50 Jean-Yves Avenard wrote:
> Hi
>
> On Saturday, 23 June 2012, Stuart Morgan wrote:
> > You aren't the only one seeing it. When Daniel said "a few of these have
> > been
> > fixed" he was referring to the crashes. The memory/cpu issues remains
> > and
> > can
> > be reproduced by several people including devs, but we're having a hard
> > time
> > figuring out the cause.
> >
> > It's not 'normal', it's a bug which we're working on fixing, or we will
> > be just as soon as we can find it.
>
> Someone in the user list mentioned that reverting a commit about using
> reference counter fixed the high CPU usage for him.. Worth looking into.

That was on the frontend, the backend CPU usage seems to relate to logging
somehow.
--
Stuart Morgan
_______________________________________________
mythtv-dev mailing list
mythtv-dev [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-dev

tom at redpepperracing

Jun 24, 2012, 6:01 AM

Post #6 of 8 (569 views)
Permalink

Re: Having run time problems? [In reply to]

On Sun, Jun 24, 2012 at 4:12 AM, Stuart Morgan <stuart [at] tase> wrote:
> On Sunday 24 Jun 2012 09:17:50 Jean-Yves Avenard wrote:
>> Hi
>>
>> On Saturday, 23 June 2012, Stuart Morgan wrote:
>> > You aren't the only one seeing it. When Daniel said "a few of these have
>> > been
>> > fixed" he was referring to the crashes. The memory/cpu issues remains
>> > and
>> > can
>> > be reproduced by several people including devs, but we're having a hard
>> > time
>> > figuring out the cause.
>> >
>> > It's not 'normal', it's a bug which we're working on fixing, or we will
>> > be just as soon as we can find it.
>>
>> Someone in the user list mentioned that reverting a commit about using
>> reference counter fixed the high CPU usage for him.. Worth looking into.
>
> That was on the frontend, the backend CPU usage seems to relate to logging
> somehow.

Thanks for the update. It just seemed like my info got dropped into a
void, with no comments either way. Let me know if there is anything I
can do to help.

Tom
_______________________________________________
mythtv-dev mailing list
mythtv-dev [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-dev

gjhurlbu at gmail

Jun 26, 2012, 4:09 PM

Post #7 of 8 (538 views)
Permalink

Re: Having run time problems? [In reply to]

On Sun, Jun 24, 2012 at 1:12 AM, Stuart Morgan <stuart [at] tase> wrote:
> That was on the frontend, the backend CPU usage seems to relate to logging
> somehow.

Turns out it wasn't logging after all, but rather the ThreadPool not
cleaning up after threads are returned to it. How the logging changes
managed to trigger the issue, I'm not quite sure yet, but Daniel seems
to have fixed the issue with his commit this morning according to all
reports I've heard.
_______________________________________________
mythtv-dev mailing list
mythtv-dev [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-dev

tom at redpepperracing

Jun 27, 2012, 6:25 AM

Post #8 of 8 (534 views)
Permalink

Re: Having run time problems? [In reply to]

On Tue, Jun 26, 2012 at 7:09 PM, Gavin Hurlbut <gjhurlbu [at] gmail> wrote:
> On Sun, Jun 24, 2012 at 1:12 AM, Stuart Morgan <stuart [at] tase> wrote:
>> That was on the frontend, the backend CPU usage seems to relate to logging
>> somehow.
>
> Turns out it wasn't logging after all, but rather the ThreadPool not
> cleaning up after threads are returned to it. How the logging changes
> managed to trigger the issue, I'm not quite sure yet, but Daniel seems
> to have fixed the issue with his commit this morning according to all
> reports I've heard.

Excellent news! I will rebuild tonight and see how it goes.

Thanks!
Tom
_______________________________________________
mythtv-dev mailing list
mythtv-dev [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-dev

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads