Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: MythTV: Users

Transcoding overhead, could use some advice...

 

 

MythTV users RSS feed   Index | Next | Previous | View Threaded


curtis at penguinbrat

Dec 14, 2003, 12:54 PM

Post #1 of 5 (1010 views)
Permalink
Transcoding overhead, could use some advice...

Is there anyway to speed up the process of transcoding, currently it
is taking hours to transcode. a 2hr movie transcoded to the highest
format is taking from 4-6+ hours to finish. Im running the backend and
frontend on the same machine, while it is transcoding I can't record -
let alone transcode another recording (other wise the frontent locks
up)... I realize that this may be a CPU intensive task (which it is,
jumps the load up to 3.0-5.0) - but it doesnt seem to make a difference
(in time) whether anything else is running or not, as in watching live
tv...
Im running everything on a P4 2.4 ghz, 256mg ram (could be an issue),
all on top of GenToo... Im still on 0.12, waiting for the transcoding to
finish so I can compile 0.13 - its been processing since 7:30 this
morning (roughly 7hrs)...

TIA,
Curtis


james at mauibay

Dec 14, 2003, 1:23 PM

Post #2 of 5 (969 views)
Permalink
Re: Transcoding overhead, could use some advice... [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Sunday 14 December 2003 09:54, Curtis Wood wrote:
> Is there anyway to speed up the process of transcoding, currently it
> is taking hours to transcode. a 2hr movie transcoded to the highest
> format is taking from 4-6+ hours to finish. Im running the backend and
> frontend on the same machine, while it is transcoding I can't record -
> let alone transcode another recording (other wise the frontent locks
> up)... I realize that this may be a CPU intensive task (which it is,
> jumps the load up to 3.0-5.0) - but it doesnt seem to make a difference
> (in time) whether anything else is running or not, as in watching live
> tv...

The transcoding is indeed CPU-bound. The compression ratio affects transcoding
time somewhat, but in general you aren't going to dramatically reduce your
transcoding time without a lot more CPU. Your processor is crunching as fast
as it can, end of story. You can only make it faster by asking it to do less,
and that involves significant tradeoffs when if comes to compressing video in
software on a general purpose CPU.

What I'd love to see is a way to use hardware encoders like the PVR-250 for
transcoding, and even then we would have the overhead of software decoding to
feed the encoder for transcoding. Ahh well. :)

I don't do a lot of transcoding with mythtranscode, but I assume there's a bug
that prevents you from transcoding in the background while recording. There's
no inherent reason I'm aware of that should cause this problem. The
transcoding threads should be the lowest priority, so sorry to hear you are
having lockups. Perhaps fixing that problem will make living with transcoding
easier.

Myself, I chose to avoid transcoding as much as possible. The PVR-250 cards
really take burden off the CPU and I can avoid encoding by recording directly
to a format that is very versatile. I know that may not apply to your
situation, but the cost of the cards was way lower for me than the cost of my
time in working around the issues of not having hardware encoding. :)

My advice: try to reduce your need to transcode for common use. If that's not
an option, add more or faster CPU. At the very least try to solve your lockup
issue so that transcoding does not interfere with normal recording. And good
luck!

> Im running everything on a P4 2.4 ghz, 256mg ram (could be an issue),
> all on top of GenToo... Im still on 0.12, waiting for the transcoding to
> finish so I can compile 0.13 - its been processing since 7:30 this
> morning (roughly 7hrs)...
>
> TIA,
> Curtis
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.1 (GNU/Linux)

iD8DBQE/3Ma6T8BYaKRUpkQRAr/4AKCco0tAReh6pmj+mwc25Ok1+ijPXQCeIxwX
nkoEZmsmsHdd9igsFLyuKUI=
=d938
-----END PGP SIGNATURE-----


_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


curtis at penguinbrat

Dec 14, 2003, 3:22 PM

Post #3 of 5 (959 views)
Permalink
Re: Transcoding overhead, could use some advice... [In reply to]

Thanks, the lockups are simply because the load gets way to high -
the last time I was recording like 3 movies over night I came in the
morning and the load was like at 8.50! I am in the market for a 250pvr,
and Im assuming from your comments - it would be well worth the
purchase?
This thing is till transcoding the movie - I had the audio pushed
down to '3' - would that be what is causing this thing to still be
churning 10hrs later? Other than that - it is set to mpeg/8000 bit rate,
hq and the mvr or something...
I think I will stop using the encoding feature...

Tahnks again,
Curtis

On Sun, 2003-12-14 at 14:23, James L. Paul wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> On Sunday 14 December 2003 09:54, Curtis Wood wrote:
> > Is there anyway to speed up the process of transcoding, currently it
> > is taking hours to transcode. a 2hr movie transcoded to the highest
> > format is taking from 4-6+ hours to finish. Im running the backend and
> > frontend on the same machine, while it is transcoding I can't record -
> > let alone transcode another recording (other wise the frontent locks
> > up)... I realize that this may be a CPU intensive task (which it is,
> > jumps the load up to 3.0-5.0) - but it doesnt seem to make a difference
> > (in time) whether anything else is running or not, as in watching live
> > tv...
>
> The transcoding is indeed CPU-bound. The compression ratio affects transcoding
> time somewhat, but in general you aren't going to dramatically reduce your
> transcoding time without a lot more CPU. Your processor is crunching as fast
> as it can, end of story. You can only make it faster by asking it to do less,
> and that involves significant tradeoffs when if comes to compressing video in
> software on a general purpose CPU.
>
> What I'd love to see is a way to use hardware encoders like the PVR-250 for
> transcoding, and even then we would have the overhead of software decoding to
> feed the encoder for transcoding. Ahh well. :)
>
> I don't do a lot of transcoding with mythtranscode, but I assume there's a bug
> that prevents you from transcoding in the background while recording. There's
> no inherent reason I'm aware of that should cause this problem. The
> transcoding threads should be the lowest priority, so sorry to hear you are
> having lockups. Perhaps fixing that problem will make living with transcoding
> easier.
>
> Myself, I chose to avoid transcoding as much as possible. The PVR-250 cards
> really take burden off the CPU and I can avoid encoding by recording directly
> to a format that is very versatile. I know that may not apply to your
> situation, but the cost of the cards was way lower for me than the cost of my
> time in working around the issues of not having hardware encoding. :)
>
> My advice: try to reduce your need to transcode for common use. If that's not
> an option, add more or faster CPU. At the very least try to solve your lockup
> issue so that transcoding does not interfere with normal recording. And good
> luck!
>
> > Im running everything on a P4 2.4 ghz, 256mg ram (could be an issue),
> > all on top of GenToo... Im still on 0.12, waiting for the transcoding to
> > finish so I can compile 0.13 - its been processing since 7:30 this
> > morning (roughly 7hrs)...
> >
> > TIA,
> > Curtis
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.2.1 (GNU/Linux)
>
> iD8DBQE/3Ma6T8BYaKRUpkQRAr/4AKCco0tAReh6pmj+mwc25Ok1+ijPXQCeIxwX
> nkoEZmsmsHdd9igsFLyuKUI=
> =d938
> -----END PGP SIGNATURE-----
>
>
> _______________________________________________
> mythtv-users mailing list
> mythtv-users [at] mythtv
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>
>


spin at avalon

Dec 18, 2003, 9:52 PM

Post #4 of 5 (966 views)
Permalink
Re: Transcoding overhead, could use some advice... [In reply to]

On Sun, Dec 14, 2003 at 04:22:52PM -0600, Curtis Wood wrote:
> Thanks, the lockups are simply because the load gets way to high -
> the last time I was recording like 3 movies over night I came in the
> morning and the load was like at 8.50! I am in the market for a 250pvr,
> and Im assuming from your comments - it would be well worth the
> purchase?
> This thing is till transcoding the movie - I had the audio pushed
> down to '3' - would that be what is causing this thing to still be
> churning 10hrs later? Other than that - it is set to mpeg/8000 bit rate,
> hq and the mvr or something...
> I think I will stop using the encoding feature...
>
> Tahnks again,
> Curtis
>
I don't see how/why your load average would be 8.5 while transcoding.
Transcoding is a pretty linear process, as is recording a show. Assuming
you are using software encoding, I would think your load average would be
about 2 while doing both at the same time, maybe above that for live TV.

Are you sure there isn't something else going on on your system?

Aran


tony at maro

Dec 18, 2003, 11:46 PM

Post #5 of 5 (963 views)
Permalink
RE: Transcoding overhead, could use some advice... [In reply to]

> -----Original Message-----
>
> On Sun, Dec 14, 2003 at 04:22:52PM -0600, Curtis Wood wrote:
> > Thanks, the lockups are simply because the load gets way
> to high -

I think this is part of my problem as well.

> > the last time I was recording like 3 movies over night I
> came in the
> > morning and the load was like at 8.50! I am in the market for a
> > 250pvr, and Im assuming from your comments - it would be well worth
> > the purchase?

> I don't see how/why your load average would be 8.5 while
> transcoding.
> Transcoding is a pretty linear process, as is recording a
> show. Assuming you are using software encoding, I would think
> your load average would be about 2 while doing both at the
> same time, maybe above that for live TV.
>
> Are you sure there isn't something else going on on your system?
>

I have the same problem, and it's a dedicated Myth box. When
transcoding one show on my 1800+ my CPU usage jumps to 100% and my load
average is hitting around 4. That's without also trying to watch TV,
etc. My lirc becomes unresponsive, requiring multiple pushes because it
can't get enough processor to interpret the IR.

I've checked and the nice level is set all the way on the transcode
threads...

If I watch live TV while transcoding I'm guaranteed to lock up within 5
minutes. The transcode and backend still work fine, but the frontend
freezes. Sometimes I do have to restart the backend after this,
however, or else the frontend will only play a minute or so before it
freezes again.

Unfortunately I'm beginning to think I'm going to have to pull my MythTV
box out of the entertainment center. It's pretty much useless at this
point, considering how often I'm having to go to a different workstation
to kill the frontend processes. My wife and kids just can't do that...
And there's no keyboard on the myth box. Just when I think I've got it
fixed, I get 10 or so lockups in an hour.

Also, transcodes from the RTjpeg to MPEG without changing resolution
seem to take about 3 hours for every 1 hour of show...

Do the 250PVR's work on VIA KT266A + VT8235 chipsets? I've seen many
warnings about VIA with ittv and dunno if this is the 250's or not.

-Tony

MythTV users RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.