Mailing List Archive: MythTV: Users

mythweb: slow results from mythweb/tv/recorded page

Index | Next | Previous | View Threaded

mrlinuxgroups at gmail

Sep 27, 2006, 4:11 PM

Post #1 of 9 (1292 views)
Permalink

mythweb: slow results from mythweb/tv/recorded page

The query:
http://web-server/mythweb/tv/recorded
takes over 3 minutes to complete with my 75 shows.

I have my own custom query that returns title, time, subtitle, etc info on the
same 75 shows and the query completes in .5 seconds.

3 minutes -vs- .5 seconds.

I know that it's returning more data... but it sure does seem slow....

Has anyone else experienced this?

you can use
time wget -O /tmp/erase.me http://server-name/mythweb/tv/recorded
to time how long the query takes.

jack
_______________________________________________
mythtv-users mailing list
mythtv-users[at]mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

lists at forevermore

Sep 27, 2006, 4:17 PM

Post #2 of 9 (1259 views)
Permalink

Re: mythweb: slow results from mythweb/tv/recorded page [In reply to]

jack snodgrass wrote:
> The query:
> http://web-server/mythweb/tv/recorded
> takes over 3 minutes to complete with my 75 shows.

What version of mythweb?

> I have my own custom query that returns title, time, subtitle, etc info on the
> same 75 shows and the query completes in .5 seconds.

It's a lot of queries, and a handful of checks against the requested
recording schedules (talking to the backend, etc).

mythweb version will make a huge difference, though. We made some huge
speed improvements in .20

-Chris

Attachments:

signature.asc (0.18 KB)

mrlinuxgroups at gmail

Sep 27, 2006, 4:28 PM

Post #3 of 9 (1272 views)
Permalink

Re: mythweb: slow results from mythweb/tv/recorded page [In reply to]

On 9/27/06, Chris Petersen <lists[at]forevermore.net> wrote:
> jack snodgrass wrote:
> > The query:
> > http://web-server/mythweb/tv/recorded
> > takes over 3 minutes to complete with my 75 shows.
>
> What version of mythweb?
>
> > I have my own custom query that returns title, time, subtitle, etc info on the
> > same 75 shows and the query completes in .5 seconds.
>
> It's a lot of queries, and a handful of checks against the requested
> recording schedules (talking to the backend, etc).
>
> mythweb version will make a huge difference, though. We made some huge
> speed improvements in .20
>
> -Chris

sorry.... I just assume that everyone is running from a semi-recent svn
version. ;) It's been slow like this for as long as I remember. I'm running
from a week-old svn ( after .20 was released ) version.

tv listings and upcomming recordings take .7 and .8 seconds to
complete. Everything is generally speedy ( the backend with the
mysql server / web server is a 3800+ x2 amd64 with 2gig of memory
and the front end is a 4600+ x2 amd64 with 2gig of memory ) execept
for the recorded shows... I definitly notice .7 secons -vs- 3 minutes.
When I want to see what's been recorded, I have to go get coffee.

both the frontend and backend are up-to-date Fedora FC5 installations.
mysql was installed from the RPMs.

I do notice messages on the backend.... when I run this web page....

2006-09-27 18:27:36.465 Preview Error: Previewer could not open file:
'file not found'
2006-09-27 18:27:36.465 MainServer: Failed to make preview image.
2006-09-27 18:27:36.467 MainServer::HandleAnnounce FileTransfer
2006-09-27 18:27:36.472 adding: websrvr as a remote file transfer
2006-09-27 18:27:42.976 RingBuf(/mnt/store//file not found.png): Could
not open /mnt/store//file not found.png.
2006-09-27 18:27:42.985 MainServer::HandlePixmapLastModified() -
Couldn't find backend for: : " "
2006-09-27 18:27:42.986 MainServer::HandleGenPreviewPixmap()
Couldn't find backend for:
: " "
2006-09-27 18:27:43.488 RingBuf(file not found): Could not open file not found.
[root[at]fw logs]# tail mythbackend.log -n100
2006-09-27 18:26:34.247 RingBuf(file not found): Could not open file not found.
2006-09-27 18:26:34.252 Preview Error: Previewer could not open file:
'file not found'
2006-09-27 18:26:34.252 MainServer: Failed to make preview image.
2006-09-27 18:26:34.254 MainServer::HandleAnnounce FileTransfer
2006-09-27 18:26:34.254 adding: websrvr as a remote file transfer
2006-09-27 18:26:40.755 RingBuf(/mnt/store//file not found.png): Could
not open /mnt/store//file not found.png.
2006-09-27 18:26:40.758 MainServer::HandlePixmapLastModified() -
Couldn't find backend for: : " "
2006-09-27 18:26:40.759 MythSocket(67c1b0:-1): writeStringList: Error,
socket went unconnected.
2006-09-27 18:26:40.761 MainServer::HandleGenPreviewPixmap()
Couldn't find backend for:
: " "
2006-09-27 18:26:41.271 RingBuf(file not found): Could not open file not found.
2006-09-27 18:26:41.272 Preview Error: Previewer could not open file:
'file not found'
2006-09-27 18:26:41.272 MainServer: Failed to make preview image.
2006-09-27 18:26:41.274 MainServer::HandleAnnounce FileTransfer
2006-09-27 18:26:41.275 adding: websrvr as a remote file transfer
2006-09-27 18:26:47.783 RingBuf(/mnt/store//file not found.png): Could
not open /mnt/store//file not found.png.
2006-09-27 18:26:47.791 MainServer::HandlePixmapLastModified() -
Couldn't find backend for: : " "
2006-09-27 18:26:47.792 MainServer::HandleGenPreviewPixmap()
Couldn't find backend for:
: " "

besides the slowness... I don't see any issues / errors when I look at the
recorded listings.....

jack
_______________________________________________
mythtv-users mailing list
mythtv-users[at]mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

mtdean at thirdcontact

Sep 27, 2006, 5:31 PM

Post #4 of 9 (1265 views)
Permalink

Re: mythweb: slow results from mythweb/tv/recorded page [In reply to]

On 09/27/06 19:28, jack snodgrass wrote:

>On 9/27/06, Chris Petersen <lists[at]forevermore.net> wrote:
>
>
>>jack snodgrass wrote:
>>
>>
>>>The query:
>>>http://web-server/mythweb/tv/recorded
>>>takes over 3 minutes to complete with my 75 shows.
>>>
>>>
>>What version of mythweb?
>>
>>>I have my own custom query that returns title, time, subtitle, etc info on the
>>>same 75 shows and the query completes in .5 seconds.
>>>
>>>
>>It's a lot of queries, and a handful of checks against the requested
>>recording schedules (talking to the backend, etc).
>>
>>mythweb version will make a huge difference, though. We made some huge
>>speed improvements in .20
>>
>sorry.... I just assume that everyone is running from a semi-recent svn
>version. ;) It's been slow like this for as long as I remember. I'm running
>from a week-old svn ( after .20 was released ) version.
>
>
...

>I do notice messages on the backend.... when I run this web page....
>
>2006-09-27 18:27:36.465 Preview Error: Previewer could not open file:
>'file not found'
>2006-09-27 18:27:36.465 MainServer: Failed to make preview image.
>
>
That's what's causing the slowness. Fix it and you'll be happy with
MythWeb.

Mike
_______________________________________________
mythtv-users mailing list
mythtv-users[at]mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

mrlinuxgroups at gmail

Sep 27, 2006, 6:40 PM

Post #5 of 9 (1261 views)
Permalink

Re: mythweb: slow results from mythweb/tv/recorded page [In reply to]

On 9/27/06, Michael T. Dean <mtdean[at]thirdcontact.com> wrote:
> On 09/27/06 19:28, jack snodgrass wrote:
>
> >On 9/27/06, Chris Petersen <lists[at]forevermore.net> wrote:
> >
> >
> >>jack snodgrass wrote:
> >>
> >>
> >>>The query:
> >>>http://web-server/mythweb/tv/recorded
> >>>takes over 3 minutes to complete with my 75 shows.
> >>>
> >>>
> >>What version of mythweb?
> >>
> >>>I have my own custom query that returns title, time, subtitle, etc info on the
> >>>same 75 shows and the query completes in .5 seconds.
> >>>
> >>>
> >>It's a lot of queries, and a handful of checks against the requested
> >>recording schedules (talking to the backend, etc).
> >>
> >>mythweb version will make a huge difference, though. We made some huge
> >>speed improvements in .20
> >>
> >sorry.... I just assume that everyone is running from a semi-recent svn
> >version. ;) It's been slow like this for as long as I remember. I'm running
> >from a week-old svn ( after .20 was released ) version.
> >
> >
> ...
>
> >I do notice messages on the backend.... when I run this web page....
> >
> >2006-09-27 18:27:36.465 Preview Error: Previewer could not open file:
> >'file not found'
> >2006-09-27 18:27:36.465 MainServer: Failed to make preview image.
> >
> >
> That's what's causing the slowness. Fix it and you'll be happy with
> MythWeb.
>
> Mike
> _______________________________________________

ok. I cleaned up some issues, duplicated some bad .png files and things
are loading faster now... 2 seconds -vs- 3 minutes...

jack
_______________________________________________
mythtv-users mailing list
mythtv-users[at]mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

mythtv2006 at bdam

Sep 28, 2006, 4:50 AM

Post #6 of 9 (1243 views)
Permalink

Re: mythweb: slow results from mythweb/tv/recorded page [In reply to]

On 9/28/06, jack snodgrass <mrlinuxgroups[at]gmail.com> wrote:

> ok. I cleaned up some issues, duplicated some bad .png files and things
> are loading faster now... 2 seconds -vs- 3 minutes...

http://host/tv/recorded is also rather slow for me. It also takes
minutes to go load 150 files, but the error messages are not so
obvious for me:

2006-09-28 13:41:57.362 MainServer::HandleAnnounce FileTransfer
2006-09-28 13:41:57.375 adding: maxi as a remote file transfer
2006-09-28 13:41:57.389 MainServer::HandlePixmapLastModified() -
Couldn't find backend for: : " "
2006-09-28 13:41:57.404 MainServer::HandleGenPreviewPixmap()
Couldn't find backend for:
: " "

or

2006-09-28 13:41:43.946 MainServer::HandleAnnounce FileTransfer
2006-09-28 13:41:43.957 adding: maxi as a remote file transfer
2006-09-28 13:41:43.971 MainServer::HandlePixmapLastModified() -
Couldn't find backend for: : " "
2006-09-28 13:41:43.982 MainServer::HandleGenPreviewPixmap()
Couldn't find backend for:
: " "
[mpegts @ 0xb736ed40]Parser not found for Codec Id: 94211 !
0: start_time: 3701.576 duration: 170.046
1: start_time: 3701.529 duration: 170.042
2: start_time: 3701.529 duration: 170.042
stream: start_time: 41128.099 duration: 1889.922 bitrate=3489 kb/s
2006-09-28 13:41:44.079 AFD: Opened codec 0x8215800, id(MPEG2VIDEO) type(Video)
2006-09-28 13:41:44.089 AFD: Opened codec 0x825d210, id(MP3) type(Audio)
2006-09-28 13:41:44.104 NVP: Recording does not have position map.
Run 'mythcommflag --file
9_2005-10-02_14-33.mpg --rebuild' to fix
2006-09-28 13:41:44.333 MainServer::HandleAnnounce FileTransfer
2006-09-28 13:41:44.347 adding: maxi as a remote file transfer
2006-09-28 13:41:44.352 MainServer::HandlePixmapLastModified() -
Couldn't find backend for: : " "
2006-09-28 13:41:44.355 MainServer::HandleGenPreviewPixmap()
Couldn't find backend for:
: " "
[mpegts @ 0xb736ed40]Parser not found for Codec Id: 94211 !
0: start_time: 3832.249 duration: 248.090
1: start_time: 3832.308 duration: 248.076
2: start_time: 3832.251 duration: 248.093
3: start_time: 3832.251 duration: 248.083
stream: start_time: 42580.541 duration: 2757.061 bitrate=3091 kb/s

or for example:

2006-09-28 13:41:45.995 MainServer::HandleGenPreviewPixmap()
Couldn't find backend for:
: " "
2006-09-28 13:41:45.997 MythSocket(8241ed0:-1): writeStringList:
Error, socket went unconnected.
[mpegts @ 0xb736ed40]Parser not found for Codec Id: 94211 !

What's wrong with my files?
Adam
_______________________________________________
mythtv-users mailing list
mythtv-users[at]mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

mrlinuxgroups at gmail

Sep 28, 2006, 5:16 AM

Post #7 of 9 (1259 views)
Permalink

Re: mythweb: slow results from mythweb/tv/recorded page [In reply to]

On 9/28/06, Adam Egger <mythtv2006[at]bdam.de> wrote:
> On 9/28/06, jack snodgrass <mrlinuxgroups[at]gmail.com> wrote:
>
> > ok. I cleaned up some issues, duplicated some bad .png files and things
> > are loading faster now... 2 seconds -vs- 3 minutes...
>
> http://host/tv/recorded is also rather slow for me. It also takes
> minutes to go load 150 files, but the error messages are not so
> obvious for me:
>
> 2006-09-28 13:41:57.362 MainServer::HandleAnnounce FileTransfer
> 2006-09-28 13:41:57.375 adding: maxi as a remote file transfer
> 2006-09-28 13:41:57.389 MainServer::HandlePixmapLastModified() -
> Couldn't find backend for: : " "
> 2006-09-28 13:41:57.404 MainServer::HandleGenPreviewPixmap()
> Couldn't find backend for:
> : " "
>
> or
>
> 2006-09-28 13:41:43.946 MainServer::HandleAnnounce FileTransfer
> 2006-09-28 13:41:43.957 adding: maxi as a remote file transfer
> 2006-09-28 13:41:43.971 MainServer::HandlePixmapLastModified() -
> Couldn't find backend for: : " "
> 2006-09-28 13:41:43.982 MainServer::HandleGenPreviewPixmap()
> Couldn't find backend for:
> : " "
> [mpegts @ 0xb736ed40]Parser not found for Codec Id: 94211 !
> 0: start_time: 3701.576 duration: 170.046
> 1: start_time: 3701.529 duration: 170.042
> 2: start_time: 3701.529 duration: 170.042
> stream: start_time: 41128.099 duration: 1889.922 bitrate=3489 kb/s
> 2006-09-28 13:41:44.079 AFD: Opened codec 0x8215800, id(MPEG2VIDEO) type(Video)
> 2006-09-28 13:41:44.089 AFD: Opened codec 0x825d210, id(MP3) type(Audio)
> 2006-09-28 13:41:44.104 NVP: Recording does not have position map.
> Run 'mythcommflag --file
> 9_2005-10-02_14-33.mpg --rebuild' to fix
> 2006-09-28 13:41:44.333 MainServer::HandleAnnounce FileTransfer
> 2006-09-28 13:41:44.347 adding: maxi as a remote file transfer
> 2006-09-28 13:41:44.352 MainServer::HandlePixmapLastModified() -
> Couldn't find backend for: : " "
> 2006-09-28 13:41:44.355 MainServer::HandleGenPreviewPixmap()
> Couldn't find backend for:
> : " "
> [mpegts @ 0xb736ed40]Parser not found for Codec Id: 94211 !
> 0: start_time: 3832.249 duration: 248.090
> 1: start_time: 3832.308 duration: 248.076
> 2: start_time: 3832.251 duration: 248.093
> 3: start_time: 3832.251 duration: 248.083
> stream: start_time: 42580.541 duration: 2757.061 bitrate=3091 kb/s
>
> or for example:
>
> 2006-09-28 13:41:45.995 MainServer::HandleGenPreviewPixmap()
> Couldn't find backend for:
> : " "
> 2006-09-28 13:41:45.997 MythSocket(8241ed0:-1): writeStringList:
> Error, socket went unconnected.
> [mpegts @ 0xb736ed40]Parser not found for Codec Id: 94211 !
>
> What's wrong with my files?
> Adam
> _______________________________________________

I got a ton of those:
Couldn't find backend for:
: " "
messages. I did a myth.rebuilddatabase.pl and added in some
shows that had been deleted from the database in the past. It
kind of worked, but I think it screwed up some fields in the
database that caused some of the slowness. I had about 20
entries with NULL in the recordid field. I deleted all of those
entries from the database and that got rid of the
Couldn't find backend for:
: " "
I still had a few errors but it listed .png files. I replaced those with
working .png files and that got me down to 2 seconds.

jack
_______________________________________________
mythtv-users mailing list
mythtv-users[at]mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

mythtv2006 at bdam

Sep 28, 2006, 5:33 AM

Post #8 of 9 (1258 views)
Permalink

Re: mythweb: slow results from mythweb/tv/recorded page [In reply to]

On 9/28/06, jack snodgrass <mrlinuxgroups[at]gmail.com> wrote:

> I got a ton of those:
> Couldn't find backend for:
> : " "
> messages. I did a myth.rebuilddatabase.pl and added in some
> shows that had been deleted from the database in the past. It
> kind of worked, but I think it screwed up some fields in the
> database that caused some of the slowness. I had about 20
> entries with NULL in the recordid field. I deleted all of those
> entries from the database and that got rid of the

Wow thanks, I also see about 40 entries with NULL in the recordid
field. But I think it's not a good idea to remove the entries since
all the files still exist (check the basename).

So how can I fix the entries with NULL in the recordid field?
_______________________________________________
mythtv-users mailing list
mythtv-users[at]mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

mrlinuxgroups at gmail

Sep 28, 2006, 6:21 AM

Post #9 of 9 (1252 views)
Permalink

Re: mythweb: slow results from mythweb/tv/recorded page [In reply to]

On 9/28/06, Adam Egger <mythtv2006[at]bdam.de> wrote:
> On 9/28/06, jack snodgrass <mrlinuxgroups[at]gmail.com> wrote:
>
> > I got a ton of those:
> > Couldn't find backend for:
> > : " "
> > messages. I did a myth.rebuilddatabase.pl and added in some
> > shows that had been deleted from the database in the past. It
> > kind of worked, but I think it screwed up some fields in the
> > database that caused some of the slowness. I had about 20
> > entries with NULL in the recordid field. I deleted all of those
> > entries from the database and that got rid of the
>
> Wow thanks, I also see about 40 entries with NULL in the recordid
> field. But I think it's not a good idea to remove the entries since
> all the files still exist (check the basename).
>
> So how can I fix the entries with NULL in the recordid field?
> _______________________________________________

I don't know....
you could mysqldump your db and make a copy, then
remove the entries and see if that IS the fix ... see if it
speeds up the query.

I might look at this more and file a bug report.... not a bug on how
the entries got like that, but a bug that mythtv does not handle the
data correctly. It might be a simple additon to the query...
where 'recordid is not NULL'.

jack
_______________________________________________
mythtv-users mailing list
mythtv-users[at]mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact lists@gossamer-threads.com