Mailing List Archive: MythTV: Mythtvnz

tv_grab_nz-py fails to validate

Index | Next | Previous | View Threaded

maillists.mythtv at gmail

Jul 21, 2010, 2:44 PM

Post #1 of 13 (1033 views)
Permalink

tv_grab_nz-py fails to validate

Hello.

I'm trying to get program guide data for a freeview dvb-t setup.

I have the latest tv_grab_nz-py grabber from:
http://nice.net.nz/scripts/tv_grab_nz-py

with the following version info:
# Last updated 2010-03-14
VERSION = '0.2.6'

Unfortunately it fails to validate as shown below. Any advice on what's wrong?

Thanks.

mythtv [at] neo:~$ which tv_grab_nz-py
/usr/local/bin/tv_grab_nz-py

mythtv [at] neo:~$ tv_validate_grabber --keep-files tv_grab_nz-py
INFO - Downloading data from nzepg.org...
INFO - Done
INFO - Parsing channel data...
INFO - Done (22 channels)

Please select the channels you wish to use for
this source by pressing y or n when prompted:

Use channel TV One (tv1.freeviewnz.tv)? [y/N]y
[I said NO to the rest]
/tmp/BJcrfJyjzK/t_1_2.xml validates ok
tv_sort failed on /tmp/BJcrfJyjzK/t_1_2.xml, probably because of
strange start or stop times. See /tmp/BJcrfJyjzK/t_1_2.sort.log
tv_sort failed on the concatenated data. Probably due to overlapping
data between days. See /tmp/BJcrfJyjzK/t_7.log
The data is not additive. See /tmp/BJcrfJyjzK/t__1_2.diff
Grabber did not validate ok. See /tmp/BJcrfJyjzK/t_commands.log for a
list of the commands that were used
Saving output files in /tmp/BJcrfJyjzK
2 errors found.

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

hads at nice

Jul 21, 2010, 3:02 PM

Post #2 of 13 (993 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, 2010-07-22 at 09:44 +1200, Bob . wrote:
> Hello.
>
> I'm trying to get program guide data for a freeview dvb-t setup.
>
> I have the latest tv_grab_nz-py grabber from:
> http://nice.net.nz/scripts/tv_grab_nz-py
>
> with the following version info:
> # Last updated 2010-03-14
> VERSION = '0.2.6'
>
> Unfortunately it fails to validate as shown below. Any advice on what's wrong?

The XMLTV data doesn't appear to be completely valid. Although this is
sub-optimal it's not the end of the world.

hads
--
http://nicegear.co.nz
New Zealand's Open Source Hardware Supplier

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

nick.rout at gmail

Jul 21, 2010, 3:24 PM

Post #3 of 13 (994 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, Jul 22, 2010 at 9:44 AM, Bob . <maillists.mythtv [at] gmail> wrote:
> Hello.
>
> I'm trying to get program guide data for a freeview dvb-t setup.
>
> I have the latest tv_grab_nz-py grabber from:
> http://nice.net.nz/scripts/tv_grab_nz-py
>
> with the following version info:
> # Last updated 2010-03-14
> VERSION = '0.2.6'
>
> Unfortunately it fails to validate as shown below. Any advice on what's wrong?
>
> Thanks.
>
>
> mythtv [at] neo:~$ which tv_grab_nz-py
> /usr/local/bin/tv_grab_nz-py
>
> mythtv [at] neo:~$ tv_validate_grabber --keep-files tv_grab_nz-py
> INFO - Downloading data from nzepg.org...
> INFO - Done
> INFO - Parsing channel data...
> INFO - Done (22 channels)
>
> Please select the channels you wish to use for
> this source by pressing y or n when prompted:
>
>
> Use channel TV One (tv1.freeviewnz.tv)? [y/N]y
> [I said NO to the rest]
> /tmp/BJcrfJyjzK/t_1_2.xml validates ok
> tv_sort failed on /tmp/BJcrfJyjzK/t_1_2.xml, probably because of
> strange start or stop times. See /tmp/BJcrfJyjzK/t_1_2.sort.log
> tv_sort failed on the concatenated data. Probably due to overlapping
> data between days. See /tmp/BJcrfJyjzK/t_7.log
> The data is not additive. See /tmp/BJcrfJyjzK/t__1_2.diff
> Grabber did not validate ok. See /tmp/BJcrfJyjzK/t_commands.log for a
> list of the commands that were used
> Saving output files in /tmp/BJcrfJyjzK
> 2 errors found.

I have never run tv_validate_grabber and mine works fine. Simply
specify the grabber in mythtv-setup.

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

maillists.mythtv at gmail

Jul 21, 2010, 4:37 PM

Post #4 of 13 (985 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, Jul 22, 2010 at 10:24 AM, Nick Rout <nick.rout [at] gmail> wrote:
> I have never run tv_validate_grabber and mine works fine. Simply
> specify the grabber in mythtv-setup.

I have attempted to.

When I run mythtv-setup the only options I have under "Listings Grabber" are:
Transmitted guide only (EIT)
No grabber
North America (SchedulesDirect.org) (Internal)

I'm assuming the nz grabber should appear in there?

The grabber appears to be found:
mythtv [at] neo:~$ tv_find_grabbers
/usr/local/bin/tv_grab_nz-py|New Zealand (py)
[and others]

which is why I suspected the validation failure was the problem. If
not, any ideas what is the problem?

Ta.

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

nick.rout at gmail

Jul 21, 2010, 5:32 PM

Post #5 of 13 (991 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, Jul 22, 2010 at 11:37 AM, Bob . <maillists.mythtv [at] gmail> wrote:
> On Thu, Jul 22, 2010 at 10:24 AM, Nick Rout <nick.rout [at] gmail> wrote:
>> I have never run tv_validate_grabber and mine works fine. Simply
>> specify the grabber in mythtv-setup.
>
> I have attempted to.
>
> When I run mythtv-setup the only options I have under "Listings Grabber" are:
> Transmitted guide only (EIT)
> No grabber
> North America (SchedulesDirect.org) (Internal)
>
> I'm assuming the nz grabber should appear in there?

It should, but will only show up if you have xmltv installed. Do you?
(the validate script is part of xmltv-utils, not xmltv)

>
> The grabber appears to be found:
> mythtv [at] neo:~$ tv_find_grabbers
> /usr/local/bin/tv_grab_nz-py|New Zealand (py)
> [and others]
>
> which is why I suspected the validation failure was the problem. If
> not, any ideas what is the problem?
>
> Ta.
>
> _______________________________________________
> mythtvnz mailing list
> mythtvnz [at] lists
> http://lists.ourshack.com/mailman/listinfo/mythtvnz
> Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/
>

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

maillists.mythtv at gmail

Jul 21, 2010, 6:52 PM

Post #6 of 13 (984 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, Jul 22, 2010 at 12:32 PM, Nick Rout <nick.rout [at] gmail> wrote:
> On Thu, Jul 22, 2010 at 11:37 AM, Bob . <maillists.mythtv [at] gmail> wrote:
>> On Thu, Jul 22, 2010 at 10:24 AM, Nick Rout <nick.rout [at] gmail> wrote:
>>> I have never run tv_validate_grabber and mine works fine. Simply
>>> specify the grabber in mythtv-setup.
>>
>> I have attempted to.
>>
>> When I run mythtv-setup the only options I have under "Listings Grabber" are:
>> Transmitted guide only (EIT)
>> No grabber
>> North America (SchedulesDirect.org) (Internal)
>>
>> I'm assuming the nz grabber should appear in there?
>
> It should, but will only show up if you have xmltv installed. Do you?
> (the validate script is part of xmltv-utils, not xmltv)

Yep.

Running an ubuntu system:

xmltv 0.5.56-1
xmltv-util 0.5.56-1
mythtv 0.23.0+fixes25328-0ubuntu0+mythbuntu2

Does myth need to be configured in some manner to recognise the
presence of xmltv or does it find it automatically?

Ta.

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

hads at nice

Jul 21, 2010, 7:08 PM

Post #7 of 13 (989 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, 2010-07-22 at 13:52 +1200, Bob . wrote:
> Does myth need to be configured in some manner to recognise the
> presence of xmltv or does it find it automatically?

It doesn't.

Run; `sudo -iu mythtv` then try running tv_grab_nz-py and see what
happens.

--
http://nicegear.co.nz
New Zealand's Open Source Hardware Supplier

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

maillists.mythtv at gmail

Jul 21, 2010, 8:52 PM

Post #8 of 13 (980 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, Jul 22, 2010 at 2:08 PM, Hadley Rich <hads [at] nice> wrote:
> On Thu, 2010-07-22 at 13:52 +1200, Bob . wrote:
>> Does myth need to be configured in some manner to recognise the
>> presence of xmltv or does it find it automatically?
>
> It doesn't.
>
> Run; `sudo -iu mythtv` then try running tv_grab_nz-py and see what
> happens.

Runs fine as far as I can tell...

mythtv [at] neo:~$ tv_grab_nz-py
INFO - Downloading data from nzepg.org...
INFO - Done
INFO - Parsing listings...
<tv date="20100722125202 +1200"
generator-info-name="epgsnoop-grabber"><channel
id="tv1.freeviewnz.tv">
<display-name>TV One</display-name>
<icon
src="http://www.freeviewnz.tv/images/uploads/tv_one.jpg" />
</channel>
<channel id="tv2.freeviewnz.tv">
<display-name>TV2</display-name>
<icon src="http://www.freeviewnz.tv/images/uploads/tv_2.jpg" />
</channel>
[snip]
<programme channel="tv1.freeviewnz.tv" start="20100728053000
+1200" stop="20100728053500 +1200">
<title>World Business Report</title>
<desc>The latest business news with informed analysis
from the world's financial centres.</desc>
<category>tvshow</category>
<category>News</category>
</programme>
</tv>

mythtv [at] neo:~$ echo $?
0

Hmmmm, looks like mythtv-setup is timing out before tv_find_grabbers
completes hence doesn't present any of them as an option. Running on
an Acer Revo and the poor little fella is just too slow. I got rid of
all the other grabbers in /usr/bin and I can now select the NZ grabber
in mythtv-setup.

Is there any way to configure it to ignore some grabbers (rather than
deleting stuff willy-nilly from /usr/bin)?

Unfortunately I'm still not getting guide data into myth successfully
but I'll start another thread if necessary.

Thanks for the help.

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

nick.rout at gmail

Jul 21, 2010, 9:11 PM

Post #9 of 13 (977 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, Jul 22, 2010 at 3:52 PM, Bob . <maillists.mythtv [at] gmail> wrote:
> On Thu, Jul 22, 2010 at 2:08 PM, Hadley Rich <hads [at] nice> wrote:
>> On Thu, 2010-07-22 at 13:52 +1200, Bob . wrote:
>>> Does myth need to be configured in some manner to recognise the
>>> presence of xmltv or does it find it automatically?
>>
>> It doesn't.
>>
>> Run; `sudo -iu mythtv` then try running tv_grab_nz-py and see what
>> happens.
>
> Runs fine as far as I can tell...
>
> mythtv [at] neo:~$ tv_grab_nz-py
> INFO - Downloading data from nzepg.org...
> INFO - Done
> INFO - Parsing listings...
> <tv date="20100722125202 +1200"
> generator-info-name="epgsnoop-grabber"><channel
> id="tv1.freeviewnz.tv">
> <display-name>TV One</display-name>
> <icon
> src="http://www.freeviewnz.tv/images/uploads/tv_one.jpg" />
> </channel>
> <channel id="tv2.freeviewnz.tv">
> <display-name>TV2</display-name>
> <icon src="http://www.freeviewnz.tv/images/uploads/tv_2.jpg" />
> </channel>
> [snip]
> <programme channel="tv1.freeviewnz.tv" start="20100728053000
> +1200" stop="20100728053500 +1200">
> <title>World Business Report</title>
> <desc>The latest business news with informed analysis
> from the world's financial centres.</desc>
> <category>tvshow</category>
> <category>News</category>
> </programme>
> </tv>
>
> mythtv [at] neo:~$ echo $?
> 0
>
>
> Hmmmm, looks like mythtv-setup is timing out before tv_find_grabbers
> completes hence doesn't present any of them as an option. Running on
> an Acer Revo and the poor little fella is just too slow. I got rid of
> all the other grabbers in /usr/bin and I can now select the NZ grabber
> in mythtv-setup.
>
> Is there any way to configure it to ignore some grabbers (rather than
> deleting stuff willy-nilly from /usr/bin)?

I remember having to do that now! I don't think there is another way
to do it, unless you change the timeout in the source code and
recompile.

>
> Unfortunately I'm still not getting guide data into myth successfully
> but I'll start another thread if necessary.
>

Take a look in mythweb at Setup (the spanner and key icon at the top)
then TV then Channel Info.

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

maillists.mythtv at gmail

Jul 21, 2010, 10:23 PM

Post #10 of 13 (978 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, Jul 22, 2010 at 4:11 PM, Nick Rout <nick.rout [at] gmail> wrote:
> On Thu, Jul 22, 2010 at 3:52 PM, Bob . <maillists.mythtv [at] gmail> wrote:
>>
>> Unfortunately I'm still not getting guide data into myth successfully
>> but I'll start another thread if necessary.
>>
>
> Take a look in mythweb at Setup (the spanner and key icon at the top)
> then TV then Channel Info.

For the record:
mythfilldatabase was looking for ~/.mythtv/nzepg.org.xmltv (nzepg.org
was what I named my video source) and the configuring of the grabber
in mythtv-setup doesn't seem to write any file at all so:
$ tv_grab_nz-py --config --config-file=~/.mythtv/nzepg.org.xmltv
helped.

Then I did a full scan of channels then used the channel editor to set
the appropriate xmltv ids (eg tv1.freeviewnz.tv,
base-fm.freeviewnz.tv, etc) onto each of the channels.

Then mythfilldatabase got the guide data in there. All sorted.

Thanks for the help.

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

stevehodge at gmail

Jul 21, 2010, 11:12 PM

Post #11 of 13 (979 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, Jul 22, 2010 at 4:11 PM, Nick Rout <nick.rout [at] gmail> wrote:

> On Thu, Jul 22, 2010 at 3:52 PM, Bob . <maillists.mythtv [at] gmail> wrote:
> > Hmmmm, looks like mythtv-setup is timing out before tv_find_grabbers
> > completes hence doesn't present any of them as an option. Running on
> > an Acer Revo and the poor little fella is just too slow. I got rid of
> > all the other grabbers in /usr/bin and I can now select the NZ grabber
> > in mythtv-setup.
> >
> > Is there any way to configure it to ignore some grabbers (rather than
> > deleting stuff willy-nilly from /usr/bin)?
>
> I remember having to do that now! I don't think there is another way
> to do it, unless you change the timeout in the source code and
> recompile.
>

Couldn't you also modify tv_find_grabbers (which is probably a script and
therefore a lot easier than messing with the mythtv source)?

Cheers,
Steve

>

nick.rout at gmail

Jul 21, 2010, 11:30 PM

Post #12 of 13 (979 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, Jul 22, 2010 at 6:12 PM, Steve Hodge <stevehodge [at] gmail> wrote:
> On Thu, Jul 22, 2010 at 4:11 PM, Nick Rout <nick.rout [at] gmail> wrote:
>>
>> On Thu, Jul 22, 2010 at 3:52 PM, Bob . <maillists.mythtv [at] gmail> wrote:
>> > Hmmmm, looks like mythtv-setup is timing out before tv_find_grabbers
>> > completes hence doesn't present any of them as an option. Running on
>> > an Acer Revo and the poor little fella is just too slow. I got rid of
>> > all the other grabbers in /usr/bin and I can now select the NZ grabber
>> > in mythtv-setup.
>> >
>> > Is there any way to configure it to ignore some grabbers (rather than
>> > deleting stuff willy-nilly from /usr/bin)?
>>
>> I remember having to do that now! I don't think there is another way
>> to do it, unless you change the timeout in the source code and
>> recompile.
>
> Couldn't you also modify tv_find_grabbers (which is probably a script and
> therefore a lot easier than messing with the mythtv source)?

yes you could speed it up so it beats the timeout.

actually i thought this bug had been fixed in mythtv by increasing it
already. What version are you using Bob?

Or maybe as xmltv adds more grabbers the timeout needs increasing again.

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

nick.rout at gmail

Jul 21, 2010, 11:36 PM

Post #13 of 13 (980 views)
Permalink

Re: tv_grab_nz-py fails to validate [In reply to]

On Thu, Jul 22, 2010 at 5:23 PM, Bob . <maillists.mythtv [at] gmail> wrote:
> On Thu, Jul 22, 2010 at 4:11 PM, Nick Rout <nick.rout [at] gmail> wrote:
>> On Thu, Jul 22, 2010 at 3:52 PM, Bob . <maillists.mythtv [at] gmail> wrote:
>>>
>>> Unfortunately I'm still not getting guide data into myth successfully
>>> but I'll start another thread if necessary.
>>>
>>
>> Take a look in mythweb at Setup (the spanner and key icon at the top)
>> then TV then Channel Info.
>
>
> For the record:
> mythfilldatabase was looking for ~/.mythtv/nzepg.org.xmltv (nzepg.org
> was what I named my video source) and the configuring of the grabber
> in mythtv-setup doesn't seem to write any file at all so:
> $ tv_grab_nz-py --config --config-file=~/.mythtv/nzepg.org.xmltv
> helped.

Just out of interest did it create
/home/mythtv/.mythtv/nzepg.org.xmltv ? thats what mine did, and then
the frontend user was looking for /home/nick/.mythtv/nzepg.org.xml. I
thought mythbuntu had fixed this but I still have a symlink from one
to the other left over from before they fixed it.

again i wonder what version you are using...

_______________________________________________
mythtvnz mailing list
mythtvnz [at] lists
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads