Mailing List Archive: MythTV: Users

Jamu error message

Index | Next | Previous | View Threaded

fatgerman at ntlworld

Nov 8, 2009, 5:37 AM

Post #1 of 10 (2330 views)
Permalink

Jamu error message

Hi All,

It's time for today's Jamu question :)

I've been trying to run a Mass Update by following the instructions on the Wiki. I haven't yet got past the Interactive Session phase. I'm running a mythbuntu 9.10 installation. The Jamu cron jobs are definitely working because I have fanart etc appearing for most of my TV shows. However there are a couple of shows where it has picked the wrong graphics, and I have a few movies in my mythvideo collection that aren't on themoviedb.org and I was hoping to use jamu's secondary source to get the data from imdb instead.

However, the following happens:

/usr/share/mythtv/mythvideo/scripts/jamu.py -l en -C "/home/bob/.mythtv/jamu.conf" -MIV

! Warning: There were no missing interef video files found.

What does this mean? I definitely have several videos and one or two TV shows without metadata or graphics.

Mark
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

jarpublic at gmail

Nov 8, 2009, 7:10 AM

Post #2 of 10 (2267 views)
Permalink

Re: Jamu error message [In reply to]

> I've been trying to run a Mass Update by following the instructions on the Wiki. I haven't yet got past the Interactive Session phase. I'm running a mythbuntu 9.10 installation. The Jamu cron jobs are definitely working because I have fanart etc appearing for most of my TV shows. However there are a couple of shows where it has picked the wrong graphics, and I have a few movies in my mythvideo collection that aren't on themoviedb.org and I was hoping to use jamu's secondary source to get the data from imdb instead.

It is against the terms of service to scrape from the IMDB, so there
isn't going to be official support for that. TMDB and TVDB are both
run wiki style. So if you have movies or shows that aren't present the
preferrable thing to do is to add them in. Then everybody benefits
from that. Also it is possible that your movie/show is in the database
but it may not have any artwork. Likewise you are encouraged to add it
in. The only way to get it all there is for the users to add it.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

r.d.vaughan at rogers

Nov 8, 2009, 7:57 AM

Post #3 of 10 (2252 views)
Permalink

Re: Jamu error message [In reply to]

Mark,
When you use the -MI option it tells jamu to ONLY process videos
that do not have either a TVDB or TMDB number and to ignore any other
videos. The message is telling you that there are no videos with missing
TVDB/TMDB numbers so Jamu -MI has nothing to process.

If you have never run a Jamu interactive session (-MI) where videos
were processed, then this may mean that the your video directory
configuration settings (set in MythTV) is pointing to an empty
directory. Run this command: "./jamu -Mf". This will output all the
settings jamu would use in alphabetical order. You are interested in the
""mythvideo" setting for example "mythvideo ([u'/media/video'])". Jamu
has read the "/media/video" directory from the MythTV database. Make
sure that your Video and graphics directory settings are correct.

There is a chance that the reason you see graphics is that one of
the Mythbuntu Jamu cronjobs gets graphics for your Scheduled and
Recorded programs.

A side comment: Jamu automatically looks for a conf file in
"~/.mythtv/jamu.conf" so from the command line you have used you do not
need to specify the location of your jamu.conf file.

To use a secondary source you need to specified it in your jamu.conf
file like the included example.

You said "However there are a couple of shows where it has picked
the wrong graphics...". If this occurs check to see if your TV series in
the video file name matches the name used for that show on TVDB. For
example on TVDB "Castle" is an old show while "Castle (2009)" is the
currently running show.

You use the jamu.conf section "[series_name_override]" to force a match
for TV shows and Movies. When something is not correct verify that the
source TVDB/TMDB information matches what jamu parses from your video
filenames or even what is in your EPG. Jamu can only do so much guessing.

Doug

_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

r.d.vaughan at rogers

Nov 8, 2009, 8:11 AM

Post #4 of 10 (2255 views)
Permalink

Re: Jamu error message [In reply to]

Johnny,
I fully endorse your recommendation that users should add missing
content to both TVDB and TMDB. Just so you know Jamu allows for user
written scripts or scripts that are distributed with MythTV as ways to
get additional/secondary information. I do not believe the distributed
scripts violate any ToS considering they come with MythTV 0.22
(imdbpy.py and fetch_poster.py). If they do violate ToS they should be
removed from the MythTV distribution.

Doug
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

fatgerman at ntlworld

Nov 8, 2009, 10:10 AM

Post #5 of 10 (2248 views)
Permalink

Re: Jamu error message [In reply to]

On Sunday 08 Nov 2009 15:57:46 Doug Vaughan wrote:
> Mark,
> When you use the -MI option it tells jamu to ONLY process videos
> that do not have either a TVDB or TMDB number and to ignore any other
> videos. The message is telling you that there are no videos with missing
> TVDB/TMDB numbers so Jamu -MI has nothing to process.
>
> If you have never run a Jamu interactive session (-MI) where videos
> were processed, then this may mean that the your video directory
> configuration settings (set in MythTV) is pointing to an empty
> directory. Run this command: "./jamu -Mf". This will output all the
> settings jamu would use in alphabetical order. You are interested in the
> ""mythvideo" setting for example "mythvideo ([u'/media/video'])". Jamu
> has read the "/media/video" directory from the MythTV database. Make
> sure that your Video and graphics directory settings are correct.

Hi Doug, thanks - I think you have put your finger on it.

jamu -Mf reports
mythvideo (['/var/lib/mythtv/videos'])

This is not correct. I have configured in the frontend under 'Videos Settings'->'General Settings'->'Directories that hold videos' is '/media/entertainment/Videos'.

So why is jamu ingoring this? And how do I fix it?

In the meantime, I tried symlinking /var/lib/mythtv/videos to /media/entertainment/Videos.
Now the interactive session is running, and finding all kinds of missing stuff, and deleting all the metadata I have carefully entered by hand, and when I go back into 'Watch Videos' I now have an entry 'Storage Groups' which lists one duplicate entry for each of my videos. And I STILL have no metadata, not even for all the videos I had painstakingly done it by hand for.

I don't have any storage groups. I don't want any storage groups. I am beginning to think that jamu doesn't work without them. Looks like a bug to me.

Does anybody know how to restore the database backup that mythbutnu creates, because jamu has snafu'd mine?

Thanks,

Mark

>
> There is a chance that the reason you see graphics is that one of
> the Mythbuntu Jamu cronjobs gets graphics for your Scheduled and
> Recorded programs.
>
> A side comment: Jamu automatically looks for a conf file in
> "~/.mythtv/jamu.conf" so from the command line you have used you do not
> need to specify the location of your jamu.conf file.
>
> To use a secondary source you need to specified it in your jamu.conf
> file like the included example.
>
> You said "However there are a couple of shows where it has picked
> the wrong graphics...". If this occurs check to see if your TV series in
> the video file name matches the name used for that show on TVDB. For
> example on TVDB "Castle" is an old show while "Castle (2009)" is the
> currently running show.
>
> You use the jamu.conf section "[series_name_override]" to force a match
> for TV shows and Movies. When something is not correct verify that the
> source TVDB/TMDB information matches what jamu parses from your video
> filenames or even what is in your EPG. Jamu can only do so much guessing.
>
>
> Doug
>
> _______________________________________________
> mythtv-users mailing list
> mythtv-users [at] mythtv
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

r.d.vaughan at rogers

Nov 8, 2009, 11:22 AM

Post #6 of 10 (2256 views)
Permalink

Re: Jamu error message [In reply to]

Mark,
This link includes data base restore information.
http://www.mythtv.org/wiki/Backup_your_database

I have no idea how you got a Videos storage group as Jamu does not
add any storage groups. If you do not want storage groups then remove
their entries through "mythtv-setup". Of course do not remove the
"Default" storage group as it is used strictly for recordings. Then in
MythVideo rescan to get rid of duplicate entries.

Jamu will always try to use a storage groups for videos and/or
graphics when they are present. Now if you find that you do not have a
Videos storage group with "/var/lib/mythtv/videos" then the last
possibility is that your backend (identified by its hostname) has a
MythTV data base "settings" table entry for the "VideoStartupDir" field
with a value of "/var/lib/mythtv/videos".

When there are no Videos storage groups defined Jamu looks for the
other directory settings specific to the backend's hostname. This is may
be why Jamu is finding the "/var/lib/mythtv/videos". If that is true
then Jamu will likely also find incorrect entries for your graphics
directories associated with your backend's hostname.

Yesterday I was talking to a user who had a FE on a seprerate
machine then their backend. They had no storage groups other than
"Default". Jamu could not find their graphics directory. We finally
determined that they had MythDB entries that did not match between their
backend and their front end. Their database even had FE settings for old
machines they no longer used.

You have a few choices, of course the first is not to use jamu as it is
entirely option. If you still want to use Jamu then run a FE on your
backend and set the directory paths for video and the graphics to what
you have on your other FE(s).

I am considering adding an option to allow a use to identify the
hostname that Jamu would use to get video and graphics settings when
storage groups are not configured for a backend. I cannot even think of
how to explain the option to users that ruh into this rare situation.

Doug
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

r.d.vaughan at rogers

Nov 8, 2009, 11:30 AM

Post #7 of 10 (2249 views)
Permalink

Re: Jamu error message [In reply to]

Mark,
One more thing, Jamu will not delete metadata. What is more likely
to have happened is that the MythVideo records did not have TVDB/TMDB
numbers and Jamu either added an entirely (duplicate to you) record or
tried to fill in the gaps from what you had entered.

If you like to manually enter metadata that you do not want replaced
then you have two choices. Change those video's TMDB/TVDB number to
'99999999' eight nines and jamu will ignore those video. This is a
feature for people that use MythVideo with their home movie collections
or those that manually enter data for videos that are not in TVDB or
TMDB. The last option is not to use jamu at all.

Doug
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

fatgerman at ntlworld

Nov 8, 2009, 12:36 PM

Post #8 of 10 (2235 views)
Permalink

Re: Jamu error message [In reply to]

On Sunday 08 Nov 2009 19:30:23 Doug Vaughan wrote:
> Mark,
> One more thing, Jamu will not delete metadata. What is more likely
> to have happened is that the MythVideo records did not have TVDB/TMDB
> numbers and Jamu either added an entirely (duplicate to you) record or
> tried to fill in the gaps from what you had entered.
>
> If you like to manually enter metadata that you do not want replaced
> then you have two choices. Change those video's TMDB/TVDB number to
> '99999999' eight nines and jamu will ignore those video. This is a
> feature for people that use MythVideo with their home movie collections
> or those that manually enter data for videos that are not in TVDB or
> TMDB. The last option is not to use jamu at all.
>
> Doug
> _______________________________________________
> mythtv-users mailing list
> mythtv-users [at] mythtv
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>
Hi Doug,

Thanks for this. I think I now know what has happened. I'm running a combined frontend/backend.

Mythbuntu creates, unbeknown to me, default storage groups for Videos, posters, fanart etc. I didn't know about these.

I had edited the setup in the Frontend under 'Directories that hold videos' to point to my /media/entertainment/Videos. Meanwhile the storage group was still pointing at /var/lib/mythtv/videos.

I'd scanned the videos from the frontend and manually downloaded metadata.

Now that I've found the storage group, I've changed the storage group setting to point to my directory. Running Jamu again then created new entries for all my videos. This confused me so I scanned for changes. This is what lost all the metadata. But, now that everything is looking in the same place, scan for changes no longer loses metadata and I'm happy to say that Jamu is updating everything just like I wanted it to.

It seems to me to be somewhat confusing to have two separate independent places to set a directory path. And it's a little worrying that it causes the jamu confusion like it does.

Anyway, thanks for the help. We worked it out in the end... :)

Mark

_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

r.d.vaughan at rogers

Nov 8, 2009, 1:47 PM

Post #9 of 10 (2246 views)
Permalink

Re: Jamu error message [In reply to]

Mark,
I am happy to read that everything is now working. It can be
confusing to have two places to define video and graphics but those are
really options. Jamu did not get confused as much as will always use
storage groups over FE paths.

Some people have both storage groups for videos and graphics that
reside on a backend(s) while they also have FE video and image
directories that are only to the FE,

As jamu will only run on a backend, having storage groups as a
priority only makes sense, The videos and their graphics would be
available to any FE. If you have both your FE video path and an
identical video storage group path you will get duplicates in MythVideo
totally independant of Jamu.

I hope that helps clarify the situation.

Doug
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

jarpublic at gmail

Nov 8, 2009, 4:25 PM

Post #10 of 10 (2240 views)
Permalink

Re: Jamu error message [In reply to]

> � I fully endorse your recommendation that users should add missing content
> to both TVDB and TMDB. Just so you know Jamu allows for user written scripts
> or scripts that are distributed with MythTV as ways to get
> additional/secondary information. I do not believe the distributed scripts
> violate any ToS considering they come with MythTV 0.22 (imdbpy.py and
> fetch_poster.py). If they do violate ToS they should be removed from the
> MythTV distribution.

I don't know the full story behind that stuff. I just remember a few
months back on the list. Someone said that the IMDB had asked that
their site not be scraped, and that was what prompted the move to tmdb
for .22 and deprecating imdb.pl. So I don't really know what the
official situation is in terms of the TOS. Also there was the
recognition of the advantages of having an open API and such that is
better for mythtv's purposes. Now it is just a matter of growing the
contributing user base to the point where themoviedb and thetvdb have
artwork and metadata for all the content. I fear that a lot of people
that use these resources don't realize that it is built from user
contributions and so their input is valuable to us all.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads