Mailing List Archive: MythTV: Users

Video Metadata

1 2

View All

Index | Next | Previous | View Threaded

raphael.timothy at gmail

Aug 3, 2012, 8:09 AM

Post #1 of 41 (1781 views)
Permalink

Video Metadata

Hi All,

I have a few questions about 0.25 and metadata for video files in the gallery.

1) What is the correct way to have the frontend perform a periodic
scan of the video library?
I would like it such that the user never needs to do this from the GUI
as I have a very large library that is altered constantly and takes
time to update.

2) What is the correct procedure for adding metadata on mass to video
files in the gallery - not recordings, videos.
Running the Ttvdb.py script on the commandline doesn't produce any
results. The only way I have gotten this to work so far is hitting 'w'
while the specific episode is selected in mythtv. I have ~1800 TV show
epiosdes and this simply is not an option for filling metadata one
episode at a time.

Thanks,

Tim
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

gentlec at gmail

Aug 3, 2012, 8:28 AM

Post #2 of 41 (1755 views)
Permalink

Re: Video Metadata [In reply to]

On Fri, Aug 3, 2012 at 10:09 AM, Tim Raphael <raphael.timothy [at] gmail>wrote:

> 2) What is the correct procedure for adding metadata on mass to video
> files in the gallery - not recordings, videos.
> Running the Ttvdb.py script on the commandline doesn't produce any
> results. The only way I have gotten this to work so far is hitting 'w'
> while the specific episode is selected in mythtv. I have ~1800 TV show
> epiosdes and this simply is not an option for filling metadata one
> episode at a time.
>

I've been fighting with this for a while. First, you have to make sure
your videos are named according to the rules on the wiki. Otherwise, the
grabber won't be able to look them up.

Most of my shows in MythVideo have correct metadata. The ones I'm having
problems with are shows that have ambiguous names that ttvdb.py can't
resolve correctly. The ttvdb.py grabber looks for a file called
~/.mythtv/ttvdb.conf and you are supposed to be able to put overrides in
there to help ttvdb.py find the correct metadata for your show. That
doesn't seem to work, at least not for me. I verified that the script is
reading the file and building the list of overrides but the lookups still
fail.

--
Chris

icicimov at gmail

Aug 3, 2012, 9:46 AM

Post #3 of 41 (1754 views)
Permalink

Re: Video Metadata [In reply to]

On Aug 4, 2012 1:10 AM, "Tim Raphael" <raphael.timothy [at] gmail> wrote:
>
> Hi All,
>
> I have a few questions about 0.25 and metadata for video files in the
gallery.
>
> 1) What is the correct way to have the frontend perform a periodic
> scan of the video library?
> I would like it such that the user never needs to do this from the GUI
> as I have a very large library that is altered constantly and takes
> time to update.

Tou can run "mythutil --scanvideos" from a cron script

> 2) What is the correct procedure for adding metadata on mass to video
> files in the gallery - not recordings, videos.
> Running the Ttvdb.py script on the commandline doesn't produce any
> results. The only way I have gotten this to work so far is hitting 'w'
> while the specific episode is selected in mythtv. I have ~1800 TV show
> epiosdes and this simply is not an option for filling metadata one
> episode at a time.
>
> Thanks,
>
> Tim
> _______________________________________________
> mythtv-users mailing list
> mythtv-users [at] mythtv
> http://www.mythtv.org/mailman/listinfo/mythtv-users

raphael.timothy at gmail

Aug 4, 2012, 6:15 AM

Post #4 of 41 (1744 views)
Permalink

Re: Video Metadata [In reply to]

Thanks for the answers so far!

I'll def look into the cron script for the video scanning.

I am yet to see the metadata inserting itself in mythvideo without me
pressing the 'w' key. Once I have used a standard file format the
metadata is not loading.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

gentlec at gmail

Aug 4, 2012, 9:03 AM

Post #5 of 41 (1733 views)
Permalink

Re: Video Metadata [In reply to]

On Sat, Aug 4, 2012 at 8:15 AM, Tim Raphael <raphael.timothy [at] gmail>wrote:

> I am yet to see the metadata inserting itself in mythvideo without me
> pressing the 'w' key. Once I have used a standard file format the
> metadata is not loading.
>

I have not been able to figure out just what triggers a metadata lookup.
There's a checkbox in the frontend for doing a lookup immediately following
a video scan but that doesn't seem to work. I also can't figure out how to
force it to happen. If I run ttvdb.py manually, it just outputs everything
to stdout without sticking anything in the database.

One problem that I see is with the "Processed" flag in the videometadata
database table. Someone replied to one of my earlier messages and said
that if the Processed flag is set to 1 then the metadata lookup isn't
attempted again. In my case, it looks like Processed is getting set to 1
even when metadata lookup fails. So that could keep it from retrying. You
can reset that flag to 0 with an SQL statement and see if it makes any
difference.

UPDATE videometadata SET Processed=0 WHERE Title = 'title of your series'

--
Chris

gentlec at gmail

Aug 4, 2012, 11:56 AM

Post #6 of 41 (1734 views)
Permalink

Re: Video Metadata [In reply to]

nick.rout at gmail

Aug 4, 2012, 1:35 PM

Post #7 of 41 (1727 views)
Permalink

Re: Video Metadata [In reply to]

On Sun, Aug 5, 2012 at 1:15 AM, Tim Raphael <raphael.timothy [at] gmail> wrote:
> Thanks for the answers so far!
>
> I'll def look into the cron script for the video scanning.
>
> I am yet to see the metadata inserting itself in mythvideo without me
> pressing the 'w' key. Once I have used a standard file format the
> metadata is not loading.

once the file has been scanned, and (because it is named wrongly) no
metadata is found, it will not be rescanned again, even if you change
the file name. Move the files that have been renamed out of your
storage group, rescan (and they will be deleted from the dB), move
them back and rescan.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

joe at thefrys

Aug 4, 2012, 2:45 PM

Post #8 of 41 (1720 views)
Permalink

Re: Video Metadata [In reply to]

>
> > Thanks for the answers so far!
> >
> > I'll def look into the cron script for the video scanning.
> >
> > I am yet to see the metadata inserting itself in mythvideo without me
> > pressing the 'w' key. Once I have used a standard file format the
> > metadata is not loading.
>
> once the file has been scanned, and (because it is named wrongly) no
> metadata is found, it will not be rescanned again, even if you change
> the file name. Move the files that have been renamed out of your
> storage group, rescan (and they will be deleted from the dB), move
> them back and rescan.
>

Or simply select the video and press ' i ' and select "Change Video
Details" and use the options there to reset and retrieve details. If you
use the retrieve details option, you are provided a list of titles matching
the query.

nick.rout at gmail

Aug 4, 2012, 3:09 PM

Post #9 of 41 (1722 views)
Permalink

Re: Video Metadata [In reply to]

On Sun, Aug 5, 2012 at 9:45 AM, Joseph Fry <joe [at] thefrys> wrote:
>> > Thanks for the answers so far!
>> >
>> > I'll def look into the cron script for the video scanning.
>> >
>> > I am yet to see the metadata inserting itself in mythvideo without me
>> > pressing the 'w' key. Once I have used a standard file format the
>> > metadata is not loading.
>>
>> once the file has been scanned, and (because it is named wrongly) no
>> metadata is found, it will not be rescanned again, even if you change
>> the file name. Move the files that have been renamed out of your
>> storage group, rescan (and they will be deleted from the dB), move
>> them back and rescan.
>
>
> Or simply select the video and press ' i ' and select "Change Video
> Details" and use the options there to reset and retrieve details. If you
> use the retrieve details option, you are provided a list of titles matching
> the query.

thats ok for one or two, gets tedious on whole directories full of files.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

gentlec at gmail

Aug 4, 2012, 3:17 PM

Post #10 of 41 (1726 views)
Permalink

Re: Video Metadata [In reply to]

On Sat, Aug 4, 2012 at 3:35 PM, Nick Rout <nick.rout [at] gmail> wrote:

> once the file has been scanned, and (because it is named wrongly) no
> metadata is found, it will not be rescanned again, even if you change
> the file name. Move the files that have been renamed out of your
> storage group, rescan (and they will be deleted from the dB), move
> them back and rescan.
>

Would just deleting the information from the videometadata table accomplish
the same thing? That seems faster than moving a directory full of videos
out and back into the storage group.

--
Chris

nick.rout at gmail

Aug 4, 2012, 4:18 PM

Post #11 of 41 (1734 views)
Permalink

Re: Video Metadata [In reply to]

On Sun, Aug 5, 2012 at 10:17 AM, Chris Gentle <gentlec [at] gmail> wrote:
> On Sat, Aug 4, 2012 at 3:35 PM, Nick Rout <nick.rout [at] gmail> wrote:
>>
>> once the file has been scanned, and (because it is named wrongly) no
>> metadata is found, it will not be rescanned again, even if you change
>> the file name. Move the files that have been renamed out of your
>> storage group, rescan (and they will be deleted from the dB), move
>> them back and rescan.
>
>
> Would just deleting the information from the videometadata table accomplish
> the same thing? That seems faster than moving a directory full of videos
> out and back into the storage group.

I used to do that but was told off because doing that doesn't clear
data out of related tables.

I copy the files using midnight commander to a directory on the same
disk, it is usually almost instantaneous as no data actually gets
shifted on disk. eg I have /mnt/videos/videoes/TV/Misnamed_series. The
SG is set to /mnt/videos/videos. I just move the whole misnamed_series
directory to /mnt/videos, scan, move back, scan.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

raphael.timothy at gmail

Aug 4, 2012, 9:24 PM

Post #12 of 41 (1708 views)
Permalink

Re: Video Metadata [In reply to]

> I have not been able to figure out just what triggers a metadata lookup.
> There's a checkbox in the frontend for doing a lookup immediately following
> a video scan but that doesn't seem to work. I also can't figure out how to
> force it to happen. If I run ttvdb.py manually, it just outputs everything
> to stdout without sticking anything in the database.

Exactly what i'm experiencing.

> Move the files that have been renamed out of your
> storage group, rescan (and they will be deleted from the dB), move

I did this, removed my folder from the storage group and rescanned. I
checked to make sure the metadata was cleared from the DB table, added
the folder back to the SG and rescanned. I could see the episode data
was being pulled into the DB table on the second scan however it just
doesn't go that extra step and load the plot, director's details and
artwork.

>> Or simply select the video and press ' i ' and select "Change Video
>> Details" and use the options there to reset and retrieve details. If you
>> use the retrieve details option, you are provided a list of titles matching
>> the query.

> thats ok for one or two, gets tedious on whole directories full of files.

Exactly, I have thousands of TV shows that would take me FOREVER to
process these individually. Most of the time for movies and tv shows
the loaded show is correct. My question: how come there is no
automatic process for mass downloading metadata?

Maybe one of the devs could enlighten us as to how the metadata should
be automatically loaded?
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

raymond at wagnerrp

Aug 4, 2012, 10:56 PM

Post #13 of 41 (1709 views)
Permalink

Re: Video Metadata [In reply to]

On 8/4/2012 12:03, Chris Gentle wrote:
> If I run ttvdb.py manually, it just outputs everything to stdout without
> sticking anything in the database.

That's correct. The grabber interface is designed such that the scripts
only need return a simple format, rather than understand the database
schema natively, to insert the response directly. The frontend takes
the output from the grabber and handles all database operations.

> In my case, it looks like Processed is getting set to 1 even when metadata
> lookup fails. So that could keep it from retrying.

Of course it is. If the batch lookup fails once, logic would suggest it
will fail on the next attempt too.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

raymond at wagnerrp

Aug 4, 2012, 10:59 PM

Post #14 of 41 (1706 views)
Permalink

Re: Video Metadata [In reply to]

On 8/4/2012 14:56, Chris Gentle wrote:
> On Sat, Aug 4, 2012 at 8:15 AM, Tim Raphael <raphael.timothy [at] gmail
> <mailto:raphael.timothy [at] gmail>> wrote:
>
>> I am yet to see the metadata inserting itself in mythvideo without me
>> pressing the 'w' key. Once I have used a standard file format the
>> metadata is not loading.
>
>
> The other confusing thing is that running "mythmetadatalookup
> --refresh-all" only seems to lookup data for recordings and ignores
> MythVideo completely. That seems like the logical way to force a
> metadata lookup for both recordings and videos. Oh well ...

`mythmetadatalookup` operates on recordings, as recordings are
frequently changing. On the other hand, videos are static and only
change when you perform a scan. There is no reason to run over those
repeatedly.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

mikep at randomtraveller

Aug 5, 2012, 3:22 AM

Post #15 of 41 (1703 views)
Permalink

Re: Video Metadata [In reply to]

On 05/08/12 00:18, Nick Rout wrote:
> On Sun, Aug 5, 2012 at 10:17 AM, Chris Gentle <gentlec [at] gmail> wrote:
>> On Sat, Aug 4, 2012 at 3:35 PM, Nick Rout <nick.rout [at] gmail> wrote:
>>>
>>> once the file has been scanned, and (because it is named wrongly) no
>>> metadata is found, it will not be rescanned again, even if you change
>>> the file name. Move the files that have been renamed out of your
>>> storage group, rescan (and they will be deleted from the dB), move
>>> them back and rescan.
>>
>>
>> Would just deleting the information from the videometadata table accomplish
>> the same thing? That seems faster than moving a directory full of videos
>> out and back into the storage group.
>
> I used to do that but was told off because doing that doesn't clear
> data out of related tables.
>
> I copy the files using midnight commander to a directory on the same
> disk, it is usually almost instantaneous as no data actually gets
> shifted on disk. eg I have /mnt/videos/videoes/TV/Misnamed_series. The
> SG is set to /mnt/videos/videos. I just move the whole misnamed_series
> directory to /mnt/videos, scan, move back, scan.
>
You could save a whole lot of work - and possible mistakes - just by deleting
the storage group /entry/ in the mythtv database and creating a new one pointing
to an empty directory somewhere. Scan, put entry back where videos reside. No
need to touch any media files.

--

Mike Perkins

_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

nick.rout at gmail

Aug 5, 2012, 1:49 PM

Post #16 of 41 (1687 views)
Permalink

Re: Video Metadata [In reply to]

>> I copy the files using midnight commander to a directory on the same
>> disk, it is usually almost instantaneous as no data actually gets
>> shifted on disk. eg I have /mnt/videos/videoes/TV/Misnamed_series. The
>> SG is set to /mnt/videos/videos. I just move the whole misnamed_series
>> directory to /mnt/videos, scan, move back, scan.
>>
> You could save a whole lot of work - and possible mistakes - just by
> deleting the storage group /entry/ in the mythtv database and creating a new
> one pointing to an empty directory somewhere. Scan, put entry back where
> videos reside. No need to touch any media files.

Only if you want the entire SG rescanned, we are talking about a
situation where some shows are wrongly named, but not all of them.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

gentlec at gmail

Aug 5, 2012, 4:41 PM

Post #17 of 41 (1685 views)
Permalink

Re: Video Metadata [In reply to]

On Sun, Aug 5, 2012 at 3:49 PM, Nick Rout <nick.rout [at] gmail> wrote:

> >> I copy the files using midnight commander to a directory on the same
> >> disk, it is usually almost instantaneous as no data actually gets
> >> shifted on disk. eg I have /mnt/videos/videoes/TV/Misnamed_series. The
> >> SG is set to /mnt/videos/videos. I just move the whole misnamed_series
> >> directory to /mnt/videos, scan, move back, scan.
>

I found that rescanning videos seems to skip hidden directories and files.
So, it seems you can rename a directory to be hidden (i.e. with a leading
dot) and rescan. This will remove the videos in that directory from the
database. Then remove the leading dot and scan again. That's easier than
moving files. However, I tested this earlier and still no metadata for the
series.

--
Chris

nick.rout at gmail

Aug 5, 2012, 4:44 PM

Post #18 of 41 (1688 views)
Permalink

Re: Video Metadata [In reply to]

On Mon, Aug 6, 2012 at 11:41 AM, Chris Gentle <gentlec [at] gmail> wrote:
> On Sun, Aug 5, 2012 at 3:49 PM, Nick Rout <nick.rout [at] gmail> wrote:
>>
>> >> I copy the files using midnight commander to a directory on the same
>> >> disk, it is usually almost instantaneous as no data actually gets
>> >> shifted on disk. eg I have /mnt/videos/videoes/TV/Misnamed_series. The
>> >> SG is set to /mnt/videos/videos. I just move the whole misnamed_series
>> >> directory to /mnt/videos, scan, move back, scan.
>
>
> I found that rescanning videos seems to skip hidden directories and files.
> So, it seems you can rename a directory to be hidden (i.e. with a leading
> dot) and rescan. This will remove the videos in that directory from the
> database. Then remove the leading dot and scan again. That's easier than
> moving files. However, I tested this earlier and still no metadata for the
> series.

What is the series and how are they named? (sorry if I missed that in
the thread above).

\
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

gentlec at gmail

Aug 6, 2012, 4:38 AM

Post #19 of 41 (1675 views)
Permalink

Re: Video Metadata [In reply to]

On Sun, Aug 5, 2012 at 6:44 PM, Nick Rout <nick.rout [at] gmail> wrote:

> What is the series and how are they named? (sorry if I missed that in
> the thread above).
>

In my case, Monk and Eureka are two examples that fail to lookup metadata.
In MythVideo I have them named "Monk" and "Eureka" and have filled in the
[series_name_override] section in ~/.mythtv/ttvdb.conf.

[series_name_override]
Monk:78490
Eureka:79334

--
Chris

raphael.timothy at gmail

Aug 7, 2012, 12:48 AM

Post #20 of 41 (1658 views)
Permalink

Re: Video Metadata [In reply to]

HI All,

To get this thread back on track, can anyone enlighten me why there seems
to be no automatic metadata fetching? I could also apply this to 0.26 which
went beta today.

Thanks,

Tim

raymond at wagnerrp

Aug 7, 2012, 6:54 AM

Post #21 of 41 (1648 views)
Permalink

Re: Video Metadata [In reply to]

On 8/7/2012 03:48, Tim Raphael wrote:
> HI All,
>
> To get this thread back on track, can anyone enlighten me why there
> seems to be no automatic metadata fetching? I could also apply this to
> 0.26 which went beta today.

Because there is, and you appear to have not enabled it.

Setup -> Media Settings -> Videos Settings -> Metadata Settings ->
Update metadata after video scan
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

raphael.timothy at gmail

Aug 10, 2012, 7:12 PM

Post #22 of 41 (1563 views)
Permalink

Re: Video Metadata [In reply to]

Hi Again,

I can now see in the FE logs the metadata scan is being run after the video
scan.
It seems to parse the video filenames for the season and episode
information alright however, no coverart, fanart, banner or description is
being displayed in the frontend until I hit the 'W' key and perform a
manual lookup.

Here is an extract from the inital video scan metadata lookup:

2012-08-08 08:11:28.191532 I Returning Metadata Results: Burn Notice 3 10
2012-08-08 08:11:28.191646 I Running Grabber:
/usr/share/mythtv/metadata/Television/ttvdb.py -l en -M Burn No tice
2012-08-08 08:11:28.389538 I Running Grabber:
/usr/share/mythtv/metadata/Television/ttvdb.py -l en -D 80270 3 9
2012-08-08 08:11:28.692854 I Returning Metadata Results: Burn Notice 3 9
2012-08-08 08:11:28.692976 I Running Grabber:
/usr/share/mythtv/metadata/Television/ttvdb.py -l en -M Burn Notice
2012-08-08 08:11:28.890890 I Running Grabber:
/usr/share/mythtv/metadata/Television/ttvdb.py -l en -D 80270 3 8
2012-08-08 08:11:29.194359 I Returning Metadata Results: Burn Notice 3 8
2012-08-08 08:11:29.194483 I Running Grabber:
/usr/share/mythtv/metadata/Television/ttvdb.py -l en -M Burn Notice
2012-08-08 08:11:29.392230 I Running Grabber:
/usr/share/mythtv/metadata/Television/ttvdb.py -l en -D 80270 3 7
2012-08-08 08:11:29.695616 I Returning Metadata Results: Burn Notice 3 7
2012-08-08 08:11:29.695732 I Running Grabber:
/usr/share/mythtv/metadata/Television/ttvdb.py -l en -M Burn Notice

Before Metadata Lookup:
http://i102.photobucket.com/albums/m82/PCgeek215/Before-Metadata-Lookup.jpg
As you can see, the show, season and episode info has been parsed fine
(left hand side).

During Metadata Lookup:
http://i102.photobucket.com/albums/m82/PCgeek215/During-Metadata-Lookup.jpg
After pressing the W key to kickoff a manual fetch. The show is recognised
100% of the time with correct file names.

All cover art and information pulled in:
http://i102.photobucket.com/albums/m82/PCgeek215/After-Metadata-Lookup.jpg

Surely i'm missing something!?!?!

dheianevans at gmail

Aug 10, 2012, 9:11 PM

Post #23 of 41 (1562 views)
Permalink

Re: Video Metadata [In reply to]

When do the episode images get grabbed? Just put Long Way Down on the system.

The metadata for the episodes were grabbed, coverat, fanart, but the
gallery view is still showing the coverart instead of the episode
images.

Out of its 10 episodes, 6 have episode images so is that a problem?

http://thetvdb.com/?tab=seasonall&id=80731&lid=7
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

dheianevans at gmail

Aug 10, 2012, 9:28 PM

Post #24 of 41 (1558 views)
Permalink

Re: Video Metadata [In reply to]

On Sat, Aug 11, 2012 at 12:11 AM, Ian Evans <dheianevans [at] gmail> wrote:
> When do the episode images get grabbed? Just put Long Way Down on the system.
>
> The metadata for the episodes were grabbed, coverat, fanart, but the
> gallery view is still showing the coverart instead of the episode
> images.
>
> Out of its 10 episodes, 6 have episode images so is that a problem?
>
> http://thetvdb.com/?tab=seasonall&id=80731&lid=7

ok...bizarre...the screenshots did get downloaded, but they didn't get
used. Have hadn't that issue with other series.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://www.mythtv.org/mailman/listinfo/mythtv-users

raphael.timothy at gmail

Aug 11, 2012, 6:43 AM

Post #25 of 41 (1533 views)
Permalink

Re: Video Metadata [In reply to]

Yes, it seems the filename gets parsed but no lookup occurs.
I'm going to check my proxy server to see if a request is actually made
when I press W.

1 2

View All

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads