Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: MythTV: Users

Question about mythfilldatabase?

  

 
MythTV users RSS feed   Index | Next | Previous | View Threaded


dyoderatucsd at gmail

Oct 22, 2009, 1:26 PM

Post #1 of 21 (2094 views)
Permalink
Question about mythfilldatabase?
Hi there. I only recently subscribed to the list, so please, please
forgive me if this question has already been addressed.

The short version of my question is: I'm using DataDirect and have the
option selected to allow the server to schedule my next grab. I'm
wondering if I can separate the grabbing process of mythfilldatabase
from the mysql stuffing process? I.e., can I allow the server to dictate
when I grab the data for server load purposes, while I can dictate when
the data will be processed into the mysql server? Read on for details as
to why.

The long version: I noticed that the mythfilldatabase process takes an
awful lot of cpu load on my meager machine. I have a separate frontend
machine in another room which I use for viewing, but while
mythfilldatabase is running, things jam up and I can't watch programs,
live TV, etc. (I get a message that the backend seems to have gone away,
and killing mythfilldatabase immediately fixes things.) I want to be a
good user and let the DataDirect servers manage their load properly, but
I also would like to schedule the load on my end to be low during times
I might be watching TV (i.e. 4am would be a good time for things to run
on my end). I know that mythfilldatabase has a --file option for XMLTV
grabbers (I had to use it back in the day), so I'm wondering if I can
somehow set things up to work with the DataDirect grabber so that
everybody's happy? Thanks in advance for your help!

--David
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


mtdean at thirdcontact

Oct 22, 2009, 1:49 PM

Post #2 of 21 (2051 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
On 10/22/2009 04:26 PM, David Yoder wrote:
> Hi there. I only recently subscribed to the list, so please, please
> forgive me if this question has already been addressed.
>
> The short version of my question is: I'm using DataDirect and have the
> option selected to allow the server to schedule my next grab. I'm
> wondering if I can separate the grabbing process of mythfilldatabase
> from the mysql stuffing process? I.e., can I allow the server to
> dictate when I grab the data for server load purposes, while I can
> dictate when the data will be processed into the mysql server? Read on
> for details as to why.
>
> The long version: I noticed that the mythfilldatabase process takes an
> awful lot of cpu load on my meager machine. I have a separate frontend
> machine in another room which I use for viewing, but while
> mythfilldatabase is running, things jam up and I can't watch programs,
> live TV, etc. (I get a message that the backend seems to have gone
> away, and killing mythfilldatabase immediately fixes things.) I want
> to be a good user and let the DataDirect servers manage their load
> properly, but I also would like to schedule the load on my end to be
> low during times I might be watching TV (i.e. 4am would be a good time
> for things to run on my end). I know that mythfilldatabase has a
> --file option for XMLTV grabbers (I had to use it back in the day), so
> I'm wondering if I can somehow set things up to work with the
> DataDirect grabber so that everybody's happy? Thanks in advance for
> your help!

The closest you could get to this is

a) Install xmltv
b) Set up tv_grab_na_dd
c) Write a script that uses tv_grab_na_dd to get the "raw" (DD--don't
have it convert to XMLTV format or it will take more processor time
/and/ will result in your getting less useful data for each program) and
save it somewhere (sorry, I forgot the argument that specifies this, but
it should be available in the --help output)
d) Change the setting, "mythfilldatabase Program" (in General settings
of mythtv-setup in trunk or in mythfrontend settings for -fixes) to
specify the full path to the script you wrote (and ensure the user
running the backend has appropriate permissions to read and execute it
and the directories leading to it). Then, mythbackend will run your
script instead of mythfilldatabase.
e) Set up a cron job to run mythfilldatabase --dd-file <sourceid>
<offset> <lineupid> <xmlfile> (for each video source you've set up).

Oh, and thanks for asking how to do it right rather than just setting up
a cron job and ignoring the provider-suggested time.

Mike
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


dyoderatucsd at gmail

Oct 22, 2009, 3:24 PM

Post #3 of 21 (2040 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
Michael T. Dean wrote:
> On 10/22/2009 04:26 PM, David Yoder wrote:
>> Hi there. I only recently subscribed to the list, so please, please
>> forgive me if this question has already been addressed.
>>
>> The short version of my question is: I'm using DataDirect and have
>> the option selected to allow the server to schedule my next grab. I'm
>> wondering if I can separate the grabbing process of mythfilldatabase
>> from the mysql stuffing process? I.e., can I allow the server to
>> dictate when I grab the data for server load purposes, while I can
>> dictate when the data will be processed into the mysql server? Read
>> on for details as to why.
>>
>> The long version: I noticed that the mythfilldatabase process takes
>> an awful lot of cpu load on my meager machine. I have a separate
>> frontend machine in another room which I use for viewing, but while
>> mythfilldatabase is running, things jam up and I can't watch
>> programs, live TV, etc. (I get a message that the backend seems to
>> have gone away, and killing mythfilldatabase immediately fixes
>> things.) I want to be a good user and let the DataDirect servers
>> manage their load properly, but I also would like to schedule the
>> load on my end to be low during times I might be watching TV (i.e.
>> 4am would be a good time for things to run on my end). I know that
>> mythfilldatabase has a --file option for XMLTV grabbers (I had to use
>> it back in the day), so I'm wondering if I can somehow set things up
>> to work with the DataDirect grabber so that everybody's happy? Thanks
>> in advance for your help!
>
> The closest you could get to this is
>
> a) Install xmltv
> b) Set up tv_grab_na_dd
> c) Write a script that uses tv_grab_na_dd to get the "raw" (DD--don't
> have it convert to XMLTV format or it will take more processor time
> /and/ will result in your getting less useful data for each program)
> and save it somewhere (sorry, I forgot the argument that specifies
> this, but it should be available in the --help output)
> d) Change the setting, "mythfilldatabase Program" (in General settings
> of mythtv-setup in trunk or in mythfrontend settings for -fixes) to
> specify the full path to the script you wrote (and ensure the user
> running the backend has appropriate permissions to read and execute it
> and the directories leading to it). Then, mythbackend will run your
> script instead of mythfilldatabase.
> e) Set up a cron job to run mythfilldatabase --dd-file <sourceid>
> <offset> <lineupid> <xmlfile> (for each video source you've set up).
>
> Oh, and thanks for asking how to do it right rather than just setting
> up a cron job and ignoring the provider-suggested time.
>
> Mike
Awesome, thanks for your help, Mike. I'll try that out and let you know.

--David
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


stichnot at gmail

Oct 22, 2009, 4:44 PM

Post #4 of 21 (2040 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
On Thu, Oct 22, 2009 at 1:49 PM, Michael T. Dean
<mtdean [at] thirdcontact> wrote:
> Oh, and thanks for asking how to do it right rather than just setting up a
> cron job and ignoring the provider-suggested time.

I can't use the setting where SD decides when to run mythfilldatabase,
because invariably it would choose primetime when 2 or 3 simultaneous
shows were recording. The resulting DB accesses thrash the disk, and
since one of my storage groups is on the same disk as the DB, I would
end up with several minutes of video dropouts and a vastly reduced
WAF.

As a result, I use the setting that picks a random time within a
reasonably wide window. Not a cron job though. It would be really
nice if SD would take my constraints into account when it makes its
suggestion. I would ask it to blackout the 7pm-11pm window.

Jim
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


gull at gull

Oct 22, 2009, 4:51 PM

Post #5 of 21 (2042 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
Jim Stichnoth wrote:
> I can't use the setting where SD decides when to run mythfilldatabase,
> because invariably it would choose primetime when 2 or 3 simultaneous
> shows were recording. The resulting DB accesses thrash the disk, and
> since one of my storage groups is on the same disk as the DB, I would
> end up with several minutes of video dropouts and a vastly reduced
> WAF.
>
> As a result, I use the setting that picks a random time within a
> reasonably wide window. Not a cron job though. It would be really
> nice if SD would take my constraints into account when it makes its
> suggestion. I would ask it to blackout the 7pm-11pm window.

Yeah, I have basically the same issue. Even with the database on a
different spindle, the CPU usage during a mythfilldatabase run is quite
significant and causes hiccups if I let it run during primetime -- which
it almost always seemed to pick, left to its own devices. Renicing
mythfilldatabase doesn't help because a lot of the CPU usage comes from
mysql.

_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


mtdean at thirdcontact

Oct 22, 2009, 6:02 PM

Post #6 of 21 (2032 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
On 10/22/2009 07:51 PM, David Brodbeck wrote:
> Jim Stichnoth wrote:
>> I can't use the setting where SD decides when to run mythfilldatabase,
>> because invariably it would choose primetime when 2 or 3 simultaneous
>> shows were recording. The resulting DB accesses thrash the disk, and
>> since one of my storage groups is on the same disk as the DB, I would
>> end up with several minutes of video dropouts and a vastly reduced
>> WAF.
>>
>> As a result, I use the setting that picks a random time within a
>> reasonably wide window. Not a cron job though. It would be really
>> nice if SD would take my constraints into account when it makes its
>> suggestion. I would ask it to blackout the 7pm-11pm window.
> Yeah, I have basically the same issue. Even with the database on a
> different spindle, the CPU usage during a mythfilldatabase run is
> quite significant and causes hiccups if I let it run during primetime
> -- which it almost always seemed to pick, left to its own devices.
> Renicing mythfilldatabase doesn't help because a lot of the CPU usage
> comes from mysql.

You still can use the suggested time.

http://www.gossamer-threads.com/lists/mythtv/users/403815#403815

Perhaps one of you who actually goes to the trouble of setting it up
will post the script and specific instructions.

Mike
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


gull at gull

Oct 22, 2009, 6:14 PM

Post #7 of 21 (2037 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
Michael T. Dean wrote:
> You still can use the suggested time.
>
> http://www.gossamer-threads.com/lists/mythtv/users/403815#403815
>
> Perhaps one of you who actually goes to the trouble of setting it up
> will post the script and specific instructions.

Thanks, Mike. I'll think about it, but I'm leery of putting this data
through too many extra steps. It seems pretty fragile to start with,
and the last thing I want to do is corrupt my listings database somehow.

Perhaps this would be better addressed by that long-delayed project to
have Myth run maintenance jobs only when the system is idle?

_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


dyoderatucsd at gmail

Oct 22, 2009, 8:06 PM

Post #8 of 21 (2023 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
David Brodbeck wrote:
> Michael T. Dean wrote:
>> You still can use the suggested time.
>>
>> http://www.gossamer-threads.com/lists/mythtv/users/403815#403815
>>
>> Perhaps one of you who actually goes to the trouble of setting it up
>> will post the script and specific instructions.
>
> Thanks, Mike. I'll think about it, but I'm leery of putting this data
> through too many extra steps. It seems pretty fragile to start with,
> and the last thing I want to do is corrupt my listings database somehow.
>
> Perhaps this would be better addressed by that long-delayed project to
> have Myth run maintenance jobs only when the system is idle?
I'm working on my version of the script--just as soon as I have a few
minutes to myself. :)

--David
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


dyoderatucsd at gmail

Oct 23, 2009, 2:38 AM

Post #9 of 21 (2011 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
Michael T. Dean wrote:
> The closest you could get to this is
>
> a) Install xmltv
> b) Set up tv_grab_na_dd
> c) Write a script that uses tv_grab_na_dd to get the "raw" (DD--don't
> have it convert to XMLTV format or it will take more processor time
> /and/ will result in your getting less useful data for each program)
> and save it somewhere (sorry, I forgot the argument that specifies
> this, but it should be available in the --help output)
> d) Change the setting, "mythfilldatabase Program" (in General settings
> of mythtv-setup in trunk or in mythfrontend settings for -fixes) to
> specify the full path to the script you wrote (and ensure the user
> running the backend has appropriate permissions to read and execute it
> and the directories leading to it). Then, mythbackend will run your
> script instead of mythfilldatabase.
> e) Set up a cron job to run mythfilldatabase --dd-file <sourceid>
> <offset> <lineupid> <xmlfile> (for each video source you've set up).
>
> Oh, and thanks for asking how to do it right rather than just setting
> up a cron job and ignoring the provider-suggested time.
>
> Mike
> _______________________________________________
> mythtv-users mailing list
> mythtv-users [at] mythtv
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
So I've written the scripts (all 20 lines of them) and am testing them.
The only thing that eludes me at this moment is how now to get mythtv to
respect the suggested grab time, since I've changed the mythfilldatabase
Program setting to my script. Maybe it's because I'm running an older
version of xmltv (it was already installed on my knoppmyth R5 dist.),
but the only reference I see to it is the --list-times option in the
tv_grab_na_dd manual, which simply reports the time to stderr. I've
scanned through the DD data for any reference to it, and don't see it,
but I could be wrong. Is there anything I need to do at this point? Thanks!

--David
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


dyoderatucsd at gmail

Oct 24, 2009, 10:27 AM

Post #10 of 21 (1960 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
David Yoder wrote:
> So I've written the scripts (all 20 lines of them) and am testing them.
> The only thing that eludes me at this moment is how now to get mythtv to
> respect the suggested grab time, since I've changed the mythfilldatabase
> Program setting to my script. Maybe it's because I'm running an older
> version of xmltv (it was already installed on my knoppmyth R5 dist.),
> but the only reference I see to it is the --list-times option in the
> tv_grab_na_dd manual, which simply reports the time to stderr. I've
> scanned through the DD data for any reference to it, and don't see it,
> but I could be wrong. Is there anything I need to do at this point?
> Thanks!
>
> --David

I've had a chance to let things run for a day or two, and it seems my
fear has been realized. My grabber script, as called by mythtv through
the mythfilldatabase Program setting, now runs every three hours. It
appears I need to find a way to pass the suggested time from my script
to myth. How does mythfilldatabase usually do this? Logs don't seem to
make any mention of it, so I'm getting kind of stuck here.

--David
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


mtdean at thirdcontact

Oct 24, 2009, 10:57 PM

Post #11 of 21 (1966 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
On 10/24/2009 01:27 PM, David Yoder wrote:
> David Yoder wrote:
>> So I've written the scripts (all 20 lines of them) and am testing them.
>> The only thing that eludes me at this moment is how now to get mythtv to
>> respect the suggested grab time, since I've changed the mythfilldatabase
>> Program setting to my script. Maybe it's because I'm running an older
>> version of xmltv (it was already installed on my knoppmyth R5 dist.),
>> but the only reference I see to it is the --list-times option in the
>> tv_grab_na_dd manual, which simply reports the time to stderr. I've
>> scanned through the DD data for any reference to it, and don't see it,
>> but I could be wrong. Is there anything I need to do at this point?
>> Thanks!
> I've had a chance to let things run for a day or two, and it seems my
> fear has been realized. My grabber script, as called by mythtv through
> the mythfilldatabase Program setting, now runs every three hours. It
> appears I need to find a way to pass the suggested time from my script
> to myth. How does mythfilldatabase usually do this? Logs don't seem to
> make any mention of it, so I'm getting kind of stuck here.

You'll need to update a setting in the database. It's the setting,
"MythFillSuggestedRunTime" and should have a format such as
"2009-10-25T19:16:30".

The best way to set it is to use the MythXML interface. It takes care
of properly flushing the settings cache to ensure the backend uses the
value. You can use it in a command-line script by simply sending an
HTTP request with wget or curl or whatever.

wget -O result.xml
'http://localhost:6544/Myth/PutSetting?HostName=&Key=MythFillSuggestedRunTime&Value=2009-10-25T19:16:30'

Note the blank value for HostName. It's critical that you put that there.

Sorry I forgot to mention that in the first place.

Mike
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


dyoderatucsd at gmail

Oct 25, 2009, 2:35 AM

Post #12 of 21 (1959 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
Michael T. Dean wrote:
> You'll need to update a setting in the database. It's the setting,
> "MythFillSuggestedRunTime" and should have a format such as
> "2009-10-25T19:16:30".
>
> The best way to set it is to use the MythXML interface. It takes care
> of properly flushing the settings cache to ensure the backend uses the
> value. You can use it in a command-line script by simply sending an
> HTTP request with wget or curl or whatever.
>
> wget -O result.xml
> 'http://localhost:6544/Myth/PutSetting?HostName=&Key=MythFillSuggestedRunTime&Value=2009-10-25T19:16:30'
>
>
> Note the blank value for HostName. It's critical that you put that
> there.
>
> Sorry I forgot to mention that in the first place.
>
> Mike

OK, looks like I'm cooking with gas now! Thanks, btw, for your help
pointing me in the right direction. I rewrote the grabber script in perl
to simplify things and, quite frankly, because it looks neater (to me).
Below is what I have done on my system. Mind you, this is setup for a
single lineup. It's a relatively minor change in the scripts to be able
to iterate over a list of lineups, if one needs to add that.

1) Ran /usr/bin/tv_grab_na_dd --configure
2) Changed the mythfilldatabase command in the MythTV settings (on my
system, it's under General settings, mythfilldatabase Program in the
setup on the frontend) to /usr/bin/my_grab.pl (see below for that script).
3) Added a cron job for /usr/bin/my_mythfilldatabase.sh (also see below
for script) to run at a time of my choosing, 4 a.m. (I.e., ran crontab
-e as mythtv and added the line "0 4 * * *
/usr/bin/my_mythfilldatabase.sh" without the quotes, of course)
4) Started enjoying my new life without worrying about mythfilldatabase
bogging things down at inopportune times!

I sincerely hope this will help anyone else who may be in my shoes.

--David


-------START my_grab.pl-------

#!/usr/bin/perl

use POSIX qw(strftime);
use LWP::Simple;

$backend_host = "localhost";
$dumpdir = "/tmp/dd_dumps";
$xmlconf = "/home/mythtv/.xmltv/tv_grab_na_dd.conf";
$grabcmd = "/usr/bin/tv_grab_na_dd";
$dumpfile = strftime ("%Y%m%d", localtime() ) . "_$$";

unless ( -d $dumpdir ) {
mkdir("$dumpdir", 0755) || die $!;
}

system("rm -f $dumpdir/*");

$grabargs = join(" ",
"--config-file $xmlconf",
"--days 14",
"--download-only",
"--list-times",
"--dd-data $dumpdir/$dumpfile"
);

open(GRAB, "$grabcmd $grabargs 2>&1 |");
open(LOG, ">$dumpdir/grab.log") || die $!;
while (<GRAB>) {
print;
print LOG;
$sugtime = $1 if /^suggestedTime\s*\|(.*)$/;
}
close(GRAB);

$xmlres =
get("http://$backend_host:6544/Myth/PutSetting?HostName=&Key=MythFillSuggestedRunTime&Value=$sugtime");
print $xmlres . "\n";
print LOG $xmlres . "\n";

symlink("$dumpdir/$dumpfile", "$dumpdir/dd_data.raw");

-------END my_grab.pl-------

-------START my_mythfilldatabase.sh-------

#!/bin/sh

# Change the following line to the location of your config file
xmlconf="/home/mythtv/.xmltv/tv_grab_na_dd.conf"

lineupid=`grep "lineup:" $xmlconf|awk '{print $2}'`

[ -f /tmp/dd_dumps/dd_data.raw ] && /usr/bin/mythfilldatabase --dd-file
1 -1 $lineupid /tmp/dd_dumps/dd_data.raw

-------END my_mythfilldatabase.sh-------
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


mtdean at thirdcontact

Oct 25, 2009, 5:52 AM

Post #13 of 21 (1938 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
On 10/25/2009 05:35 AM, David Yoder wrote:
> Michael T. Dean wrote:
>> You'll need to update a setting in the database. It's the setting,
>> "MythFillSuggestedRunTime" and should have a format such as
>> "2009-10-25T19:16:30".
>>
>> The best way to set it is to use the MythXML interface. It takes
>> care of properly flushing the settings cache to ensure the backend
>> uses the value. You can use it in a command-line script by simply
>> sending an HTTP request with wget or curl or whatever.
>>
>> wget -O result.xml
>> 'http://localhost:6544/Myth/PutSetting?HostName=&Key=MythFillSuggestedRunTime&Value=2009-10-25T19:16:30'
>>
>>
>> Note the blank value for HostName. It's critical that you put that
>> there.
>>
>> Sorry I forgot to mention that in the first place.
> OK, looks like I'm cooking with gas now! Thanks, btw, for your help
> pointing me in the right direction. I rewrote the grabber script in
> perl to simplify things and, quite frankly, because it looks neater
> (to me). Below is what I have done on my system. Mind you, this is
> setup for a single lineup. It's a relatively minor change in the
> scripts to be able to iterate over a list of lineups, if one needs to
> add that.
...
> I sincerely hope this will help anyone else who may be in my shoes.
>

This looks great. If I can figure out a way (or you can) to easily
support multiple lineups/video sources, I may make a few modifications
(multiple lineups, command-line args with Getopt::Long, and rolling both
scripts into one with different behaviors triggered by arguments) and
see about putting it into contrib, as I'm sure there are several people
who would like control over when the database-filling side of the
process occurs. (Then again, if you have any ideas and get around to it
before me, I won't complain. :)

Thanks,
Mike
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


dyoderatucsd at gmail

Oct 25, 2009, 7:05 AM

Post #14 of 21 (1937 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
On 10/25/09, Michael T. Dean <mtdean [at] thirdcontact> wrote:
> This looks great. If I can figure out a way (or you can) to easily
> support multiple lineups/video sources, I may make a few modifications
> (multiple lineups, command-line args with Getopt::Long, and rolling both
> scripts into one with different behaviors triggered by arguments) and
> see about putting it into contrib, as I'm sure there are several people
> who would like control over when the database-filling side of the
> process occurs. (Then again, if you have any ideas and get around to it
> before me, I won't complain. :)
>
> Thanks,
> Mike

I'd be happy to take another look as soon as I get back into
town--that was the rush, I'm going to Disney World for the week :)
Unfortunately, I won't have access to my myth box until I get back (I
once had remote ssh turned on, but unfortunately some idiot managed to
break into the box and run a few scripts on my box, so I've since
locked the machine down tight once again). But when that happens, I'd
love to roll it up into one script. To be honest, I considered doing
that, but since I originally wrote the script in bash, I had written
it as two separate scripts and only bothered to rewrite the one to try
to get it done in time before I left :P

Thanks again for all your help. I'll check back with the list as soon
as I say goodbye to Mickey and all his friends.

--David
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


mtdean at thirdcontact

Oct 25, 2009, 10:27 AM

Post #15 of 21 (1919 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
On 10/25/2009 10:05 AM, David Yoder wrote:
> Unfortunately, I won't have access to my myth box until I get back (I
> once had remote ssh turned on, but unfortunately some idiot managed to
> break into the box and run a few scripts on my box, so I've since
> locked the machine down tight once again).

I'm a huge fan of fwknop/SPA for that. http://www.cipherdyne.org/fwknop/

My port 22 is closed until I send the right encrypted package to the
system. Then, it dynamically opens port 22 for requests from the IP I
used for 30 seconds--just long enough to establish a TCP connection
(which will persist even after the port is blocked again). It's amazing
how much smaller my btmp file is since switching. I even use it for
dynamically forwarding port 443 to port 22 for 30 seconds when I'm at a
hotel with, "Free high-speed Internet," that closes all connections to
any ports other than 80 and 443--i.e. hotels that should advertise,
"Free high-speed web," as they're really attempting to block all non-web
Internet traffic.

Have fun at Disney (just down the road from here :).

Mike
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


dyoderatucsd at gmail

Nov 3, 2009, 3:20 AM

Post #16 of 21 (1781 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
Michael T. Dean wrote:
> I'm a huge fan of fwknop/SPA for that. http://www.cipherdyne.org/fwknop/
>
> My port 22 is closed until I send the right encrypted package to the
> system. Then, it dynamically opens port 22 for requests from the IP I
> used for 30 seconds--just long enough to establish a TCP connection
> (which will persist even after the port is blocked again). It's amazing
> how much smaller my btmp file is since switching. I even use it for
> dynamically forwarding port 443 to port 22 for 30 seconds when I'm at a
> hotel with, "Free high-speed Internet," that closes all connections to
> any ports other than 80 and 443--i.e. hotels that should advertise,
> "Free high-speed web," as they're really attempting to block all non-web
> Internet traffic.
>
> Have fun at Disney (just down the road from here :).
>
> Mike
> _______________________________________________
> mythtv-users mailing list
> mythtv-users [at] mythtv
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>

Hey, Mike. Back from Disney World, and had a chance to rework the
script. I've got a working version of it, barely tested with two
lineups. Unfortunately, I'm not known for my clean coding style, but if
you'd like to take a look I'd be happy to pass it along. Can I attach
files on this mailing list (sorry for the total newbie questions!)? Or
what's the best way to get it across at this point?

--David
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


mtdean at thirdcontact

Nov 3, 2009, 3:39 AM

Post #17 of 21 (1773 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
On 11/03/2009 06:20 AM, David Yoder wrote:
> Hey, Mike. Back from Disney World, and had a chance to rework the
> script. I've got a working version of it, barely tested with two
> lineups. Unfortunately, I'm not known for my clean coding style, but
> if you'd like to take a look I'd be happy to pass it along. Can I
> attach files on this mailing list (sorry for the total newbie
> questions!)? Or what's the best way to get it across at this point?

Sure. Attached is fine. Or feel free to send direct to me for now
(just make sure you use the same subject so it won't get lost).

Thanks,
Mike
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


dyoderatucsd at gmail

Nov 9, 2009, 11:08 AM

Post #18 of 21 (1697 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
Michael T. Dean wrote:
> On 11/03/2009 06:20 AM, David Yoder wrote:
>> Hey, Mike. Back from Disney World, and had a chance to rework the
>> script. I've got a working version of it, barely tested with two
>> lineups. Unfortunately, I'm not known for my clean coding style, but
>> if you'd like to take a look I'd be happy to pass it along. Can I
>> attach files on this mailing list (sorry for the total newbie
>> questions!)? Or what's the best way to get it across at this point?
>
> Sure. Attached is fine. Or feel free to send direct to me for now
> (just make sure you use the same subject so it won't get lost).
>
> Thanks,
> Mike
> _______________________________________________
> mythtv-users mailing list
> mythtv-users [at] mythtv
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

Did you get my last message, by any chance? I sent it directly to you.
In case not, here's a copy of the script I have written, which so far is
working for me. Sorry to be a nag!

--David
Attachments: my_mythfilldb.pl (6.34 KB)


mtdean at thirdcontact

Nov 10, 2009, 4:17 PM

Post #19 of 21 (1672 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
On 11/09/2009 02:08 PM, David Yoder wrote:
> Michael T. Dean wrote:
>> On 11/03/2009 06:20 AM, David Yoder wrote:
>>> Hey, Mike. Back from Disney World, and had a chance to rework the
>>> script. I've got a working version of it, barely tested with two
>>> lineups. Unfortunately, I'm not known for my clean coding style, but
>>> if you'd like to take a look I'd be happy to pass it along. Can I
>>> attach files on this mailing list (sorry for the total newbie
>>> questions!)? Or what's the best way to get it across at this point?
>>
>> Sure. Attached is fine. Or feel free to send direct to me for now
>> (just make sure you use the same subject so it won't get lost).
> Did you get my last message, by any chance? I sent it directly to you.
> In case not, here's a copy of the script I have written, which so far is
> working for me. Sorry to be a nag!

Yeah, I did get it--I just haven't had a chance to go through it, yet.

Thanks,
Mike
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


dyoderatucsd at gmail

Nov 10, 2009, 5:21 PM

Post #20 of 21 (1665 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
Michael T. Dean wrote:
> On 11/09/2009 02:08 PM, David Yoder wrote:
>> Michael T. Dean wrote:
>>> On 11/03/2009 06:20 AM, David Yoder wrote:
>>>> Hey, Mike. Back from Disney World, and had a chance to rework the
>>>> script. I've got a working version of it, barely tested with two
>>>> lineups. Unfortunately, I'm not known for my clean coding style,
>>>> but if you'd like to take a look I'd be happy to pass it along. Can
>>>> I attach files on this mailing list (sorry for the total newbie
>>>> questions!)? Or what's the best way to get it across at this point?
>>>
>>> Sure. Attached is fine. Or feel free to send direct to me for now
>>> (just make sure you use the same subject so it won't get lost).
>> Did you get my last message, by any chance? I sent it directly to you.
>> In case not, here's a copy of the script I have written, which so far is
>> working for me. Sorry to be a nag!
>
> Yeah, I did get it--I just haven't had a chance to go through it, yet.
>
> Thanks,
> Mike
> _______________________________________________
> mythtv-users mailing list
> mythtv-users [at] mythtv
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Alright, no problem. I understand you are a very busy man. Just wanted
to make sure you got my email. BTW, I found a typo or two in the one I
sent to you directly, and I have corrected them, so you might want to
ditch that for the one I sent more recently. I'll leave you to your
business. Take care.

--David
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


mtdean at thirdcontact

May 12, 2010, 9:57 PM

Post #21 of 21 (1160 views)
Permalink
Re: Question about mythfilldatabase? [In reply to]
On 11/10/2009 08:21 PM, David Yoder wrote:
> Michael T. Dean wrote:
>> On 11/09/2009 02:08 PM, David Yoder wrote:
>>> Michael T. Dean wrote:
>>>> On 11/03/2009 06:20 AM, David Yoder wrote:
>>>>> Hey, Mike. Back from Disney World, and had a chance to rework the
>>>>> script. I've got a working version of it, barely tested with two
>>>>> lineups. Unfortunately, I'm not known for my clean coding style,
>>>>> but if you'd like to take a look I'd be happy to pass it along.
>>>>> Can I attach files on this mailing list (sorry for the total
>>>>> newbie questions!)? Or what's the best way to get it across at
>>>>> this point?
>>>> Sure. Attached is fine. Or feel free to send direct to me for now
>>>> (just make sure you use the same subject so it won't get lost).
>>> Did you get my last message, by any chance? I sent it directly to you.
>>> In case not, here's a copy of the script I have written, which so
>>> far is
>>> working for me. Sorry to be a nag!
>> Yeah, I did get it--I just haven't had a chance to go through it, yet.
> Alright, no problem. I understand you are a very busy man. Just wanted
> to make sure you got my email. BTW, I found a typo or two in the one I
> sent to you directly, and I have corrected them, so you might want to
> ditch that for the one I sent more recently. I'll leave you to your
> business. Take care.

David,

Are you still using this script? I still think this would be a very
useful script for a lot of people. And if you've been using it since
the end of October, I'm sure it's been well tested and is in pretty good
shape, now.

However, since I mentioned adding it to contrib (
http://www.gossamer-threads.com/lists/mythtv/users/404185#404185 ),
we've made a change to the plan for contrib--we're actually moving
contrib scripts out of the contrib directory and putting them in the
wiki where they're easier for their authors to maintain. So, I'd love
for you to add a page to the wiki for the script (complete with an
explanation of why someone might want to use it--like you gave in
http://www.gossamer-threads.com/lists/mythtv/users/403803#403803 ).

Note, also, that trunk MythTV (which, when released as 0.24, will be the
first release with the "lean/mean contrib directory") has support in the
Python bindings for automatically downloading scripts out of the wiki
pages, so it will be easy for users to access.

You can either put the code directly in the wiki page or set up a
project at Google Code or SourceForge or wherever and link to the code
from the wiki page. Please put the wiki page into the Scripts category
( http://www.mythtv.org/wiki/Category:Scripts ). Feel free to ask here
or on IRC for help creating the wiki page and getting it into the
category and set up to allow the auto-download.

Here's a link to the script you posted on the list, just in case.
http://www.gossamer-threads.com/lists/mythtv/users/406707#406707

Thanks,
Mike

_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

MythTV users RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.