Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: MythTV: Users

Problem with Apple Trailer Grabber

 

 

MythTV users RSS feed   Index | Next | Previous | View Threaded


jayf0ster at sbcglobal

Aug 21, 2009, 8:22 AM

Post #1 of 7 (2298 views)
Permalink
Problem with Apple Trailer Grabber

I'm using the Ben Leto Apple Trailer Grabber script to download the
Apple movie trailers. Last night, it started failing. I am using it in
the download mode. The script seems to run correctly and produces a
valid appletrailer.xml file, but the movie trailer files themselves fail
to download. After some investigation, I discovered that the
'system("/usr/bin/wget --quiet $movieLink");' line is really downloading
a file called "index.html" instead of the movie trailer file. The value
of $movieLink is correct (ie, not "index.html"). Any one else having
this problem?

In looking into this, I also made some modifications to the
myth_trailers_grabber script to detect and report these errors properly
in the appletrailer.xml file.

Jay

_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


jarpublic at gmail

Aug 21, 2009, 8:29 AM

Post #2 of 7 (2253 views)
Permalink
Re: Problem with Apple Trailer Grabber [In reply to]

> I'm using the Ben Leto Apple Trailer Grabber script to download the Apple
> movie trailers.  Last night, it started failing.  I am using it in the
> download mode.  The script seems to run correctly and produces a valid
> appletrailer.xml file, but the movie trailer files themselves fail to
> download.  After some investigation, I discovered that the
> 'system("/usr/bin/wget --quiet $movieLink");' line is really downloading a
> file called "index.html" instead of the movie trailer file.  The value of
> $movieLink is correct (ie, not "index.html").  Any one else having this
> problem?
>
> In looking into this, I also made some modifications to the
> myth_trailers_grabber script to detect and report these errors properly in
> the appletrailer.xml file.

Apple changed stuff yesterday when they released the Avatar trailer.
Now you can only download from quicktime. If you are able to change it
so that you can give the quicktime user agent then you will be allowed
to download again. I know you can do it with wget:
http://www.hd-trailers.net/blog/2009/08/20/direct-download-links-from-apple-are-not-working/
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


tom at graniteskies

Aug 21, 2009, 12:53 PM

Post #3 of 7 (2235 views)
Permalink
Re: Problem with Apple Trailer Grabber [In reply to]

On Fri, Aug 21, 2009 at 10:29 AM, Johnny <jarpublic [at] gmail> wrote:

> > I'm using the Ben Leto Apple Trailer Grabber script to download the Apple
> > movie trailers. Last night, it started failing. I am using it in the
> > download mode. The script seems to run correctly and produces a valid
> > appletrailer.xml file, but the movie trailer files themselves fail to
> > download. After some investigation, I discovered that the
> > 'system("/usr/bin/wget --quiet $movieLink");' line is really downloading
> a
> > file called "index.html" instead of the movie trailer file. The value of
> > $movieLink is correct (ie, not "index.html"). Any one else having this
> > problem?
> >
> > In looking into this, I also made some modifications to the
> > myth_trailers_grabber script to detect and report these errors properly
> in
> > the appletrailer.xml file.
>
> Apple changed stuff yesterday when they released the Avatar trailer.
> Now you can only download from quicktime. If you are able to change it
> so that you can give the quicktime user agent then you will be allowed
> to download again. I know you can do it with wget:
>
> http://www.hd-trailers.net/blog/2009/08/20/direct-download-links-from-apple-are-not-working/
> _______________________________________________
> mythtv-users mailing list
> mythtv-users [at] mythtv
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>

Is there anyway of modifying it to download from Yahoo instead of / in
addition to Apple? Not that it helps with the Avatar trailer, but.

Speaking of Avatar, I was really irked to find I couldn't even watch the
trailer in Firefox using mplayer and gecko-mediaplayer.


mtdean at thirdcontact

Aug 21, 2009, 1:15 PM

Post #4 of 7 (2226 views)
Permalink
Re: Problem with Apple Trailer Grabber [In reply to]

On 08/21/2009 11:29 AM, Johnny wrote:
>> I'm using the Ben Leto Apple Trailer Grabber script to download the Apple
>> movie trailers. Last night, it started failing. I am using it in the
>> download mode. The script seems to run correctly and produces a valid
>> appletrailer.xml file, but the movie trailer files themselves fail to
>> download. After some investigation, I discovered that the
>> 'system("/usr/bin/wget --quiet $movieLink");' line is really downloading a
>> file called "index.html" instead of the movie trailer file. The value of
>> $movieLink is correct (ie, not "index.html"). Any one else having this
>> problem?
>>
>> In looking into this, I also made some modifications to the
>> myth_trailers_grabber script to detect and report these errors properly in
>> the appletrailer.xml file.
> Apple changed stuff yesterday when they released the Avatar trailer.
> Now you can only download from quicktime. If you are able to change it
> so that you can give the quicktime user agent then you will be allowed
> to download again. I know you can do it with wget:
> http://www.hd-trailers.net/blog/2009/08/20/direct-download-links-from-apple-are-not-working/

Please, do not discuss, here, how to circumvent the "protections" they
put on their content, especially until someone can show that the script
isn't already violating Apple's site's ToS (
http://www.apple.com/legal/terms/site.html ).

As it is, the script may be (I haven't looked at the script,
specifically) violating the portion that says:
---
You may not use any “deep-link”, “page-scrape”, “robot”, “spider” or
other automatic device, program, algorithm or methodology, or any
similar or equivalent manual process, to access, acquire, copy or
monitor any portion of the Site or any Content, or in any way reproduce
or circumvent the navigational structure or presentation of the Site or
any Content, to obtain or attempt to obtain any materials, documents or
information through any means not purposely made available through the
Site. Apple reserves the right to bar any such activity.
---

(where, IMHO (IANAL), the "automatic ... program" portion sounds a lot
like a script, the "copy ... any portion of the Site or any Content"
portion would be violated if anything (the actual trailers or even just
URI's and titles) is saved on the Myth box, and the "circumvent the
navigational structure or presentation of the Site or any Content"
portion would be violated if the script isn't simply taking you in a
browser to Apple's site)

However, since the terms /also/ say:
---
You may not forge headers or otherwise manipulate identifiers in order
to disguise the origin of any message or transmittal you send to Apple
on or through the Site or any service offered on or through the Site.
---
I can guarantee that changing the User-Agent string is a violation.

Mike

***Even if said "protection" is only a feeble attempt that can only
succeed through legal protections, such as their ToS.
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


ylee at pobox

Aug 21, 2009, 1:38 PM

Post #5 of 7 (2239 views)
Permalink
Re: Problem with Apple Trailer Grabber [In reply to]

Johnny <jarpublic [at] gmail> says:
> Apple changed stuff yesterday when they released the Avatar trailer.
> Now you can only download from quicktime. If you are able to change
> it so that you can give the quicktime user agent then you will be
> allowed to download again. I know you can do it with wget:
> http://www.hd-trailers.net/blog/2009/08/20/direct-download-links-from-apple-are-not-working/

Thanks for the pointer. Adding

-U QuickTime/7.6.2

to the wget line in the download script solves the issue. Delete the
extraneous index.html* files in the trailers' directory.

--
Frontend/backend: P4 3.0GHz, 1.5TB software RAID 5 array
Backend: Quad-core Xeon 1.6GHz, 6.6TB sw RAID 6
Video inputs: Four high-definition over FireWire/OTA
Accessories: 47" 1080p LCD, 5.1 digital, and MX-600
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


dlknight at sdf

Aug 22, 2009, 5:31 AM

Post #6 of 7 (2208 views)
Permalink
Re: Problem with Apple Trailer Grabber [In reply to]

On Fri, August 21, 2009 9:38 pm, Yeechang Lee wrote:
> Johnny <jarpublic [at] gmail> says:
>> Apple changed stuff yesterday when they released the Avatar trailer.
>> Now you can only download from quicktime. If you are able to change
>> it so that you can give the quicktime user agent then you will be
>> allowed to download again. I know you can do it with wget:
>> http://www.hd-trailers.net/blog/2009/08/20/direct-download-links-from-apple-are-not-working/
>
> Thanks for the pointer. Adding
>
> -U QuickTime/7.6.2
>
> to the wget line in the download script solves the issue. Delete the
> extraneous index.html* files in the trailers' directory.
>
> --
> Frontend/backend: P4 3.0GHz, 1.5TB software RAID 5 array
> Backend: Quad-core Xeon 1.6GHz, 6.6TB sw RAID 6
> Video inputs: Four high-definition over FireWire/OTA
> Accessories: 47" 1080p LCD, 5.1 digital, and MX-600
>
>

Script updated to 0.4.2.3 -
http://www.mythtv.ukpc.net/mythappletrailer-0.4.2.3.tar.gz

More information - http://www.mythtv.org/wiki/Myth_Apple_Trailers

NOTE: Use of this script may break Apple's TOS so your use of this script
is at your own choice. Full disclaimer is contained within the download.

http://www.apple.com/legal/terms/site.html




_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


jyavenard at gmail

Aug 25, 2009, 8:56 PM

Post #7 of 7 (1984 views)
Permalink
Re: Problem with Apple Trailer Grabber [In reply to]

Hi

2009/8/22 David Knight <dlknight [at] sdf>:
> Script updated to 0.4.2.3 -
> http://www.mythtv.ukpc.net/mythappletrailer-0.4.2.3.tar.gz
>

You may want to also change the user agent used by mplayer (required
in "stream" mode) as otherwise your script only works with download
mode
_______________________________________________
mythtv-users mailing list
mythtv-users [at] mythtv
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

MythTV users RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.