Gossamer Forum
(Advanced Search)
for
Home : General : Perl Programming :

Capture HTML from another domain name.

Oct 13, 2000, 1:05 AM
nduque
User (98 posts)
Oct 13, 2000, 1:05 AM
Post #1 of 12
Views: 7324
Shortcut
Quote Reply
Capture HTML from another domain name.
Dear,

I would like to know how can I capture data from another file on the web.
What I want to do is captures my local weather forecast station values everyday and put it in my home page with automatic refresh. I just need to capture in this case the <IMG SRC="../images/p6.gif" HEIGHT=78 WIDTH=64> and <CENTER><B><FONT COLOR="#0000ee">20 </FONT><SUP>o</SUP>C /<FONT COLOR="#FF0000">23 </FONT><SUP>o</SUP>C</B></CENTER> .

Source of the file of my weather station.
eg:
<html>
<head>

<TABLE WIDTH="100%" >
<TD WIDTH="50%">
<CENTER><B> <FONT COLOR="#1932cc"> October</FONT>/<FONT COLOR="#1932cc">13</FONT><FONT
COLOR="#FFFFFF"></FONT></B><BR></CENTER>
<CENTER><P><IMG SRC="../images/p6.gif" HEIGHT=78 WIDTH=64></P></CENTER>
<CENTER><B><FONT COLOR="#0000ee">22
</FONT><SUP>o</SUP>C /
<FONT COLOR="#FF0000">26
</FONT><SUP>o</SUP>C</B></CENTER>

</TD>
<TD WIDTH="50%">
<CENTER><B><FONT COLOR="#1932cc"> October</FONT>/<FONT
COLOR="#1932cc">14</FONT></B><BR></CENTER>
<CENTER><P><IMG SRC="../images/p6.gif" HEIGHT=78 WIDTH=64></P></CENTER>


<CENTER><B><FONT COLOR="#0000ee">20
</FONT><SUP>o</SUP>C /
<FONT COLOR="#FF0000">23
</FONT><SUP>o</SUP>C</B></CENTER>
</TD>
</TABLE>
</BODY>
</html>


Regards,

Nuno Duque
--------------------
Macau Search Engine
searchmacau.com
Oct 13, 2000, 8:17 AM
Stealth
Veteran (17240 posts)
Stealth's avatar
Oct 13, 2000, 8:17 AM
Post #2 of 12
Views: 7195
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
Use LWP:Simple or better yet create a copy of the file with only the codes that you want to appear in another web page and then use SSI calls.

Regards,

Eliot Lee

Oct 13, 2000, 9:33 AM
nduque
User (98 posts)
Oct 13, 2000, 9:33 AM
Post #3 of 12
Views: 7154
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
Thanks, I'll try it.


Regards,

Nuno Duque
--------------------
Macau Search Engine
searchmacau.com
Oct 13, 2000, 9:34 AM
Stealth
Veteran (17240 posts)
Stealth's avatar
Oct 13, 2000, 9:34 AM
Post #4 of 12
Views: 7153
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
You're welcome.

Regards,

Eliot Lee

Oct 13, 2000, 2:28 PM
nduque
User (98 posts)
Oct 13, 2000, 2:28 PM
Post #5 of 12
Views: 7129
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
I already fetch the HTML page at http://www.lookeasy.net/cgi-bin/weather.cgi, but how can I pick up the temperatures values only.


Regards,

Nuno Duque
--------------------
Macau Search Engine
searchmacau.com
Oct 13, 2000, 9:13 PM
jsu
User (381 posts)
Oct 13, 2000, 9:13 PM
Post #6 of 12
Views: 7147
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
if ($source =~ m!<FONT COLOR="#FF0000">(\d+)!) {
$temperature = $1;
}

Jerry Su
Oct 13, 2000, 11:43 PM
nduque
User (98 posts)
Oct 13, 2000, 11:43 PM
Post #7 of 12
Views: 7144
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
I make a new cgi called forecast.cgi using LWP::UserAgent instead of LWP::Simple and I use a variable like this,
$filter =~ s|</TD>
<TD WIDTH=\"50%\"(.*?)</BODY>|</b></table></body>|sig;
I made this way because it's more easy to track the HTML code changes.

See the new cgi working at http://www.lookeasy.net/cgi-bin/forecast.cgi

and compare to the old http://www.lookeasy.net/cgi-bin/weather.cgi

Now I just need to make it more nice and use SSI call.

Thanks for yours helps,


Regards,

Nuno Duque
--------------------
Macau Search Engine
searchmacau.com
Oct 13, 2000, 11:44 PM
nduque
User (98 posts)
Oct 13, 2000, 11:44 PM
Post #8 of 12
Views: 7189
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
Thanks, but I made it another way.


Regards,

Nuno Duque
--------------------
Macau Search Engine
searchmacau.com
Oct 17, 2000, 11:22 AM
TB2
Novice (48 posts)
Oct 17, 2000, 11:22 AM
Post #9 of 12
Views: 7107
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
Nice Script - is it possible to get this?



Oct 17, 2000, 12:58 PM
nduque
User (98 posts)
Oct 17, 2000, 12:58 PM
Post #10 of 12
Views: 7108
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
I made this script for my own and for sell but currently not finished yet, if you want to find something for free go to http://www.hotscripts.com/...her&category=all.

Regards,

Nuno Duque
--------------------
Macau Search Engine
inmacau.com
Oct 19, 2000, 12:47 AM
jackofnone
User (125 posts)
Oct 19, 2000, 12:47 AM
Post #11 of 12
Views: 7089
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
Any body interested in a php version than do mail me

Best Regs
JackofNone

Oct 22, 2000, 1:00 PM
pugdog
Veteran (6956 posts)
Oct 22, 2000, 1:00 PM
Post #12 of 12
Views: 7019
Shortcut
Quote Reply
Re: Capture HTML from another domain name. In reply to
The BEST weather script out there, IMHO, and suffering the same delays as Links SQL for it's next version (genious takes work!) is HamWeather.

If you run your own server, you can do just about anything with it. Literally, Anything.

Check out http://hamweather.com

I use it on http://postcards.com in a virtually unmodified form to include weather forecasts in our postcards, and it's very, very popular.



PUGDOGŪ
PUGDOGŪ Enterprises, Inc.
FAQ: http://postcards.com/FAQ