Gossamer Forum
Home : Products : Gossamer Links : Development, Plugins and Globals :

Re: [Dinky] Andy's Spider Bug??

Quote Reply
Re: [Dinky] Andy's Spider Bug?? In reply to
Hi. It should be as simple as editing /admin/Plugins/Spider.pm;

Code:
sub extract_links {
my ($tag, %attr) = @_;

if ($tag eq 'a') { #or $tag eq 'img'
foreach my $key (keys %attr) {
if ($key eq 'href' or $key eq 'src') {
my $link_url = URI->new($attr{$key});
my $full_url = $link_url->abs($base_url);
if ($full_url !~ /\.cgi/i) {
push(@urls,$full_url);
} else {
push(@unused_urls,$full_url);
}
}
}
}
}

...to

Code:
sub extract_links {
my ($tag, %attr) = @_;

if ($tag eq 'a') { #or $tag eq 'img'
foreach my $key (keys %attr) {
if ($key eq 'href' or $key eq 'src') {
my $link_url = URI->new($attr{$key});
my $full_url = $link_url->abs($base_url);
push(@urls,$full_url);
}
}
}
}
}

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Subject Author Views Date
Thread Andy's Spider Bug?? Dinky 3766 Apr 29, 2004, 7:21 PM
Thread Re: [Dinky] Andy's Spider Bug??
Andy 3667 Apr 30, 2004, 1:07 AM
Thread Re: [Andy] Andy's Spider Bug??
pugdog 3673 Apr 30, 2004, 4:19 AM
Thread Re: [pugdog] Andy's Spider Bug??
Andy 3652 Apr 30, 2004, 5:41 AM
Post Re: [Andy] Andy's Spider Bug??
Dinky 3651 Apr 30, 2004, 5:49 AM
Thread Re: [Dinky] Andy's Spider Bug??
katabd 3665 Apr 30, 2004, 7:23 AM
Thread Re: [katabd] Andy's Spider Bug??
Andy 3659 Apr 30, 2004, 8:01 AM
Thread Re: [Andy] Andy's Spider Bug??
katabd 3649 Apr 30, 2004, 8:33 AM
Thread Re: [katabd] Andy's Spider Bug??
Dinky 3628 Apr 30, 2004, 7:11 PM
Thread Re: [Dinky] Andy's Spider Bug??
Andy 3625 May 1, 2004, 1:29 AM
Thread Re: [Andy] Andy's Spider Bug??
Dinky 3571 Jun 26, 2004, 6:37 PM
Post Re: [Dinky] Andy's Spider Bug??
Andy 3557 Jun 27, 2004, 3:48 AM