Post away :)

For reference here is the original thread:

http://www.gossamer-threads.com/...orum_view_collapsed;

Thanks Paul...
I've updated the zip for gofetch 2.2 since it was brought to my attention that gofetch.cgi wasn't set up to use default Links fields. I don't know if this happened to all but i fixed it anyway. Still trying to find out about that Unknown Tag business.
Lavon Russell
LookHard Mods
lavon@lh.links247.net

Works great.

I'm using revised 2.2 with no problems at all now. Great to have the spider web url feature now

I updated my links with the newer template parser as was suggested to me and put

message => $message,

in the globals part of site html templates and have had no more unknown tag problems.

So glad to have this working, its going to be a real boost to my links setup.

Where is the page to download 2.2 ?

http://lh.links247.net/downloads
Lavon Russell
LookHard Mods
lavon@lh.links247.net

Hi Bmxer, is this script working now?

I don't know. Works for me. Have you tried it lately?
Lavon Russell
LookHard Mods
lavon@lh.links247.net

 
I will try it, btw, how do I set it up so that it ignores specific (non-dmz) URL's in the page that is to be spidered...? Thx!

This is explained in the script. There is an array at the top of gofetch.cgi that is called ForbidSites. Just follow the format of the other urls in the array.
Lavon Russell
LookHard Mods
lavon@lh.links247.net

fatal error: Label not found for "next LINE" at /home/public_html/cgi-bin/admin/site_html_templates.pl line 1088.

Anyone else getting this?

What does the code look like near there?

It is a loop problem not being labeled like:

LINE: while (@bla) {

oops, sorry. under
sub customcatlist in site_html_templates
where you see
foreach $db (@db) {
change it to
LINE: foreach $db (@db) {

Lavon Russell
LookHard Mods
lavon@lh.links247.net

Works! Thanks......

Strange this -

Getting this message: Unkown Tag: message

and when it comes to the spidering I am getting:

http://http://dmoz.org/Regional/Europe/United_Kingdom/England/

in the URL field instead of the actual link I want ie

http://www.manchester.co.uk

add message => $message, to the globals in site_html_templates.pl.

When does that http://http:// problem happen? when spidering web urls, or a dmoz cat? send me your gofetch.cgi and site_html_templates.pl. webmaster@lh.links247.net
Lavon Russell
LookHard Mods
lavon@lh.links247.net

gofetch.cgi is fine - works no problem

it's the dmoz.cgi one

When I added message => $message into site_html_templates.pl it didn't seem to work at all with dmoz.cgi now!

I will e-mail you site_html_templates.pl and dmoz.cgi if that's okay?

Thanks for doing this :)

Yeah, email me those files please and the url to where dmoz.cgi is doing this. If i need admin access, i'd also need a temporary .htaccess name and password.
Lavon Russell
LookHard Mods
lavon@lh.links247.net

Cool, just e-mailed it over... :) Thanks!

I didn't get it. try emailing to bmxer@lh.links247.net
Oh, to fix the message unknown tag thing, you also need to have the enhanced template parser installed.
Lavon Russell
LookHard Mods
lavon@lh.links247.net

Okay - sent it to that other e-mail address....

I have the new template parser installed ;)

ugh!!!!!!!!
sorry boomboom, i did it twice.
i see now why i didn't receive any of the mail.
its not lavon@lh.links247.net
its lavon@links247.net
sorry. thats like the 10th time i made that mistake so far.
Lavon Russell
LookHard Mods
lavon@lh.links247.net

Okay! Tried again ;)

I updated the zip for 2.2. It has a fix to the template returning in dmoz.cgi. Thats pretty much the only file to replace. I also added message => $message, to all the gofetch subs. It was in some, but not all. specifically sub get_dmoz and get_url.
I think thats why the unknown tags came up. So just add that tag to those.
Lavon Russell
LookHard Mods
lavon@lh.links247.net

Does it solve the problem of the double http://http:// ? And did you notice how it didn't spider the URL's correctly and put in, for example, http://http://dmoz/thiscat/cat/cat etc instead of the actual site URL?

ok above, you said gofetch.cgi is fine works no problem. Which script does it, at which point does it do it? and i don't see why it would say http://dmoz...
if you're spidering urls. I could understand if i did that when spidering index cats. btw... i sent you an email with an updated dmoz.cgi and site_html_templates.pl
I just spidered a dmoz cat and all links came out good. The link to the main site(category i was spidering came out fine) and at the bottom of the page where it says ## links spidered to http://dmoz.org/.../... came out fine.
Lavon Russell
LookHard Mods
lavon@lh.links247.net