Gossamer Forum
Home : Products : Gossamer Links : Development, Plugins and Globals :

Re: [Dinky] Andy's Spider Bug??

Quote Reply
Re: [Dinky] Andy's Spider Bug?? In reply to
Quote:
Second question,
Some links come back with:
The following URL's have been grabbed, but were decided that they were not suitable for spidering;

Yeah, they are links that are unsuitable to be spidered (.asp, .pl, .cgi, etc). The reason I put that in, is so it will scan out weird URL's, such as javascript: and mailto:.

Quote:
What if I want to spider it anyway, there is no option or way of doing it???

I may write these URL's to a file, and then at the end of the process, give the option to scan the checked URL's from that list too. Not easy, but I'll have a look into it (not guaranteeing anything this week though I'm afraid, as I'm totally booked up).

Quote:
Also, as a future update, how hard would it be to have an admin function that once you have spidered all the links, you can click a check box or something and then click add, and it will add all of the clicked spidered links into the category you selected instead of individually???

I'm not sure this is possible. When you click 'add' on the current plugin, it will give you the list of fields, pre populated... ready to have a category assigned, and added. The problem is, that if any errors turn up (i.e you forget to assign a category), it will give a fatal GT::SQL:;error, and the whole process will die :(

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Subject Author Views Date
Thread Andy's Spider Bug?? Dinky 3766 Apr 29, 2004, 7:21 PM
Thread Re: [Dinky] Andy's Spider Bug??
Andy 3667 Apr 30, 2004, 1:07 AM
Thread Re: [Andy] Andy's Spider Bug??
pugdog 3673 Apr 30, 2004, 4:19 AM
Thread Re: [pugdog] Andy's Spider Bug??
Andy 3652 Apr 30, 2004, 5:41 AM
Post Re: [Andy] Andy's Spider Bug??
Dinky 3651 Apr 30, 2004, 5:49 AM
Thread Re: [Dinky] Andy's Spider Bug??
katabd 3665 Apr 30, 2004, 7:23 AM
Thread Re: [katabd] Andy's Spider Bug??
Andy 3659 Apr 30, 2004, 8:01 AM
Thread Re: [Andy] Andy's Spider Bug??
katabd 3649 Apr 30, 2004, 8:33 AM
Thread Re: [katabd] Andy's Spider Bug??
Dinky 3628 Apr 30, 2004, 7:11 PM
Thread Re: [Dinky] Andy's Spider Bug??
Andy 3626 May 1, 2004, 1:29 AM
Thread Re: [Andy] Andy's Spider Bug??
Dinky 3571 Jun 26, 2004, 6:37 PM
Post Re: [Dinky] Andy's Spider Bug??
Andy 3557 Jun 27, 2004, 3:48 AM