Gossamer Forum
Quote Reply
GT's Spider Plugin
I'm using GT Links SQL 2.1.0.

GT's Spider plug-in is working great, except I can't do any bulk operations.

Any ideas why this might be happening?

Here is the forum from the source code.

<form action="Plugins/Spider/nph-sets.cgi">
<input type="hidden" name="do" value="plugin">
<input type="hidden" name="plugin" value="Spider">
<input type="hidden" name="func" value="set_manipulate">

<font face="Tahoma,Arial,Helvetica" size="2">

<select size="1" name="db">
<option value="Spider_Hosts">Hosts</option>
<option value="Spider_Links">Links</option>
<option value="Spider_Queue">Queue</option>
<option value="Spider_Rejected">Rejected</option>
<option value="Spider_Rules">Rules</option>
<option value="Spider_Validate">Validate</option>
<input type="submit" value="Go">


Thanks, April

A. Lougheed
Quote Reply
Re: [aprillougheed] GT's Spider Plugin In reply to
Also - does anyone know how to prevent the spider from queing robot.txt files?

I tried to write a rule . . . but I don't know what I'm doing, so I couldn't make it ignore robot.txt files.

Thanks so much, April
A. Lougheed