The new "beta" spider script can only be run by telnet or cron job. It times out if you try to run as a CGI.
The way it's supposed to be run is to trigger at an off hour every night, and run until it hits its stop parameters.
So, if you don't have telnet - or cron -, you really can't use this script -- at least at this time. I don't see why that would change, since the purpose of this script is to do a lot of crawling, and that wouldn't be done interactively ie: via cgi/html.
The only way to really put it through it's paces is with Telnet.
Links, once it's installed, can be managed through FTP and the HTML interface.
The way it's supposed to be run is to trigger at an off hour every night, and run until it hits its stop parameters.
So, if you don't have telnet - or cron -, you really can't use this script -- at least at this time. I don't see why that would change, since the purpose of this script is to do a lot of crawling, and that wouldn't be done interactively ie: via cgi/html.
The only way to really put it through it's paces is with Telnet.
Links, once it's installed, can be managed through FTP and the HTML interface.
