Gossamer Forum
Quote Reply
Spider questions
Hi Alex,

I am very interested in the spider plugin, but I am not sure if I can actually use it on my site. So I have a few questions:

1. Is it possible to run this plugin on a virtual server (i.e. not a dedicated server, it's the same one where LinksSQL 2 is actually running) with shell, but not root access?

2. Are there any experiences on server load, memory and cpu usage, disk space needed etc. and what load is it causing on the mysql host (which in my case is not the same as the site server)?

3. Is it possible to manually restrict user searches to certain pages of the spidered ones, maybe by adding an indicator column to the spider's database?

There are two things I'd like to do:

a) Let the user choose an option if he likes to search all of the spidered pages, or only pages from my own site (not the Links pages but pages that are generated outside of LinksSQL)

b) Set up an individual search page from where only certain pages can be searched. I'd like to mark these pages in the spider's database by adding a custom column, so that only marked pages will be searched and not the whole database.

Having the spider would surely be a big plus for our site, but before I purchase that, I want to be sure that I actually can use it.

Andreas

--------------------------------------------
http://www.archaeologie-online.de
Subject Author Views Date
Thread Spider questions Digger 5805 Mar 20, 2001, 1:13 AM
Thread Re: Spider questions
Alex 5678 Mar 20, 2001, 12:47 PM
Thread Re: Spider questions
Alex 5691 Mar 20, 2001, 12:57 PM
Thread Re: Spider questions
padders 5686 Mar 20, 2001, 1:04 PM
Thread Re: Spider questions
Alex 5622 Mar 21, 2001, 11:23 AM
Thread Re: Spider questions
Stealth 5623 Mar 21, 2001, 12:24 PM
Post Re: Spider questions
Alex 5601 Mar 21, 2001, 1:19 PM
Thread Re: Spider questions
Digger 5649 Mar 21, 2001, 1:49 AM
Thread Re: Spider questions
Alex 5647 Mar 21, 2001, 11:23 AM
Thread Re: Spider questions
Digger 5608 Mar 22, 2001, 12:19 AM
Thread Re: Spider questions
Alex 5598 Mar 22, 2001, 12:28 AM
Post Re: Spider questions
padders 5584 Mar 22, 2001, 6:18 AM