Gossamer Forum
Quote Reply
Spider questions
Hi Alex,

I am very interested in the spider plugin, but I am not sure if I can actually use it on my site. So I have a few questions:

1. Is it possible to run this plugin on a virtual server (i.e. not a dedicated server, it's the same one where LinksSQL 2 is actually running) with shell, but not root access?

2. Are there any experiences on server load, memory and cpu usage, disk space needed etc. and what load is it causing on the mysql host (which in my case is not the same as the site server)?

3. Is it possible to manually restrict user searches to certain pages of the spidered ones, maybe by adding an indicator column to the spider's database?

There are two things I'd like to do:

a) Let the user choose an option if he likes to search all of the spidered pages, or only pages from my own site (not the Links pages but pages that are generated outside of LinksSQL)

b) Set up an individual search page from where only certain pages can be searched. I'd like to mark these pages in the spider's database by adding a custom column, so that only marked pages will be searched and not the whole database.

Having the spider would surely be a big plus for our site, but before I purchase that, I want to be sure that I actually can use it.

Andreas

--------------------------------------------
http://www.archaeologie-online.de
Subject Author Views Date
Thread Spider questions Digger 5899 Mar 20, 2001, 1:13 AM
Thread Re: Spider questions
Alex 5770 Mar 20, 2001, 12:47 PM
Thread Re: Spider questions
Alex 5783 Mar 20, 2001, 12:57 PM
Thread Re: Spider questions
padders 5777 Mar 20, 2001, 1:04 PM
Thread Re: Spider questions
Alex 5714 Mar 21, 2001, 11:23 AM
Thread Re: Spider questions
Stealth 5715 Mar 21, 2001, 12:24 PM
Post Re: Spider questions
Alex 5693 Mar 21, 2001, 1:19 PM
Thread Re: Spider questions
Digger 5742 Mar 21, 2001, 1:49 AM
Thread Re: Spider questions
Alex 5739 Mar 21, 2001, 11:23 AM
Thread Re: Spider questions
Digger 5700 Mar 22, 2001, 12:19 AM
Thread Re: Spider questions
Alex 5690 Mar 22, 2001, 12:28 AM
Post Re: Spider questions
padders 5674 Mar 22, 2001, 6:18 AM