Gossamer Forum
Home : Products : Gossamer Links : Development, Plugins and Globals :

[iUNI] Spider / Crawler Plugin and Standalone App.

Quote Reply
[iUNI] Spider / Crawler Plugin and Standalone App.


Introducing iuCrawler...

iuCrawler is two applications in one (a spider and a crawler) and can exist as a plug-in to Links SQL or as a stand alone application. iuCrawler has been available and selling to many webmasters since last year. We have decided to bring it to Link SQL, beacuse of the many obvious advantages of having iuCrawler's advanced features right in Links, not to mention the time saving virtues of integration with an existing links database.

+ Set a starting point and let iuCrawler do the rest
+ Retrieve information from websites
+ Build databases quickly and accurately
+ Export crawled data to popular database and file formats
+ Import crawled datainto Links SQL (Gossamer Threads)

Yes, you can save your data into a variety of formats, like MS Excel!

Requirements:

- Unix/Linux/OS X/NT
- Perl 5.005 +
- Spreadsheet::WriteExcel Perl module if exporting to MS Excel spreadsheets
- GDBM_File Perl module if exporting to flat file database
- MySQL 3.23 or greater if using MySQL to store data
- PostgreSQL 7.1 or greater if using PostgreSQL to store data
- Links SQL version 2.1.0 or greater if using Links to store the data

This version is available, however we are just waiting for GT to make it available in the plugin download area.

For screenshots, and latest information, visit: http://www.iuni.com/software/iucrawler.html


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] [iUNI] Spider / Crawler Plugin and Standalone App. In reply to
iuCrawler in Action...



Naturallly progressing menu viewable right in your Links SQL admin panel.


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] [iUNI] Spider / Crawler Plugin and Standalone App. In reply to
iuCrawler in Action...



Configuration allows spidering of virtually any source.


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] [iUNI] Spider / Crawler Plugin and Standalone App. In reply to
iuCrawler in Action...



Select where you want your crawled data to go. The latest version now has a Links SQL option!!


http://www.iuni.com/...tware/web/index.html
Links Plugins

Last edited by:

Ian: Jan 16, 2003, 9:47 PM
Quote Reply
Re: [Ian] [iUNI] Spider / Crawler Plugin and Standalone App. In reply to
iuCrawler in Action...



Preparing to export directly into a Links category of your choice.


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] [iUNI] Spider / Crawler Plugin and Standalone App. In reply to
Looks interesting.
Has anyone used it yet ? How good is the information it retrieves ?