Hey thanks for the spider mod.
Question though, how does one use it WITH templates?
Visionary
Question though, how does one use it WITH templates?
Visionary
Mar 22, 1999, 9:32 AM
Novice (26 posts)
Mar 22, 1999, 9:32 AM
Post #27 of 52
Views: 8332
Dan,
Thanks for the mod, I now have it on my site :-)
For templates in Links 2.0 add this to link.html
Cheers
------------------
Webmaster@spreester.com
www.spreester.com
exposing amsterdam's A2000 people...
Thanks for the mod, I now have it on my site :-)
For templates in Links 2.0 add this to link.html
Code:
[ <a href="<%db_cgi_url%>/spider.cgi\?URL="<%db_cgi_url%>/jump.cgi?ID=<%ID%>">Spider</a> ]Cheers
------------------
Webmaster@spreester.com
www.spreester.com
exposing amsterdam's A2000 people...
Mar 22, 1999, 9:45 AM
Enthusiast (760 posts)
Mar 22, 1999, 9:45 AM
Post #28 of 52
Views: 8389
Lucas - sorry but with being solely responsible with running 3 labour-intensive commercial websites, I have little time to take on other projects. Besides you may want a 'real' cgi-perl programmer.
Spreester - thanks for the templates code. I'll add it.
BTW guys, don't give me too much credit. Afterall, it was the people at Fluid Dynamics that wrote the base script - and it is one hell of a script in its design and complexity. I just did some snipping and adding here and there to produce what you see now. Not much brain power involved. Just time as the code is rather involved to redesign.
Dan
Spreester - thanks for the templates code. I'll add it.
BTW guys, don't give me too much credit. Afterall, it was the people at Fluid Dynamics that wrote the base script - and it is one hell of a script in its design and complexity. I just did some snipping and adding here and there to produce what you see now. Not much brain power involved. Just time as the code is rather involved to redesign.
Dan
Mar 24, 1999, 8:06 AM
User (144 posts)
Mar 24, 1999, 8:06 AM
Post #29 of 52
Views: 8364
Just a little note, say Thank you, also you coding for the templated mod on this page is messed up, there is an extra " mark in your coding that will make links not output the actual jump id etc.
code:
[ <a href="<%db_cgi_url%>/spider.cgi\?URL="<%db_cgi_url%>/jump.cgi?ID=<%ID%>">Spider</a> ]
--------------------------------------------------------------------------------
SHOULD BE
code:
--------------------------------------------------------------------------------
[ <a href="<%db_cgi_url%>/spider.cgi\?URL=<%db_cgi_url%>/jump.cgi?ID=<%ID%>">Spider</a> ]
--------------------------------------------------------------------------------
Hope this formated correctly.
Visionary
[This message has been edited by Visionary (edited March 24, 1999).]
[This message has been edited by Visionary (edited March 24, 1999).]
code:
Code:
-------------------------------------------------------------------------------- [ <a href="<%db_cgi_url%>/spider.cgi\?URL="<%db_cgi_url%>/jump.cgi?ID=<%ID%>">Spider</a> ]
--------------------------------------------------------------------------------
SHOULD BE
code:
--------------------------------------------------------------------------------
[ <a href="<%db_cgi_url%>/spider.cgi\?URL=<%db_cgi_url%>/jump.cgi?ID=<%ID%>">Spider</a> ]
--------------------------------------------------------------------------------
Hope this formated correctly.
Visionary
[This message has been edited by Visionary (edited March 24, 1999).]
[This message has been edited by Visionary (edited March 24, 1999).]
Mar 24, 1999, 8:27 AM
Enthusiast (760 posts)
Mar 24, 1999, 8:27 AM
Post #30 of 52
Views: 8373
Visionary - that line was changed Monday as I noticed the extra ". Plus, I changed it to point directly to the URL. You need to clear your browser cache and reload (refresh) the page as you are viewing the old page from Sunday or early Monday.
Dan
Dan
Mar 24, 1999, 7:54 PM
User (144 posts)
Mar 24, 1999, 7:54 PM
Post #31 of 52
Views: 8328
Thanks Dan, guess I should have noted what I was replying to. I already downloaded the script before you had the instructions for the templates coding on your site, so I was just replying to your post on here which has the bad code in it not towards the coding you had on your site.
Thanks again
Thanks again
Mar 25, 1999, 1:02 PM
Enthusiast (685 posts)
Mar 25, 1999, 1:02 PM
Post #32 of 52
Views: 8406
can i see a sample of what exactly your mode does? does the results come out on your own pages? can i decide which search engines it searches? can i place my own ads on these pages?
Mar 25, 1999, 2:45 PM
Enthusiast (760 posts)
Mar 25, 1999, 2:45 PM
Post #33 of 52
Views: 8271
theguy - the mod does not spider search engines. It only spiders listings in the links database. And since the results are displayed on locally, you can display your own ads. Check here for an example - www.spreester.com
Dan
Dan
Mar 25, 1999, 4:08 PM
User (88 posts)
Mar 25, 1999, 4:08 PM
Post #34 of 52
Views: 8290
Will this Spider Mod thread on this forum ever end!
------------------
Patrick Chukwura
http://nytesoft.hypermart.net
------------------
Patrick Chukwura
http://nytesoft.hypermart.net
Mar 26, 1999, 9:21 AM
User (144 posts)
Mar 26, 1999, 9:21 AM
Post #36 of 52
Views: 8369
Hey Dan,
How can I make it so that the description comes out for each link as well as the main link, seems kinda weird to only display a descripton for the main link and none of the ones that it found on the main link page.
Is this simple to do or complicated, or is the script designed not to do it?
Thanks
How can I make it so that the description comes out for each link as well as the main link, seems kinda weird to only display a descripton for the main link and none of the ones that it found on the main link page.
Is this simple to do or complicated, or is the script designed not to do it?
Thanks
Apr 12, 1999, 12:35 PM
Enthusiast (685 posts)
Apr 12, 1999, 12:35 PM
Post #38 of 52
Views: 8294
i installed the script but i'm not sure if it's working. i do not see the word spider on any of my pages. the sample page dan provided,
does not have the word spider either.
i thought you should have a link to the script?
does not have the word spider either.
i thought you should have a link to the script?
Apr 12, 1999, 1:31 PM
User (83 posts)
Apr 12, 1999, 1:31 PM
Post #40 of 52
Views: 8292
hi,
Theguy,
You will see how the spider is working on my site
factory.co.kr/cgi_baseball/link/index_en.html
The code you should change is at the following;
At site_html.pl
sub site_html_link {
$output .= qq~ <br><font color=#808080><small class="date">(Added:$rec{'Date'} Hits:$rec{'Hits'} Rating:$rec{'Rating'} Votes:$rec{'Votes'}) <a href="$build_rate_url?ID=$rec{'ID'}"><img src=/cgi/link/image/rate_en.gif border=0 alt="Rate it"></a><a href="$db_cgi_url/spider_en.cgi\?URL=$rec{'URL'}" target=new><img src=/cgi/link/image/preview_en.gif border=0 alt="Site preview"></a><a href="$db_cgi_url/birdcast_en.cgi?rec_url=$build_jump_url?ID=$rec{'ID'}&rec_title=$rec_title"><img src=/cgi/link/image/recommend_en.gif border=0 alt="Recommend it"></a></small></font>
</ul>
~;
The key point you need to change is following;
Insert this code just after "rate it"></a>
---------------------------------------------
<a href="$db_cgi_url/spider.cgi\?URL=$rec{'URL'}">Spider</a>
---------------------------------------------
## $db_cgi_url/spider.cgi ## means http://www.yourname.com/links2.0_directory/cgi-bin/spider.cgi
[This message has been edited by koreags (edited April 13, 1999).]
Theguy,
You will see how the spider is working on my site
factory.co.kr/cgi_baseball/link/index_en.html
The code you should change is at the following;
At site_html.pl
sub site_html_link {
$output .= qq~ <br><font color=#808080><small class="date">(Added:$rec{'Date'} Hits:$rec{'Hits'} Rating:$rec{'Rating'} Votes:$rec{'Votes'}) <a href="$build_rate_url?ID=$rec{'ID'}"><img src=/cgi/link/image/rate_en.gif border=0 alt="Rate it"></a><a href="$db_cgi_url/spider_en.cgi\?URL=$rec{'URL'}" target=new><img src=/cgi/link/image/preview_en.gif border=0 alt="Site preview"></a><a href="$db_cgi_url/birdcast_en.cgi?rec_url=$build_jump_url?ID=$rec{'ID'}&rec_title=$rec_title"><img src=/cgi/link/image/recommend_en.gif border=0 alt="Recommend it"></a></small></font>
</ul>
~;
The key point you need to change is following;
Insert this code just after "rate it"></a>
---------------------------------------------
<a href="$db_cgi_url/spider.cgi\?URL=$rec{'URL'}">Spider</a>
---------------------------------------------
## $db_cgi_url/spider.cgi ## means http://www.yourname.com/links2.0_directory/cgi-bin/spider.cgi
[This message has been edited by koreags (edited April 13, 1999).]
Apr 12, 1999, 1:58 PM
User (125 posts)
Apr 12, 1999, 1:58 PM
Post #41 of 52
Views: 8320
I tried to put up the spider.cgi and got a whole whack of errors:
forget it, had to put the proper path to perl at the top.
[This message has been edited by Predator (edited April 12, 1999).]
forget it, had to put the proper path to perl at the top.
[This message has been edited by Predator (edited April 12, 1999).]
Apr 13, 1999, 3:52 AM
User (83 posts)
Apr 13, 1999, 3:52 AM
Post #43 of 52
Views: 8236
Hi, Dan
Is it possible to have spidering result massage only for bad connection at separate html file ?
My LWP doesn't work.
So, i think i need to get an error report for bad links by e-mail to me or a html file after someone trys spidering.
[This message has been edited by koreags (edited April 15, 1999).]
Is it possible to have spidering result massage only for bad connection at separate html file ?
My LWP doesn't work.
So, i think i need to get an error report for bad links by e-mail to me or a html file after someone trys spidering.
[This message has been edited by koreags (edited April 15, 1999).]
Apr 13, 1999, 8:51 PM
Enthusiast (685 posts)
Apr 13, 1999, 8:51 PM
Post #44 of 52
Views: 8365
great mod!! finally it's working on my site.
is there a way to improve it? by adding a description for all the links.
dan: if you can do this , it will be the best mod for links.
is there a way to improve it? by adding a description for all the links.
dan: if you can do this , it will be the best mod for links.
Apr 13, 1999, 9:58 PM
Enthusiast (760 posts)
Apr 13, 1999, 9:58 PM
Post #45 of 52
Views: 8330
Thanks for all the positive feedback and suggestions! I'll modify the script to provide descriptions for all spidered pages. I'm pretty swamped at the moment but I hope to have it done within 1-2 weeks.
Again, it will be available at www.monster-submit.com/mods02.html
Dan
[This message has been edited by dan (edited April 14, 1999).]
Again, it will be available at www.monster-submit.com/mods02.html
Dan
[This message has been edited by dan (edited April 14, 1999).]
Apr 14, 1999, 4:35 AM
User (144 posts)
Apr 14, 1999, 4:35 AM
Post #46 of 52
Views: 8415
*****WARNING THIS EMAIL IS FROM A BEGINNER*****
I think that the spider mod only spiders to the first level, thus getting it to show the description of the pages below the first level won't happen, unless you build it into the script to spider beyond the first level.
Where that is in the script? Don't Know!
Anyone know how to change it to the 2nd level?
Visionary
I think that the spider mod only spiders to the first level, thus getting it to show the description of the pages below the first level won't happen, unless you build it into the script to spider beyond the first level.
Where that is in the script? Don't Know!
Anyone know how to change it to the 2nd level?
Visionary
Apr 25, 1999, 2:33 PM
Enthusiast (685 posts)
Apr 25, 1999, 2:33 PM
Post #48 of 52
Views: 8367
search for </body> and add it before that.
note: you should find it twice so you need to add the footer in both places.
dan , how about an update on your work?
do you still think you can add a description to all the links?
[This message has been edited by theguy (edited September 12, 1999).]
note: you should find it twice so you need to add the footer in both places.
dan , how about an update on your work?
do you still think you can add a description to all the links?
[This message has been edited by theguy (edited September 12, 1999).]
Apr 28, 1999, 9:42 AM
Enthusiast (760 posts)
Apr 28, 1999, 9:42 AM
Post #49 of 52
Views: 8411
Update: Sorry but I've decided to leave the Links Spider mod as is. It is NOT advised to incorporate descriptions for the secondary pages as this would require spidering embedded links in the primary page. This can be a drain on any server and seriously tax their cpu resources.
Anyone is welcome to tinker with the script but any changes will not be incorporated into the Links Spider code. And if you decide you want to release a modified version for public use then you will require expressed permission of Fluid Dynamics at http://www.xav.com .
Dan
Anyone is welcome to tinker with the script but any changes will not be incorporated into the Links Spider code. And if you decide you want to release a modified version for public use then you will require expressed permission of Fluid Dynamics at http://www.xav.com .
Dan
Apr 30, 1999, 8:57 PM
User (124 posts)
Apr 30, 1999, 8:57 PM
Post #50 of 52
Views: 8319
Links 2.0
I have followed instructions but after I searched and click on SPIDER it gave errors:
syntax error in file /data1/hypermart.net/viet-usa/spider.cgi at line 27, next 2 tokens "use Socket"
"my" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 62.
Illegal modulus of constant zero in file /data1/hypermart.net/viet-usa/spider.cgi at line 62, next 2 tokens "FORM ="
Illegal expression (MODULO) as lvalue in file /data1/hypermart.net/viet-usa/spider.cgi at line 62, next 2 tokens "\ReadInput;"
"my" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 112.
syntax error in file /data1/hypermart.net/viet-usa/spider.cgi at line 112, next 2 tokens "my @HITS"
"my" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 133.
syntax error in file /data1/hypermart.net/viet-usa/spider.cgi at line 133, next 2 tokens "my $InputString "
"my" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 134.
"my" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 135.
Illegal modulus of constant zero in file /data1/hypermart.net/viet-usa/spider.cgi at line 135, next 2 tokens "FORM ="
Illegal expression (MODULO) as lvalue in file /data1/hypermart.net/viet-usa/spider.cgi at line 135, next 2 tokens ");"
/^(.*?)=(.*)$/: nested *?+ in regexp at /data1/hypermart.net/viet-usa/spider.cgi line 140.
[Fri Apr 30 23:55:13 1999] access to /data1/hypermart.net/viet-usa/spider.cgi failed for 129.71.139.79, reason: Premature end of script headers
Help Please!
This is what I insert
[ <a href="http://www.viet-usa.com/spider.cgi\?URL=$rec{'URL'}">Spider</a> ]
Thanks in advance to all!
------------------
WebKing
WebKing@trisoft.net
http://www.trisoft.net
My ICQ # 25356171
I have followed instructions but after I searched and click on SPIDER it gave errors:
Quote:
"use" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 27. syntax error in file /data1/hypermart.net/viet-usa/spider.cgi at line 27, next 2 tokens "use Socket"
"my" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 62.
Illegal modulus of constant zero in file /data1/hypermart.net/viet-usa/spider.cgi at line 62, next 2 tokens "FORM ="
Illegal expression (MODULO) as lvalue in file /data1/hypermart.net/viet-usa/spider.cgi at line 62, next 2 tokens "\ReadInput;"
"my" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 112.
syntax error in file /data1/hypermart.net/viet-usa/spider.cgi at line 112, next 2 tokens "my @HITS"
"my" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 133.
syntax error in file /data1/hypermart.net/viet-usa/spider.cgi at line 133, next 2 tokens "my $InputString "
"my" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 134.
"my" may clash with future reserved word at /data1/hypermart.net/viet-usa/spider.cgi line 135.
Illegal modulus of constant zero in file /data1/hypermart.net/viet-usa/spider.cgi at line 135, next 2 tokens "FORM ="
Illegal expression (MODULO) as lvalue in file /data1/hypermart.net/viet-usa/spider.cgi at line 135, next 2 tokens ");"
/^(.*?)=(.*)$/: nested *?+ in regexp at /data1/hypermart.net/viet-usa/spider.cgi line 140.
[Fri Apr 30 23:55:13 1999] access to /data1/hypermart.net/viet-usa/spider.cgi failed for 129.71.139.79, reason: Premature end of script headers
Help Please!
This is what I insert
[ <a href="http://www.viet-usa.com/spider.cgi\?URL=$rec{'URL'}">Spider</a> ]
Thanks in advance to all!
------------------
WebKing
WebKing@trisoft.net
http://www.trisoft.net
My ICQ # 25356171