Gossamer Forum
Home : Products : Links 2.0 : Discussions :

Data accessible to Search Engines?

Quote Reply
Data accessible to Search Engines?
* I thought I saw something earlier on this topic, can't find it. Sorry if this is a repeat...

Is it possible to make my Links data accessible to a search engine spider? Is that possible?

I see a significant disadvantage using Links over using standard html links in terms of search engine link popularity ratings. Comments?

Also, same question/concerns apply to my DBman implementations.

Thanks.
Quote Reply
Re: [jmueller] Data accessible to Search Engines? In reply to
In what aspect do you mean? Spiders can already access your static Links pages, and some can spider dynamic content. You don't really want a spider to be indexing outside links do you (jump.cgi...)?

--Philip
Links 2.0 moderator
Quote Reply
Re: [King Junko II] Data accessible to Search Engines? In reply to
Yes, I would like the spiders to crawl the actual link data.

"jump.cgi?ID=84" is meaningless to a search engine spider.

You guys are aware of something called Link Popularity in your search engine rankings, aren't you? Part of the algorithm is the “hub” equation – the number of links on your site.

So... although I love my Links2.0, I need to know how you guys make your link data available to the spiders – or don’t you?
Quote Reply
Re: [jmueller] Data accessible to Search Engines? In reply to
The spiders index your category pages. Jump.cgi will be used for the hyperlink which will work fine.

Last edited by:

Paul: Mar 23, 2002, 6:11 AM
Quote Reply
Re: [Paul] Data accessible to Search Engines? In reply to
Paul.. do I understand you correctly.
Are you saying that a search engine spider will navigate through my static Link category pages, through the jump.cgi and somehow find the actual link in the database?
Quote Reply
Re: [jmueller] Data accessible to Search Engines? In reply to
The spiders will index your category pages.

What do you want it to index?
Quote Reply
Re: [Paul] Data accessible to Search Engines? In reply to
I'm talking about Yahoo, Hotbot, Lycos, etc., spidering my site. I want the spiders to index the actual URL's in my Links database, just as they would if those URL's were in static pages.
Quote Reply
Re: [jmueller] Data accessible to Search Engines? In reply to
You'd have to change the links in link.html to <%URL%> instead of jump.cgi
Quote Reply
Re: [jmueller] Data accessible to Search Engines? In reply to
Quote:
Yahoo, Hotbot, Lycos

I dont' think any of those search engines actually 'spider' your site, definatly not Yahoo ;)

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [A.J.] Data accessible to Search Engines? In reply to
Yes, if you are using templates in your Links2.0 to build your static pages, then all search engines which spider the web (altavista, google, etc.,) will spider your pages and make them available on their search engines.

Yahoo is not a search engine and it does not have a robot. However, since yahoo uses google for showing search results, any pages spidered by google will be available on yahoo.

Jump.cgi in Links2.0 has nothing to do with it (spidering) - it is used just to redirect your users to specific links.
Quote Reply
Re: [socrates] Data accessible to Search Engines? In reply to
Yes, the search engines will find those static pages. Not a problem.

However, what the search engine will find are URL's like this:
<a class="link" href="/cgi-bin/links/jump.cgi?ID=60">Family Builders</a>

What I WANT is the search engines to locate the ACTUAL URL to my linked sites.
As far as I can tell, that is not possible. Or is it?

Reason: Reciprocal links are important to my site. Most link popularity algorithms look not only at other similar sites linked to us, but also those sites we are linked to. Therefore it's imprtant that crawlers see those links.
Quote Reply
Re: [jmueller] Data accessible to Search Engines? In reply to
Then, as Paul already suggested, use the <%URL%> tag instead of jump.cgi or, even better, use both of them.
Quote Reply
Re: [Tho:mas] Data accessible to Search Engines? In reply to
Okay... I think we're getting closer. Wink

Tell me specifically how to use the <%URL%> tag.
Not sure what you mean.

Thanks guys.
Quote Reply
Re: [jmueller] Data accessible to Search Engines? In reply to
I'm not sure how much clearer we can make it!

Use;

<a href="<%URL%><%Title%></a>

in link.html where the title and link needs to be shown! That will print out, for example;

<a href="http://www.ace-installer.com">Ace Installer</a>

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Post deleted by jmueller In reply to
Quote Reply
Re: [jmueller] Data accessible to Search Engines? In reply to
Take this page as example.

You could link the title with jump.cgi (in order to be able to count hits) and the URL below with the <%URL%> tag.
Quote Reply
Re: [A.J.] Data accessible to Search Engines? In reply to
>>
Use;

<a href="<%URL%><%Title%></a>
<<

Try:

<a href="<%URL%>"><%Title%></a>

Tongue

Last edited by:

Paul: Mar 25, 2002, 9:09 AM
Quote Reply
Re: [Paul] Data accessible to Search Engines? In reply to
Ooops, my typo. I was just giving him the general idea Wink

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [A.J.] Data accessible to Search Engines? In reply to
Okay... Just a little more detail guys.

My current code on link.html looks like this:
<a class="link" href="<%db_cgi_url%>/jump.cgi?ID=<%ID%>"><%Title%></a>

You're suggesting a change to look like this:
<a href="<%URL%>"><%Title%></a>


Thomas says: ""You could link the title with jump.cgi (in order to be able to count hits) and the URL below with the <%URL%> tag."

I think THAT [Thomas' suggestion] is the way to go -- I don't want to forfeit link tracking.

So... What exactly would the finished code look like?

Thanks again.
Quote Reply
Re: [jmueller] Data accessible to Search Engines? In reply to
Dear DFGI,

<a href="<%db_cgi_url%>/jump.cgi?ID=<%ID%>"><%Title%></a><br>
URL: <%URL%>

Another example (older and before Thomas' site was created)...

http://vlib.anthrotech.com/Applied_Anthropology/
========================================
Buh Bye!

Cheers,
Me

Last edited by:

Heckler: Mar 25, 2002, 10:38 AM
Quote Reply
Re: [Heckler] Data accessible to Search Engines? In reply to
Eliot, thanks.

DFGI?