Gossamer Forum
Home : Products : Gossamer Links : Version 1.x :

Can I skip building pages that have not changed?

Quote Reply
Can I skip building pages that have not changed?
Is there a setting that I can set to tell links SQL to skip over building pages that have not changed. If not this would save alot of time if this feature was added.

Thank You Very Much,

Mark Foster
Quote Reply
Re: Can I skip building pages that have not changed? In reply to
Alex is working on something for this. But, the concept, while simple, is quite complex on the back end, and it will probably take some experimentation to see at what point it saves time (ie: what size sites benefit).

Quote Reply
Re: Can I skip building pages that have not changed? In reply to
Thank you pugdog. I am trying to have the whole DMOZ directory on my site so it would definitely be beneficial to me.

Thanks Again,

Mark Foster
Quote Reply
Re: Can I skip building pages that have not changed? In reply to
What kind of speed are you seeing with the DMOZ site? What hardware are you using?

I'm curious from a performance stand point.

Quote Reply
Re: Can I skip building pages that have not changed? In reply to
I am not sure what kind of hardware that my server is using. I have an account set up with webfusion. You can view there site at http://www.webfusion.com . As far as speed, here is an example: I was able to transfer the content.rdf.gz file from DMOZ to my server within 14 minutes. The address to my site is http://www.linkondemand.com if you would like to see my progress. I was able to insert the Arts category with no problem, but I have run into a problem with the Parse_RDF.pl file as noted in the following board: http://www.gossamer-threads.com/...um9/HTML/000850.html .

Thanks Again pugdog,

Mark Foster