Hi all
I just have a quick question and that is,
Say i have 1 million links within my directory however a lot of these links just don't work anymore (e.g. domain exist no more, files have moved etc, etc)
Is there a spider out there or any other piece of software out there that would go through all my directory, say via crontab and make a list of all links that don't work or go anywhere, so i can go in and delete the link or suppend them or such.
Would love to hear your thoughts on this.
Kirk
--------------------------------------------------
Life isn't like a box of chocolates ... it's more like a jar of jalapenos. What you do today might burn your ass tomorrow.
I just have a quick question and that is,
Say i have 1 million links within my directory however a lot of these links just don't work anymore (e.g. domain exist no more, files have moved etc, etc)
Is there a spider out there or any other piece of software out there that would go through all my directory, say via crontab and make a list of all links that don't work or go anywhere, so i can go in and delete the link or suppend them or such.
Would love to hear your thoughts on this.
Kirk
--------------------------------------------------
Life isn't like a box of chocolates ... it's more like a jar of jalapenos. What you do today might burn your ass tomorrow.
I think this was discussed about 5-7 days ago 