Hi Guys!
We trying to write Perl script - multithreaded, link-following, file-retrieving webspider script, that will retrieve files — and only the files you want from any part of the Internet.
Does somebody seeing something like that?
Actually we already wrote the script but we not really satisfied with results. We used Net::HTTP module. It works pretty fast from a local PC but runs pretty slow from a host server.
So i'm wondering if somebody have any experience with that.
Thank you
D.S
We trying to write Perl script - multithreaded, link-following, file-retrieving webspider script, that will retrieve files — and only the files you want from any part of the Internet.
Does somebody seeing something like that?
Actually we already wrote the script but we not really satisfied with results. We used Net::HTTP module. It works pretty fast from a local PC but runs pretty slow from a host server.
So i'm wondering if somebody have any experience with that.
Thank you
D.S