Hi,
thanks for the hints so far. I would like to save the google results pages, so I can compare them time after time. Are there any standard settings I should take in order to save the google results pages locally for a certain query? I had problems, and it didn't work at all for me. But I thought, that google should be a standard, which is already known to you.
Regards,
Alpha
google results pages
Re: google results pages
Well, this will not work. When you scan google, you get different session ID in the links and it will also ask you for a captcha verification. Google don't like to be spidered!
Your support team.
http://SoftByteLabs.com
http://SoftByteLabs.com
Re: google results pages
Does this problem also exist, if I crawl only with one stream and slowly with long delays?
Speed is not the problem.
Is there any other search engine like bing or so, which can be spidered?
Speed is not the problem.
Is there any other search engine like bing or so, which can be spidered?
Re: google results pages
Perhaps not. I'm not sure. All search engines have some ways to restrict spidering the data!
Your support team.
http://SoftByteLabs.com
http://SoftByteLabs.com