google results pages

[alpha2]

Hi,

thanks for the hints so far. I would like to save the google results pages, so I can compare them time after time. Are there any standard settings I should take in order to save the google results pages locally for a certain query? I had problems, and it didn't work at all for me. But I thought, that google should be a standard, which is already known to you.

Regards,

Alpha

[Support]

Well, this will not work. When you scan google, you get different session ID in the links and it will also ask you for a captcha verification. Google don't like to be spidered!

[alpha2]

Does this problem also exist, if I crawl only with one stream and slowly with long delays?
Speed is not the problem.

Is there any other search engine like bing or so, which can be spidered?

[Support]

Perhaps not. I'm not sure. All search engines have some ways to restrict spidering the data!