Using web-harvesting program to download Yahoo-News for mobile. Is there a limit of number of links permitted?

Question

The web-site for Yahoo-News for mobiles is:

http://intl.m.yahoo.com/p/news

After receiving a certain amount of content (maybe following a few hundred URL links - maybe less), I am blocked in accessing this Yahoo page, and the only way I can get back in is by reconnecting to Internet.

Answer 1

Yes, Yahoo and google stops automated harvest/scraping requests erratically. If your internet connection is through dynamic ip, you will be able to extract it once you re-initiate the internet connect otherwise if you are using a public ip, it will be hard to change the ip often and it is also illegal.