Robots.txt question...?

Question

I just found out that Yahoo search is pulling up pages that I dont want it to. I created a robots.txt file that disallows all inside directories, everything but the main page. But I ran a search and the files are still coming up, how long does it take to take effect?

Answer 1

until the robot recrawls over your site.  this is usually about a month.

Answer 2

Maybe you could try resubmitting to the Yahoo crawler.  Then it will recognize the robots.txt and remove the pages that it no longer crawls.