New top story on Hacker News: Robots.txt for the NYT has a specific exclusion for an 1996 news article

Robots.txt for the NYT has a specific exclusion for an 1996 news article
27 by mikeortman