Anne van Kesteren

robots.txt

"All this hullabaloo over robots.txt destroying the web is crazy!"

related
robots.txt
via
paranoidfish.org/links/2005/01/21