# robots.txt User-agent: * Disallow: /dead-end # Bad Bot trap. Disallow: /publications/bsd # No longer in existence. Disallow: /cgi-bin/www/mobile # No longer in existence.