# robots.txt for http://www.edexcellence.net/ User-agent: Twiceler Disallow: / User-agent: dotbot Disallow: / User-agent: psbot Disallow: / User-agent: * Crawl-delay: 20 User-agent: * Disallow: /admin/ Disallow: /archive/ Disallow: /CGI-BIN/ Disallow: /database/ Disallow: /dayton/ Disallow: /designs/ Disallow: /doc/ Disallow: /fordham/ Disallow: /fordhamprizes/ Disallow: /foundation/ Disallow: /gadfly/ Disallow: /gif/ Disallow: /log/ Disallow: /scripts/ Disallow: /styles/ Disallow: /tbfinstitute/ Disallow: /template/ Disallow: /topics/ Disallow: /W3SVC29/