# robots.txt file for http://www.socialfunds.com User-agent: * Disallow: /images/ Disallow: /javascript/ Disallow: /css/ Disallow: /news/article.cgi/ Crawl-delay: 100 User-agent: Slurp Crawl-delay: 300