User-agent: Gigabot/3.0 (http://www.gigablast.com/spider.html) Disallow: / User-agent: Jeeves Disallow: / User-agent: Sosospider+(+http://help.soso.com/webspider.htm) Disallow: / User-agent: ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html) Disallow: / User-agent: msnbot Disallow: / User-agent: psbot Disallow: / User-agent: panscient.com Disallow: / User-agent: * Crawl-delay: 10.00 Disallow: /*.gif$ Disallow: /*.Gif$ Disallow: /*.GIF$ Disallow: /*.jpg$ Disallow: /*.Jpg$ Disallow: /*.JPG$ Disallow: /*.jpeg$ Disallow: /*.Jpeg$ Disallow: /*.JPEG$ Disallow: /*.pdf$ Disallow: /*.Pdf$ Disallow: /*.PDF$