#/-----------------------------------------------\ #| | #| | # --------> SynNet Robots.txt File <-----------| #| | #| | #\-----------------------------------------------/ User-agent: MS Search 4.0 Robot Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 4.0 Robot) Microsoft Disallow: / User-agent: * Disallow: /admin/ Disallow: /App_GlobalResources/ Disallow: /bin/ Disallow: /Components/ Disallow: /controls/ Disallow: /DesktopModules/ Disallow: /HttpModules/ Disallow: /images/ Disallow: /Install/ Disallow: /js/ Disallow: /Providers/ Disallow: /Portals/ User-agent: msnbot Disallow: /admin/ Disallow: /App_GlobalResources/ Disallow: /bin/ Disallow: /Components/ Disallow: /controls/ Disallow: /DesktopModules/ Disallow: /HttpModules/ Disallow: /images/ Disallow: /Install/ Disallow: /js/ Disallow: /Providers/ Disallow: /Portals/ Crawl-delay: 5 User-agent: Slurp Disallow: /admin/ Disallow: /App_GlobalResources/ Disallow: /bin/ Disallow: /Components/ Disallow: /controls/ Disallow: /DesktopModules/ Disallow: /HttpModules/ Disallow: /images/ Disallow: /Install/ Disallow: /js/ Disallow: /Providers/ Disallow: /Portals/ Crawl-delay: 5 User-agent: Googlebot Disallow: /*/ctl/ Disallow: /admin/ Disallow: /App_GlobalResources/ Disallow: /bin/ Disallow: /Components/ Disallow: /controls/ Disallow: /DesktopModules/ Disallow: /HttpModules/ Disallow: /images/ Disallow: /Install/ Disallow: /js/ Disallow: /Providers/ Disallow: /Portals/