User-agent: * Crawl-delay: 30 Disallow: /Community/Finance/ Disallow: /pub/Community/Finance/ Disallow: /bin/view/Community/Finance/ Disallow: /bin/attach Disallow: /bin/changes Disallow: /bin/compare Disallow: /bin/compareauth Disallow: /bin/configure Disallow: /bin/edit Disallow: /bin/geturl Disallow: /bin/installpasswd Disallow: /bin/login Disallow: /bin/logon Disallow: /bin/logos Disallow: /bin/mailnotify Disallow: /bin/manage Disallow: /bin/oops Disallow: /bin/passwd Disallow: /bin/preview Disallow: /bin/previewauth Disallow: /bin/rdiff Disallow: /bin/rdiffauth Disallow: /bin/register Disallow: /bin/rename Disallow: /bin/resetpasswd Disallow: /bin/rest Disallow: /bin/restauth Disallow: /bin/save Disallow: /bin/savemulti Disallow: /bin/search Disallow: /bin/setlib.cfg Disallow: /bin/solrsearch Disallow: /bin/statistics Disallow: /bin/testenv Disallow: /bin/upload Disallow: /bin/viewauth Disallow: /bin/viewfile Disallow: /bin/viewfileauth Disallow: /list/ Disallow: /System/CompleteDocumentation Disallow: /bin/view/System/CompleteDocumentation Disallow: /Tasks/WebIndex Disallow: /bin/view/Tasks/WebIndex Disallow: /Support/WebIndex Disallow: /bin/view/Support/WebIndex Disallow: /Sandbox/ Disallow: /bin/view/Sandbox/ # Prevent googlebot from indexing query params Disallow: /*? # http://www.80legs.com/webcrawler.html # Too stupid to follow Crawl-delay # And this site sucks balls - Babar - 2012-11-05 User-agent: 008 Disallow: /