# Added disallowance for Gigabot as it sucks too much. FEL 21 march 2006 User-agent: gigabot Disallow: / # Alexa's bot is a bit aggressive so I think I shall make it wait 1 minute (60 seconds) until it can view another page. # I think I already put it on the IP-banned list. User-agent: IA_Archiver Crawl-Delay: 60 User-agent: * Disallow: /administrator/ Disallow: /cache/ Disallow: /components/ Disallow: /editor/ Disallow: /help/ Disallow: /images/ Disallow: /includes/ Disallow: /language/ Disallow: /mambots/ Disallow: /media/ Disallow: /modules/ Disallow: /templates/ Disallow: /installation/ Disallow: /index.php?option=com_search* Disallow: /index.php?option=com_events*