# CCL Online Robots.txt # # Date : 2004-12-17 # Author : PT : Mando Group # # All user-agents have been chosen # The ONE place you can use a wildcard in a robots.txt file # register interest files added by PJD 03/02/2006 # openRange newSpec files added by PJD 18/07/2006 # product-compare added by PJD 21/08/2006 to cure newspec folder spidering # /news2/ added 18/03/2009 PJD # /product-details.asp added 18/03/2009 PJD # /content/ added 18/03/2009 PJD # /related-products.asp added 18/03/2009 PJD # /tellafriend/ added 18/03/2009 PJD # /brands.asp/ added 14/04/2010 # /brands-categories.asp 14/04/2010 User-agent: * Disallow: /_common/ Disallow: /_trash/ Disallow: /accounts/ Disallow: /backup/ Disallow: /basket/ Disallow: /control-c/ Disallow: /enquiries/ Disallow: /images/ Disallow: /login/ Disallow: /order/ Disallow: /premium/ Disallow: /services/ Disallow: /tellafriend/thankyou.asp Disallow: /templates/ Disallow: /testharnesses/ Disallow: /svrRegisterInterest.asp Disallow: /RegisterInterest.asp Disallow: /RegisterInterestThanks.asp Disallow: /newspec/ Disallow: /product-compare.asp Disallow: /news2/ Disallow: /product-details.asp Disallow: /content/ Disallow: /related-products.asp Disallow: /tellafriend/ Disallow: /brands.asp Disallow: /brands-categories.asp