# Robots.txt file created 14/02/2008 # For domain: http://www.cthlp.org.uk # All robots will spider the domain User-agent: * #Disallow the following Disallow: /Scripts/ Disallow: /Templates/ Disallow: /Menus/ Disallow: /Pictures/ Disallow: /Banners/ Disallow: /logs/ Disallow: /Photos/