# Robots.txt file for cristcdl.com User-agent: * Disallow: /logs/ Disallow: /admin/ Disallow: /error/ Disallow: /parse/