# robots.txt - crawler configuration file User-agent: * Disallow: /_private/ Disallow: /database/ Sitemap: http://www.lilcritters.com.au/sitemap.xml