# This says to apply these settings to ALL search engine spiders/crawlers User-agent: * # These settings will keep spiders from indexing your unwanted pages Disallow: /admin Disallow: /logs Disallow: /cgi-bin User-agent: Googlebot-Image Disallow: / Sitemap: http://www.facemed.co.uk/sitemap.php