# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file Sitemap: https://reviewed-misc.s3.amazonaws.com/sitemaps/sitemap.xml.gz User-Agent: * Disallow: /affiliates/ Disallow: /c/ Disallow: /a/ Disallow: /t/ Disallow: /*.htm.amp Disallow: /.well-known/ Disallow: /*.amp.ampAs Disallow: /.ampAs Disallow: /*.htm .amp Disallow: /*. .amp