One absolute sitemap URL per line.
robots.txt
159 B
Upload robots.txt to the root of your domain (https://your-site/robots.txt). It is a request to well-behaved crawlers, not access control — never rely on it to hide private pages. Google ignores Crawl-delay.