robots.txt
robots.txt is a text file at the root of a site that tells well-behaved crawlers which paths they may or may not request. It controls crawling, not indexing, so it is the wrong tool for hiding a page from search results entirely.
robots.txt is a text file at the root of a site that tells well-behaved crawlers which paths they may or may not request. It controls crawling, not indexing, so it is the wrong tool for hiding a page from search results entirely.