Magento Commerce 2.1.x

Using a Sitemap

A sitemapA page that provides search engines with an efficient, alternate route through your site. improves the way your store is indexed by search engines, and is specifically designed to find pages that might be overlooked by web crawlers. A sitemap can be configured to index all pages and images.

When enabled, Magento creates a file called sitemap.xml that is saved to the root directory of your installation. The configuration gives you the ability to set the frequency of the updates, and the priority for each type of content. Your sitemap should be updated as frequently as the content on your site changes, which might be daily, weekly, or monthly.

While your site is in development, you might include instructions in the robots.txt file for webcrawlers to avoid indexing the site. Then before the launch, you can change the instructions to allow the site to be indexed.