Magento Open Source 2.1.x

Magento 2.1.x Notice: Magento 2.1.18 is the final 2.1.x release. After June 2019, Magento 2.1.x will no longer receive security patches, quality fixes, or documentation updates. To maintain your site's performance, security, and PCIPayment Card Industry: Refers to debit and credit cards and their associated businesses. compliance, upgrade to the latest version of Magento. The Magento User Guide 2.1.x remains available in PDF for Open Source and Commerce.

Using a Sitemap

A sitemapA page that provides search engines with an efficient, alternate route through your site. improves the way your store is indexed by search engines, and is specifically designed to find pages that might be overlooked by web crawlers. A sitemap can be configured to index all pages and images.

When enabled, Magento creates a file called sitemap.xml that is saved to the root directory of your installation. The configuration gives you the ability to set the frequency of the updates, and the priority for each type of content. Your sitemap should be updated as frequently as the content on your site changes, which might be daily, weekly, or monthly.

While your site is in development, you might include instructions in the robots.txt file for webcrawlers to avoid indexing the site. Then before the launch, you can change the instructions to allow the site to be indexed.