Magento 2.1.x Notice: Magento 2.1.18 is the final 2.1.x release. After June 2019, Magento 2.1.x will no longer receive security patches, quality fixes, or documentation updates. To maintain your site's performance, security, and PCIPayment Card Industry: Refers to debit and credit cards and their associated businesses. compliance, upgrade to the latest version of Magento. The Magento User Guide 2.1.x remains available in PDF for Open Source and Commerce.
Using a Sitemap
A sitemapA page that provides search engines with an efficient, alternate route through your site. improves the way your store is indexed by search engines, and is specifically designed to find pages that might be overlooked by web crawlers. A sitemap can be configured to index all pages and images.
When enabled, Magento creates a file called
sitemap.xml that is saved to the root directory of your installation. The configuration gives you the ability to set the frequency of the updates, and the priority for each type of content. Your sitemap should be updated as frequently as the content on your site changes, which might be daily, weekly, or monthly.
While your site is in development, you might include instructions in the
robots.txt file for webcrawlers to avoid indexing the site. Then before the launch, you can change the instructions to allow the site to be indexed.
Complete the XML Sitemap configuration to determine what is included, and how frequently the sitemap is updated.
Complete the Search Engine Robots configuration with instructions that direct search engines to crawl the parts of your site that you want to be indexed.
You can submit your sitemap to different search engines by providing them a link to the
sitemap.xml file in the root of your Magento installation. For more information, see the instructions for the specific search engine. Here are links to instructions for two top search engines: