Magento 2.0.18 is the final 2.0.x release. After March 2018, Magento 2.0.x will no longer receive security patches, quality fixes, or documentation updates. To maintain your site's performance, security, and PCIPayment Card Industry: Refers to debit and credit cards and their associated businesses. compliance, upgrade to the latest version of Magento.
Using a Sitemap
A sitemapA page that provides search engines with an efficient, alternate route through your site. improves the way your store is indexed by their search engine, and is specifically designed to find pages that might otherwise be overlooked by web crawlers. A sitemap can be configured to index all pages, and even images.
When enabled, Magento creates a file called sitemap.xml that is saved to the root directory of your installation. The configuration lets you set the frequency of the updates, and the priority for each type of content. Your sitemap should be updated as frequently as the content on your site changes, which might be daily, weekly, or monthly.
While your site is in development, you might include instructions in the robots.txtA file placed on a website that tells search engine crawlers which pages not to index. file for webcrowlers to avoid indexing the site. Then before the launch, you can change the instructions to allow the site to be indexed.
Complete the XML Sitemap configuration to determine what is included, and how frequently the sitemap is updated.
Complete the Search Engine Robots configuration with instructions that direct search engines to crawl the parts of your site that you want to be indexed.