Configuring an XML Sitemap with Google XML
Sitemaps
Install and activate the plugin.
Access the robots.txt file. A sample robots.txt file will be generated. Let’s try accessing it. For example, if your WordPress URL is
https://getshifter.io, add/robots.txtto the end of the URL to access it. Sample robots.txt:User-agent: *
Disallow: /
Sitemap: /sitemap_index.xmlCheck the sitemap.xml file. The app’s sitemap URL will look like /sitemap.xml. XML Sitemap Index generated by the Google XML Sitemaps plugin:
Disable notification settings. To prevent the temporary URL from being sent to search engines, uncheck the following two checkboxes under [Basic Options]:
- Notify Google of site updates
- Notify Bing (formerly MSN Live Search) of site updates
Generate and deploy the artifact. Once you’ve verified the sitemap file, publish it. Click the [Generate Artifact] button.
- Double-check the robots.txt file. Add
/robots.txtto the end of the URL and access the Shifter site.User-agent: *
Disallow: /
Sitemap: http://modest-wescoff7228.static.getshifter.net/sitemap_index.xml Access the deployed site and its generated sitemap.xml. The sitemap URL for the deployed site will look like
https://www.example.com/sitemap.xml
orhttps://foobar.on.getshifter.io/sitemap.xml
XML sitemap index generated by the Google XML
Sitemaps plugin on the deployed site:
That’s it! Search engine crawlers will now access the XML sitemap via robots.txt.