How to generate an XML sitemap
- Enter your homepage. Use the public https address of the site. The crawl stays on that host, including a www redirect from the address you typed.
- Wait for the crawl. We request up to 200 URLs, skip anything robots.txt disallows for SEOchatBot, and refuse private, local, and non-public addresses.
- Download sitemap.xml. Upload the file somewhere public on your site, then submit that URL in Google Search Console and Bing Webmaster Tools.
What the file includes
Search engines use an XML sitemap as a list of URLs, not as a ranking signal. This sitemap generator adds a URL when the response is HTML, the status is 200, and the page does not say noindex. A redirect is listed as the URL it lands on, not the old address. Query parameters used for click tracking, such as utm tags, are dropped so the same page is not listed twice.
The crawl does not run JavaScript, sign in, or submit the file to Google for you. It does not invent last-modified dates. If the server does not send Last-Modified, that line is left out.
After you download it
Upload sitemap.xml and confirm it opens in a browser. In Google Search Console, use Sitemaps and submit the full URL. Bing Webmaster Tools has the same kind of submission. Then add the URL to robots.txt so other crawlers can find it.
Add that line with the robots.txt generator. Check pages that returned errors with the broken link checker. See the HTML a crawler reads on one URL with the spider simulator.