Creating a Sitemap for your website and keeping it up-to-date are important SEO best practices. Search engines can crawl and index your website more completely if they have an XML Sitemap for reference. This necessary SEO research covers how to create a XML Sitemap so you can welcome search engine spiders and help them find their way around when they visit.
What Is a Sitemap?
An XML Sitemap is a text file webmasters create to tell search engines like Google and Bing what a website contains. It is basically a list of all the URLs that should be indexed — URLs of web pages, images, videos and other content files on the site — formatted with a few XML tags. XML Sitemaps should not be confused with HTML site maps, which are regular web pages created to help human visitors get around a website. However, each has SEO benefits, so you should create both XML and HTML types for your site. Here are the differences:
XML Sitemap HTML Site Maps
Crawlable by search engines Yes Yes
Read by human visitors No Yes
Maximum size 50,000 URLs or 50MB uncompressed Not specified, but keep it user-friendly
Format XML file (plain text), Web page (can be pretty)
Linked from Robots.txt file Site navigation (footer)
Recommended for SEO Yes - Yes
How Many Sitemaps Should I Create?
Unlike submitting your site manually, which is a completely optional task, every site needs at least one XML Sitemap. Large websites may need several to ensure that the number of page URLs per Sitemap doesn't exceed the limit. It is also recommended (for any size website) that certain types of files be listed in their own specialized Sitemap: videos and news, for two examples. Therefore, if you have videos on your site, create a specialized video Sitemap to help make sure the search engines find your video files.
In another of his many useful videos for webmasters, Google's Matt Cutts answers the question, "Which is better: an HTML site map or XML Sitemap?"
Listen as he explains that since they meet different needs, both are important.
How to Create an XML Sitemap
You can create a Sitemap manually, but using a Sitemap generator makes the job easier. There are many good third-party tools for creating XML Sitemap automatically. One is Microsoft Bing’s free server-side Bing XML Sitemap Plugin, which can automatically generate two types of XML Sitemaps that can be read by any search engine:
• Comprehensive Sitemap, which includes all files (except any you disallow in your robots.txt file)
• Recently updated Sitemap, which includes URLs of changed files only (useful for your own tracking or for prioritizing the pages that search engines should crawl)
NOTE: Any search engine can read your XML Sitemap files because they comply with Sitemaps.org protocol.
How to Submit Your Sitemap to Search Engines
You can submit your XML Sitemap to Google and Bing using the Sitemaps feature within their webmaster tools:
• Google: Log in to your Google Webmaster Tools account. Under the Crawl menu, choose Sitemaps.
• Bing: Log in to Bing Webmaster Tools. You can use the Sitemap widget on your Dashboard or go to the Sitemap feature, located under the Configure My Site section.
The above methods let you proactively submit your XML Sitemap file(s) to the search engines if you want to. Regardless, make sure you specify your XML Sitemap location in your robots.txt file, where the spiders are sure to find it then next time they come crawling. (A robots.txt file is simply a text file saved at the root of your website that gives instructions to visiting search engine spiders.) Your robots.txt file should look similar to this, with a Sitemap directive line for each of your different XML Sitemap:
That's it! Once you create your XML Sitemap and tell search engines where to find them using your robots.txt file, the search engine spiders should do the rest. If you need more details on creating a Sitemap, see Google’s Webmaster Tools Help.