Search engines improve XML sitemaps with robots.txt
After Google/Yahoo/MSN announced support for XML sitemaps protocol, it was only a matter of time before more would follow. Yesterday it was announced that Ask.com and IBM have been added to the list of XML sitemap protocol supporters.
One of the hottest news seem to be that it is now possible to link your xml sitemap from your robots.txt file.
You can simply add this line to your robots.txt file:
Sitemap: http://www.example.com/sitemap.xml
I think this change will help make the XML sitemaps protocol a widely used standard. The primary reason being it enables search engines to automatically discover XML sitemaps on their own.
For more information, you can check two recent blog posts by Google and Yahoo.
