Microsys Blog

Independent Software Vendor (ISV) Company



Category: XML sitemaps

Search engines improve XML sitemaps with robots.txt

12 April, 2007 (16:18) | A1 Sitemap Generator, Marketing, Search engine optimization, XML sitemaps

After Google/Yahoo/MSN announced support for XML sitemaps protocol, it was only a matter of time before more would follow. Yesterday it was announced that Ask.com and IBM have been added to the list of XML sitemap protocol supporters.

One of the hottest news seem to be that it is now possible to link your xml sitemap from your robots.txt file.

You can simply add this line to your robots.txt file:
Sitemap: http://www.example.com/sitemap.xml

I think this change will help make the XML sitemaps protocol a widely used standard. The primary reason being it enables search engines to automatically discover XML sitemaps on their own.

For more information, you can check two recent blog posts by Google and Yahoo.

A1 Sitemap Generator 1.4.4 released

14 March, 2007 (18:03) | A1 Sitemap Generator, HTML sitemaps, Marketing, News, Search engine optimization, XML sitemaps

  • Made the HTML parser much faster
  • Added BOM checking (in addition to server response headers and the “charset” meta tag) to identify the character set used in HTML documents
  • Korean translation by Eunsook Kim, http://www.famun.com
  • Fixed a bug concerning reading UTF8 translation files with a leading BOM
  • Fixed a bug concerning website crawler ignore filters
  • Fixed an issue in ASP.Net sitemaps (these can be used in ASP.Net controls)
  • Fixed a bug related to LastMod in XML sitemaps

Read more about A1 Sitemap Generator or try it now

Sitemap generator can pause and resume website crawling

22 February, 2007 (22:29) | A1 Sitemap Generator, HTML sitemaps, Marketing, News, Search engine optimization, XML sitemaps

I released a new version of A1 Sitemap Generator yesterday with a bunch of news:

  • Website scanner now uses a load balanced thread / work pool.
  • Added support pause and resume website crawl.
  • New “allow” crawler filters (complements “ignore” and “output” filters).
  • Various speed and memory usage optimizations.
  • Miscellaneous bug fixes etc.

To see all recent changes, see A1 Sitemap Generator news

Article about Google sitemaps and priority values

12 July, 2006 (04:04) | A1 Sitemap Generator, Marketing, Search engine optimization, XML sitemaps

You can find it in the webmaster articles section with title:
XML Google sitemaps and priority values

It explains the priority tag, when it is useful, and why using a software product to calculate priorty values can be a good idea for the busy webmaster.

New webmaster / SEO tools series

21 April, 2006 (13:18) | A1 Sitemap Generator, A1 Website Analyzer, Google Adwords, HTML sitemaps, Marketing, News, Pay per click, Products, Search engine optimization, XML sitemaps

Within the last few months we have released:

We still have a few ideas for new applications,
but I suspect most of my time will be consumed by
implementing requests and suggestions from feedback :-)

If you are a Webmaster and/or doing SEO,
I suggest you check out above tools :-)

A1 Sitemap Generator Version 1.0 Released

26 January, 2006 (16:16) | A1 Sitemap Generator, HTML sitemaps, press releases, XML sitemaps

Generate sitemaps for your website in both HTML and Google XML formats
Micro-Sys announces the availability of A1 Sitemap Generator for Windows, a website scanner, sitemap builder, and sitemap FTP upload tool for Windows 95/98/ME/NT/2000/XP/2003.

You can generate sitemaps over static and dynamic database websites, including sites and pages using https protocol, CD/DVD content, and local/network disks. A1 Sitemap Generator also optionally supports robots.txt, a file often used by webmasters to guide website crawlers.

The sitemap builder has both simple options for linking, titles, columns etc. and advanced options including a rich template system featuring 20+ fields for defining code (e.g. HTML) output. This allows for easy and tight integration into existing pages and site layout.

The sitemap builder system is accompanied by a configurable crawler that can retrieve and store vast amounts of website data. You can view site structure, pages found, broken and redirected links (wherefrom and whereto), summaries for directories, and more. This data also allows for generating Google XML sitmaps with fields such as already calculated and defined.

It is possible to automate and control A1 Sitemap Generator through the command line. This means you can have a task scheduler (or script/batch file) to launch A1 Sitemap Generator at given intervals. You can automate tasks such as scan website, build sitemap and FTP sitemap upload.

Micro-Sys A1 Sitemap Generator is the first product in a series aimed at website professionals. Upcoming products include A1 Website Analyzer which has website XML data export and search engine optimization tools. For more info, see http://www.microsystools.com/products/website-analyzer/.

A fully functional trial version is available to the public at http://www.microsystools.com/. Program registration is only $39.00 (USD), and may be completed from the company’s website.