Sitemap Creator Revision History

Version 3.2.4

• Added "Accept-Language" header to HTTP requests
• Fixed a minor bug in JavaScript parser

Version 3.2.3

• Fixed a bug that could cause an unhandled exception to occur when access in the scheduler on Windows Vista/7

Version 3.2.2

• Fixed a regression bug in the task scheduler/command line interface
• Fixed an unhandled error in the Task Scheduler (affected some Vista/Win7 PCs)
• Removed Yahoo's ping URL from the list of default Ping URLs (Yahoo is phasing this out as part of their search merger with Bing)

Version 3.2.1

• Fixed a bug that would prevent Sitemap Creator from crawling on some Windows XP systems

Version 3.2.0

• Added "Soft 404" detection
• Crawler enhancements for improved website compatibility
• Added option to Image Info context menu to allow excluding image from sitemap
• Added option to obey no-index meta tags
• Added support for internationalized domain names (IDNA encoding)

Version 3.1.8

• Fixed CSV sitemap import
• Fixed various issues related to cookies when crawling
• Windows Program Compatibility Assistant no longer appears on Windows 7

Version 3.1.7

• Updated installer package
• HTML "Base" tag is now used when parsing image URLs
• Fixed bug that would cause no ping URLs to be shown for new users

Version 3.1.6

• Updated cookie handler for improved site compatibility
• Improved handling of HTML base tag
• Fixed errors while pinging on some systems
• Fixed errors while important projects on some systems
• Fixed handling of IE conditional comments (only affects some sites)
• Fixed handing of invalid character encoding value in Content-Type

Version 3.1.5

• Fixed casing issue with Image Sitemap URLs
• HTML "base" tag now used when parsing Image URLs for image sitemaps
• Excluded URL list is now applied to image URLs for image sitemaps

Version 3.1.4

• Minor internal changes to reduce installer file size
• Fixed minor issues with project export/import that could cause unexpected errors

Version 3.1.3

• Added option to use HTTP 1.0
• Added option to obey robots "nofollow" meta tag
• Fixed issue that could cause unexpected error to occur during crawl when creating image sitemaps

Version 3.1.2

• Fixed issue that caused "Root URL" option not to work correctly in Priority Rules

Version 3.1.1

• Fixed "No Priority Rules" text appearing even when Priority Rules are present

Version 3.1.0

• New multi-threaded crawler for significantly faster crawls
• Support for Google Mobile sitemaps
• Support for Google Image sitemaps (with automatic image data extraction)
• Added options to enable/disable HTTP keep-alive
• Added options to enable/disable HTTP compression
• Improved project Export/Import (results and data are now included)

Version 3.0.5

• Fixed "OK" button not working on Advanced Project Settings window

Version 3.0.4

• Fixed "Delete URL" in Excluded Pages always disabled
• Fixed Root URL case sensitivity issue
• Fixed scheduler error if incorrect password supplied with scheduled task
• Added support for Google's Ajax crawling framework ("_escaped_fragement_")
• Updated "Default Project Settings" page (differentiates itself from "Advanced Project Settings")

Version 3.0.3

• Fixed pages in sitemap not updated after editing Excluded Pages list

Version 3.0.2

• Fixed condition where scheduled tasks could load incorrect settings

Version 3.0.1

• Enhanced Scheduler so tasks can be scheduled to run when user is not logged on
• File change history is only saved if crawl completes successfully. If crawl is aborted, history is not saved.
• Excluded pages now works correctly when non standard port is used.
• Changed Additional Root URL behavior, pages under Additional Root URL paths are now treated as internal.
• Updated installer to automatically launch Sitemap Creator after installation

Version 3.0.0

• Added Automatic Sitemap Priority
• Renamed "Site Sections" to "Priority Rules"
• Added FTP "Browse" to select upload folder
• New crawler options
• Added Updated Pages and crawler log
• Added FTP upload status to email alerts
• Added "Import Sitemap" option for modifying Priority and Update Frequency values of existing sitemaps
• Sitemap Creator now saves sitemap information with project
• New Windows 7 look and feel
• Added ability Import/Export project files to/from other Inspyder applications
• New easier scheduler interface, allows editing of scheduled tasks and uses wizard interface
• Scheduling tasks no longer requires windows password
• New report engine no longer requires GAC registration
• Now runs as 64-bit processes on 64-bit versions of Windows

Version 2.0.12

• Canonical URL detection is now case insensitive (was causing problems if casing did not match link)
• Fixed "Create Site Section" shortcut that was effected by some Root URLs
• If all content included in Sitemap, email notification now correctly shows all URLs that have been updated (not just HTML content)
• Fixed Sitemap Creator application name not appeared correctly in some 3rd party firewall applications
• Fixed trailing slash duplicate URL problem
• Fixed Ask.com ping timeout issue

Version 2.0.11

• Added Microsoft's Bing search engine to Sitemap Ping URL list

Version 2.0.10

• Added ability to exclude HTML and Style from duplicate content detection (and Last Updated calculation)

Version 2.0.9

• Fixed minor URL decoding problem
• Minor updates to default HTML sitemap templates
• Fixed an issue that would keep some URLs from appearing in the HTML sitemap
• HTML sitemap grouping is no longer case sensitive
• Added support for Canonical URLs as defined by Google

Version 2.0.8

• HTML sitemaps are now encoded in UTF-8
• Fixed compatibility issue with servers using Content-Location header

Version 2.0.7

• Fixed a bug in the trial that could cause sitemaps to contain less than the 25 page maximum

Version 2.0.6

• Fixed Site Sections not applied correctly if site uses mix of HTTP and HTTPS
• Updated crawler to include additional HTML attributes
• Now impossible to create project with invalid characters in name
• Fixed several minor problems caused by localized versions of Windows

Version 2.0.5

• Updated schema location information so sitemaps pass 3rd party validators (does not affect Google compatibility)

Version 2.0.4

• Fixed a minor bug that could occur on some systems when saving sitemap files

Version 2.0.3

• Fixed performance issue when running as scheduled task
• Minor change to installer for improved compatibility

Version 2.0.2

• Fixed a minor UI bug that caused spacing to the left of the Sitemap Result items
• Fixed a minor bug that could cause HTML sitemaps not to work correctly
• Fixed a minor bug in crawler that could stop crawl if an invalid relative path occurred during an HTTP redirect

Version 2.0.1

• Fixed unexpected exception that could occur on some PCs while crawling
• Redirect destination URLs are now included in sitemap (rather than the actual redirect)

Version 2.0.0

• Major Update: Sitemap Creator now requires .NET 2.0 or later
• Significantly reduced memory utilization for large sites
• Improved email notification, now page that have changed are marked as Added, Removed or Updated
• FTPS and SSH (via SFTP) file transfers are now supported

Version 1.2.5

• Added ability to include Meta Description text from crawled pages in HTML sitemaps
• Fixed an HTML entity decoding bug when 2 digit hex values are used
• Fixed parsing of URLs beginning with "//"
• Added basic support for crawling JavaScript
• Fixed GUI problem for Windows users using non-standard DPI screen values
• Fixed scheduler ignoring page limit value

Version 1.2.4

• Added Use SSL option to SMTP settings
• Added 'Include All Content Types' option so that non-HTML/PDF content can be included in the sitemap (disabled by default)

Version 1.2.3

• Fixed a minor bug that could stop Sitemap Creator for crawling some sites with PDF documents
• Added "Domain Alias" feature to Advanced Project Settings
• Improved crawler so that certain types of invalid links are now corrected and crawled on the fly
• Fixed a minor bug in the crawler that could cause a single page to be skipped

Version 1.2.2

• 'Ping' button now becomes active after 'Export'
• Fixed a problem exporting sitemap index file if path name contained a '.'

Version 1.2.1

• Fixed broken context menu on Sitemap Info tab

Version 1.2.0

• Changed "Additional Root URLs" to use Relative URL style
• Removed "Options", moved all global settings into projects and created Master Project to control default values
• Added user adjustable User-Agent string
• Changed text on 'Notify Search Engines' button to 'Ping Search Engines'
• Added HTML Sitemap capability
• Fixed a bug in "Duplicate Content Detection" when checking PDF documents
• Changed "Export Sitemap" to "Create Sitemap" in UI
• Improved crawler speed and reduced memory usage
• Added ability to import exclusion list from robots.txt

Version 1.1.4

• Added Moreover.com to the sitemap ping/notify list
• Added support for sitemap index files
• Crawler no longer follows HTML Form 'Action' attributes implicitly (caused problems with some websites).

Version 1.1.3

• Fixed bug that could cause Sitemap Creator to freeze when exporting on some PCs
• Updated application icon
• Updated crawler: CSS @import "filename.css" syntax now followed correctly
• Various minor improvements

Version 1.1.2

• Fixed minor internationalization issue with output format
• Added Ask.com search engine ping URL

Version 1.1.1

• Fixed a minor bug that caused the 'Detect Duplicate Content' option to not save correctly

Version 1.1.0

• Replaced 'Text' output format with CSV (Comma Separated Values)
• Added 'Gzip' export option (gzips XML output format)
• Added referrer information to the log
• Added Email Notification
• Added parameter removal capability (for removing session IDs, etc.)
• Added automatic detection (and removal) of duplicate content (such as www.example.com and www.example.com/index.html)
• Various minor improvements

Version 1.0.5

• The characters ".", "-" and "_" are now allowed in project names
• Content between <span id="isc_exclude"> tags is not included when determining if a page has changed
• Improved speed when applying Site Section rules to results

Version 1.0.4

• Added crawler count information to UI
• Export settings are now saved per project
• Crawler log now shows total elapsed time and referrer information
• Added user adjustable crawler delay (to slow crawler) and timeout period
• Various UI improvements

Version 1.0.3

• Fixed error when renaming project before crawling
• Fixed occasional error when accessing help

Version 1.0.2

• URLs with spaces (and other special characters) are now properly URL encoded in XML sitemap output

Version 1.0.1

• Fixed results not updating after modifying Site Sections
• Fixed results not sorting when column header clicked

Version 1.0.0

• Initial Release