| Site Spider | |||
| By Tortuga Group LLC | |||
| Release date: | 19 Aug 2005 | ||
| Platform: | Win95, Win98, WinME, WinNT 4.x, WinXP, Win2000 | ||
| Language: | English | ||
| License: | Freeware | ||
| |||
Spiders a site and creates output files containing (1) a list of URLs in the site, (2) a Google sitemap, (3) an XML summary file with title, description, and keywords for each page, and (4) links to URLs external to the spidered domain. Robots.txt compliant.
Tags: site spider, xml file, output file, title description, google sitemap