CoffeeCup Google SiteMapper
By placing a Sitemap-formatted file on your webserver, you enable the Google crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly. Using Sitemaps to inform and direct the Google crawlers, they hope to expand their coverage of the web and... It's very important to have a site map so search engines can find all of your pages. ... Just point CoffeeCup Google SiteMapper to where your Website is located at on your hard drive and it will create a nice page you can use for a site map.
http://mercedes.coffeecup.com/CoffeeGoogleMapper45.exe - 3Mb - Download - Screenshot

!Delicioso!
Power tool for submitting URLs to del. icio. us. Interactively crawl a site and submit to del. icio. us. Title, extended description, and tags are generated automatically from each URL submitted. Batch submit capable.
http://www.worldwideweb-x.com/delicioso.zip - 563Kb - Download - Screenshot

EScrambler - Webmaster Antispam Utility
Are you getting too much junk email from your web site? Provide your email addresses to legitimate visitors of your web site without ending up on more junk email lists. Do it - fast and easy - with EScrambler. The entire program and all the documentation is on one web page. ... They crawl your web site for only one purpose -- to add your email addresses their spam lists. ... Human visitors to your site are NOT causing your spam problem. ... EScrambler does not stop search engine robots from indexing your site.
http://innerpeace.org/download/escramb.zip - 9Kb - Download - Screenshot

Trellian SiteSpider
Trellian SiteSpider is a powerful, yet simple to use program which is loaded with sophisticated search, web crawling and site mapping functions. What does SiteSpider do? SiteSpider can be used simply as a web browser, which works cooperatively with Internet Explorer to allow importing and... While using SiteSpider in just the same way as a web browser, you can also search for and list photos, movies, email addresses, applications, documents, music and more. ... SiteSpider will also list every HTML document that it has crawled.
http://www.trellian.com/bin/lu/dl/SiteSpider.exe - 2Mb - Download - Screenshot

Xtreeme SiteXpert Standard Edition
With SiteXpert you can create a professional navigation scheme (such as a DHTML drop down menu or site map tree) within a few minutes. You can also create Google Sitemaps or ROR. No JavaScript knowledge is required. All you need to do is pick a base URL and let the program crawl through your... This tool can build 12 different navigation system types (static and dynamic site map tree, DHTML / Javascript drop down menu, portal interface, site index, Java applet site map tree, mega folder, hierarchical diagram, Google sitemap,ROR and more..
http://www.xtreeme.com/sitexpert/SiteXpertInstallStd.exe - 5Mb - Download - Screenshot

Sekhol Finder
Sekhol Finder is a tool for deep Internet searches. It allows to create unlimited and fully customisable list of search engines with possibility of adding user defined sites and setting search site parameters. The pages referenced in the replies that are returned by the search sites are... The search could be done in completely autonomous mode or be supervised and fine-tuned by a user. ... In the case of long searches the project data can be saved, and the search can be resumed later. ... The application also allows to download pages from a user defined list or URL's and create a list of...
http://www.sekhol.com/files/SekholFinder23.zip - 2b - Download - Screenshot

PADexpress
Automatically submit your software PAD file to 100+ shareware and freeware sites with just one click. PADexpress fully automates the process of submitting software PAD files to over 100 popular shareware and freeware sites. Simply enter a URL pointing to your PAD file and a category selection. ... PADexpress will then crawl through a list of over 700 software directories, submitting your PAD files. ... Fully automated and accurate submissions. ... Includes resume ability to continue from previous submission.
http://www.dummysoftware.com/PADexpressSetup.exe - 845Kb - Download - Screenshot

PornBot
PornBot is a unique software program that will crawl through various sites listing adult movie and picture galleries. It will get the links, download the content, and save it to your harddrive. You can set the program to only get pictures and/or movies that matches one or several specific... PornBot uses multiple connections to download the content, this makes it go as fast as possible while maintaing the high quality standard that the PornBot Windows software provides. ... The flexible database also allows you to add your own MGP's and/or TGP's (Movie/Thumbnail Gallery Posts).
http://www.porn-bot.net/install_pb_shareware.exe - 2Mb - Download - Screenshot

Xtreeme SiteXpert Professional Edition
With SiteXpert you can create a professional navigation scheme (such as a DHTML drop down menu or site map tree) within a few minutes. You can also create Google Sitemaps or ROR. No JavaScript knowledge is required. SiteXpert also generates search engines hosted by your own web server / ISP,... This tool can build 12 different navigation system types (static and dynamic site map tree, DHTML / Javascript drop down menu, portal interface, site index, Java applet site map tree, mega folder, hierarchical diagram, Google sitemap,ROR and more..
http://www.xtreeme.com/sitexpert/sitexpertinstall.exe - 9Mb - Download - Screenshot

PRdigger
PRdigger is a unique application that digs through the pages of Google and searches for sites that have a specific pagerank (PR), based on your keywords. Our application digs through the pages of Google at lightning speed and produces a list of sites that have a page ranking, based on the... You may have seen other applications that crawl at snails pace through Google? ... You will be able to scan over 2000 domain names per minute using your own custom lists. ... This incredible speed makes PRdigger the fastest PR scanning application on the market today for the price!
http://www.prdigger.com/download.zip - 0b - Download - Screenshot