QuidProQuo
QuidProQuo automatically scans through your site to locate your link partners. It then spiders through your link partners sites to verify reciprocal links back to you. It will find the link cheaters (those to whom you are linking but are not returning the favor). ... In addition, the full version allows you to speed up the process further by spidering upto 16 sites simultaneously. ... With multi-threading it allows you to speed up the process by spidering multiple sites at the same time (the lite version has a maximum of 2 threads).
http://www.webmastersloom.com/down...s/QuidProQuo/QuidProQuo_Setup.exe - 16Mb - Download - Screenshot

Chilkat Spider ActiveX
Crawl a website with this free ActiveX spidering component. Advanced features include caching, "avoid" patterns, and robots. txt compliance.
http://www.chilkatsoft.com/download/SpiderActiveX.msi - 536Kb - Download - Screenshot

SpiderArmor
If you own a web site with imporant information, this software is the only product available today (to the best of our knowledge) that can secure your data from spidering programs. This software is made as plugin for IIS and can be used with any scripting language supported by Microsoft IIS server. ... SpiderArmor makes your pages visible to users but not available for spidering programs that will make your data safe from scrapping by others! ... * Protection against data extraction by spidering programs.
http://www.softservice.org/download/SpiderArmor.exe - 848Kb - Download - Screenshot

Site Spider
Spiders a site and creates output files containing (1) a list of URLs in the site, (2) a Google sitemap, (3) an XML summary file with title, description, and keywords for each page, and (4) links to URLs external to the spidered domain. Robots. txt compliant.
http://www.worldwideweb-x.com/siteSpider.zip - 469Kb - Download - Screenshot

Email Extractor Jeanie Pro
Url Spider and Email Spider Jeanie Pro Url Spider and Email Spider Jeanie Pro extracted, spidered and indexed Url for your link pages, catalog system or search engine. Url Spider and Email Spider Jeanie Pro contains a special email scan modul In only a few day's you can index more than hundred... Export to: EasyLink, IndexU Web Directory, PowerSeek SQL, Gossamer Links2, Linker, LinksCaffe, MyEngines etc. ... With Url Spider and Email Spider Jeanie Pro you will carry out your own search engine- or catalog-system, very fast.
http://ptsoftware.trialfileservice.com/jeaniepro.exe - 5Mb - Download - Screenshot

Url Spider Jeanie
Url Spider Jeanie Standard the professional tool Url Spider Jeanie extracted, spidered and indexed Url for your link pages, catalog system or search engine. In only a few day's you can index more than hundred thousand of url and exported these in your system. ... Export to: EasyLink, IndexU Web Directory, PowerSeek SQL, Gossamer Links2, Linker, LinksCaffe, MyEngines etc. ... With Url Spider Jeanie you will carry out your own search engine- or catalog-system, very fast. ... In short: Url Spider Jeanie is the perfect tool for you!
http://ptsoftware.trialfileservice.com/spider.exe - 5Mb - Download - Screenshot

QuadSucker-Web
QuadSucker/Web is a multithreaded website downloader. The fact that it is multithreaded means that it is one of the fastest downloaders around and is capable of downloading several files at once. It is optimized for downloading images, and includes built in support for viewing GIF, JPEG, BMP,... Setup options allow limits on spidering depth and types of files to download. ... Built in duplicate database and duplicate remembering. ... Built in cookie tracking allows you to download sites that use cookies to try to prevent automated downloading.
http://quadsucker.com/quadweb/qdweb31.exe - 1Mb - Download - Screenshot

Web Scraper Plus+: Web Spider Edition
Build a custom web spider / web crawler using web data extraction / screen scraping technology. Use the web extract for web data mining of contact lists, product catalogs, government databases, real estate listings, or build a custom email extractor. ... The website spider / crawlers can even sort and filter the webpages while spidering. ... com, Affiliate Management, Ad Management) 4. ... Automate Online Marketing (GoogSpy. ... Analyze Financial News and Information (Hedge Funds, Day Trading) 5.
http://www.webdataextraction.net/WebScraperPlus.exe - 16Mb - Download - Screenshot

NetTools Spider
NetTools Spider is a multi-functional Internet spidering utility that supports: website downloading, offline browsing, link checking, and real-time web mining. You can download, search and data mine websites, quickly and easily. Its intuitive user interface and powerful features make it simple... You can search thousands of web sites and only download the files that contain the words you're looking for. ... You can search downloaded web sites with amazing speed or you can search the Internet for files containing keywords.
http://www.questronixsoftware.com/Download/NetToolsSpider2.1Setup.exe - 2Mb - Download - Screenshot

Visual Web Task
Visual Web Task creates executable spiders for your download and extraction needs. You can teach your spider how to negotiate logins , proxies and security pages to download and extract what You need - files , emails , search results. One spider can invoke another and this let You create a... E. ... 5. ... The product uses Internet explorer as web engine so installation of I. ... The tool is completely visual and there is no need to be a programmer to use it.
http://www.lencom.com/ftp/SetupVWT.exe - 4Mb - Download - Screenshot