Freeware: Spider

 
All | Mobile
Download Heritrix 1.12.1

Heritrix 1.12.1 Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.


Advertisements

 

Freeware
Download
Download PKTorrents 0.1b 1.0

PKTorrents 0.1b 1.0 PKTorrents has the functionality to crawl the top torrent sites, Meganova, Mininova, Piratebay, Snarf, Torrentportal, Torrentspy and adding 1000's of torrents to the db as it gos using the well know ibitzy torrent Spider/crawler!!PKTorrents has the functionality to crawl the top torrent sites, Meganova, Mininova, Piratebay, Snarf, Torrentportal, Torrentspy and adding 1000's of torrents to the db as it gos using the well know ibitzy torrent Spider/crawler!!

Freeware
Download
Download Astanda Directory Project 1.3b 1.0

Astanda Directory Project 1.3b 1.0 Astanda Directory Project [ADP] is a directory, search engine, and Spider/crawler software. Your own little breed of DMOZ and Google. ADP is the only software in its class ever to be written in PHP with MySQL database support.Astanda Directory Project [ADP] is a directory, search engine, and Spider/crawler software. Your own little breed of DMOZ and Google. ADP is the only software in its class ever to be written in PHP with MySQL database support.

Freeware
Download
Download URL Web Crawler 1.0

URL Web Crawler 1.0 It is basically a program that can make you a search engine. It is a web crawler, has all the web site source code (in ASP, soon to be PHP as well), and a mysql database.It is basically a program that can make you a search engine. It is a web crawler, has all the web site source code (in ASP, soon to be PHP as well), and a mysql database.

Freeware
Download
Download swiesel 0.8

swiesel 0.8 Swiesel is an "inteligent" searchEngine to search the web for textual content in flash- sites.Swiesel is an "inteligent" searchEngine to search the web for textual content in flash- sites.

Freeware
Download
Download  Spider  Friendly "Redirect" without Hesis 1.0

Spider Friendly "Redirect" without Hesis 1.0 Like most first time users, I installed oscommerce to the default directory of /catalog/. I placed a simple redirect in the primary root to direct viewers to the /catalog/ directly. That's where my trouble began.Like most first time users, I installed oscommerce to the default directory of /catalog/. I placed a simple redirect in the primary root to direct viewers to the /catalog/ directly. That's where my trouble began.

Freeware
Download
Download  Spider  Session Remover 1.0

Spider Session Remover 1.0 This contribution uses Apache mod_rewite to look for specific spiders, and remove the session (osCsid) from the URL, and return a '301' back to the Spider .Basically, if the Spider tries to do this:GET /www.example.com/product_info.php?This contribution uses Apache mod_rewite to look for specific spiders, and remove the session (osCsid) from the URL, and return a '301' back to the Spider .Basically, if the Spider tries to do this:GET /www.example.com/product_info.php?

Freeware
Download
Download Webtools 4 larbin 1.0

Webtools 4 larbin 1.0 Larbin is a Web crawler intended to fetch a large number of Web pages. It should be able to fetch more than 100 millions pages on a standard PC with much u/d. This set of PHP and Perl scripts, called webtools4larbin, can handle the output of Larbin.Larbin is a Web crawler intended to fetch a large number of Web pages. It should be able to fetch more than 100 millions pages on a standard PC with much u/d. This set of PHP and Perl scripts, called webtools4larbin, can handle the output of Larbin.

Freeware
Download
Download  Spider  Killer for MS1 1.2

Spider Killer for MS1 1.2 The check is done only once per page (and not a lot of times as in the sugestion of the threads)If you're using it, just use the bugfix and the updated spider_configure file.The check is done only once per page (and not a lot of times as in the sugestion of the threads)If you're using it, just use the bugfix and the updated spider_configure file.

Freeware
Download
Download Web Forge  Spider  0.32

Web Forge Spider 0.32 A useful web forge Spider for specific project information retrieval, for now it works only in gforge based forges. Ite retrievals information like: Project names, repository urls, mailing list mbox urls and .tar.gz urls.A useful web forge Spider for specific project information retrieval, for now it works only in gforge based forges. Ite retrievals information like: Project names, repository urls, mailing list mbox urls and .tar.gz urls.

Freeware
Download

ScrapePro Web Scraper 1.0.0.1250 Extensible web scraper platform. Easy configuration using drag&drop, context menus and wizards. Use custom actions, converters, filters, data sources and user interface plugins such as .Net macros, Docking, Error handling, Built-in proxy, API.Extensible web scraper platform. Easy configuration using drag&drop, context menus and wizards. Use custom actions, converters, filters, data sources and user interface plugins such as .Net macros, Docking, Error handling, Built-in proxy, API.

Freeware
Download
9.3 MB
Download 123 Free Memory - Card Games Collection 3.1

123 Free Memory - Card Games Collection 3.1 123 FREE Memory Card Games 2003 is a collection of five great Memory games: Ace-To-King, Concentration, Forget-Me-Not, Memory-Up (6x4) and Memory Up (8x5).123 FREE Memory Card Games 2003 is a collection of five great Memory games: Ace-To-King, Concentration, Forget-Me-Not, Memory-Up (6x4) and Memory Up (8x5).

Freeware
Download
1.4 MB
All | Mobile