orbiter d7d38f9135 made number of open files in crawler configurable and increased default ... maximum number of open files from 100 to 1000. This number can be changed with the attribut crawler.onDemandLimit		2014-05-31 09:29:55 +02:00
..
data	made number of open files in crawler configurable and increased default	2014-05-31 09:29:55 +02:00
retrieval	added crawl depth for failed documents	2014-04-17 13:21:43 +02:00
robots	new Strategies in Balancer:	2014-04-17 12:52:54 +02:00
Balancer.java	- added a new Crawler Balancer: HostBalancer and HostQueues:	2014-04-16 21:34:28 +02:00
CrawlStacker.java	added crawl depth for failed documents	2014-04-17 13:21:43 +02:00
CrawlSwitchboard.java	npe fix	2014-04-29 19:24:05 +02:00
HarvestProcess.java	fix for wrong display of error urls in HostBrowser	2012-12-07 00:31:10 +01:00
HostBalancer.java	made number of open files in crawler configurable and increased default	2014-05-31 09:29:55 +02:00
HostQueue.java	fix crawl of file:// , also http://mantis.tokeek.de/view.php?id=149	2014-05-28 03:01:34 +02:00
LegacyBalancer.java	special strategy for balancer: do not remove targets with zero wait time	2014-04-18 06:50:07 +02:00