Michael Peter Christen ad0da5f246 added new web page snapshot infrastructure which will lead to the ... ability to have web page previews in the search results. (This is a stub, no function available with this yet...)		2014-11-29 11:56:32 +01:00
..
data	added new web page snapshot infrastructure which will lead to the	2014-11-29 11:56:32 +01:00
retrieval	added new web page snapshot infrastructure which will lead to the	2014-11-29 11:56:32 +01:00
robots	more ipv6 bugfixes	2014-10-08 15:21:49 +02:00
Balancer.java	- added a new Crawler Balancer: HostBalancer and HostQueues:	2014-04-16 21:34:28 +02:00
CrawlStacker.java	explain crawl denial when not switched to intranet mode	2014-10-11 09:02:12 +02:00
CrawlSwitchboard.java	added new web page snapshot infrastructure which will lead to the	2014-11-29 11:56:32 +01:00
HarvestProcess.java	fix for wrong display of error urls in HostBrowser	2012-12-07 00:31:10 +01:00
HostBalancer.java	reduce number of calls to queue.size() because that may be a bottleneck	2014-11-23 20:09:32 +01:00
HostQueue.java	more stacks shall be considered for on-demand loading, not only	2014-11-23 20:11:23 +01:00
LegacyBalancer.java	special strategy for balancer: do not remove targets with zero wait time	2014-04-18 06:50:07 +02:00