yacy_search_server/source/net/yacy/crawler
Michael Peter Christen 783cf6fbc7 the LinkedBlockingQueue is much faster than the ArrayBlockingQueue
(strange but this is the result of a test:
ArrayBlockingQueue: 39461 lines / second;
LinkedBlockingQueue: 60774 lines / second)
2015-01-27 16:53:09 +01:00
..
data fixed font size and print page generation in pdf snapshots 2015-01-20 17:14:14 +01:00
retrieval the LinkedBlockingQueue is much faster than the ArrayBlockingQueue 2015-01-27 16:53:09 +01:00
robots more ipv6 bugfixes 2014-10-08 15:21:49 +02:00
Balancer.java - added a new Crawler Balancer: HostBalancer and HostQueues: 2014-04-16 21:34:28 +02:00
CrawlStacker.java ViewFile servlet: update index if newer, 2014-12-05 01:13:37 +01:00
CrawlSwitchboard.java documents pushed over the api/push_p.html interface will have their 2015-01-06 15:22:59 +01:00
HarvestProcess.java fix for wrong display of error urls in HostBrowser 2012-12-07 00:31:10 +01:00
HostBalancer.java reduce number of calls to queue.size() because that may be a bottleneck 2014-11-23 20:09:32 +01:00
HostQueue.java more stacks shall be considered for on-demand loading, not only 2014-11-23 20:11:23 +01:00
LegacyBalancer.java special strategy for balancer: do not remove targets with zero wait time 2014-04-18 06:50:07 +02:00