Michael Peter Christen 9e503b3376 also delete the robots.txt file from the cache when a new crawl is ... started		2014-04-09 21:59:54 +02:00
..
data	fixed a bug which prevented crawl starts after a network switch	2014-04-04 14:43:35 +02:00
retrieval	fix for bad/missing values of size_i	2014-03-11 09:51:04 +01:00
robots	also delete the robots.txt file from the cache when a new crawl is	2014-04-09 21:59:54 +02:00
Balancer.java	- enhanced postprocessing speed and memory footprint (by using HashMaps	2014-02-28 14:01:09 +01:00
CrawlStacker.java	fix for bad/missing values of size_i	2014-03-11 09:51:04 +01:00
CrawlSwitchboard.java	enhanced concurrent loading by using a fixed set of concurrent loader	2014-03-03 22:13:40 +01:00
HarvestProcess.java	fix for wrong display of error urls in HostBrowser	2012-12-07 00:31:10 +01:00
HostQueue.java	- removed old metadata database and all migration code	2014-01-20 18:31:46 +01:00
HostQueues.java	Added new data structure to be used by the balancer (not used yet).	2013-09-24 21:08:40 +02:00