orbiter 8952153ecf update to Balancer algorithm: ... - create a load list from the current list of known hosts - do not create this list for each Balancer.pop access - create the list from those hosts which have a zero-waiting time - select 1/3 from that list which have the most urls waiting - get hosts from the wainting list in random order - fixes for some delta-time computations - always load all urls from hosts which have never been loaded before		2012-10-28 13:24:49 +01:00
..
data	update to Balancer algorithm:	2012-10-28 13:24:49 +01:00
retrieval	update to Balancer algorithm:	2012-10-28 13:24:49 +01:00
robots	removed the option to prevent removal of & parts inside of the	2012-10-10 11:46:22 +02:00
Balancer.java	update to Balancer algorithm:	2012-10-28 13:24:49 +01:00
CrawlStacker.java	- removed dependencies from URIMetadataRow and made direct access to	2012-10-16 18:11:57 +02:00
CrawlSwitchboard.java	fixes to crawl profiles	2012-10-08 10:50:40 +02:00