6 Commits

Author	SHA1	Message	Date
Michael Peter Christen	0fe8be7981	enhaced data structures for balancer and latency computation which ... should produce a bit better prognosis about forced waiting times.	2012-10-30 17:30:24 +01:00
Michael Peter Christen	b2ffd49817	less latency	2012-10-30 12:26:32 +01:00
Michael Peter Christen	0833937c1c	better balancing and duetime-cumputation also for no-delay intranet ... hosts	2012-10-30 11:28:49 +01:00
Michael Peter Christen	2d9e577ad0	replaced the custom robots.txt loader by the standard http loader	2012-10-28 22:48:11 +01:00
orbiter	8952153ecf	update to Balancer algorithm: ... - create a load list from the current list of known hosts - do not create this list for each Balancer.pop access - create the list from those hosts which have a zero-waiting time - select 1/3 from that list which have the most urls waiting - get hosts from the wainting list in random order - fixes for some delta-time computations - always load all urls from hosts which have never been loaded before	2012-10-28 13:24:49 +01:00
Michael Peter Christen	00c1c777fa	refactoring	2012-09-21 15:48:16 +02:00