3 Commits

Author	SHA1	Message	Date
orbiter	a6719dfd2b	- refactoring of robots parser ... - no more keep-order parameter in remove (it was not possible to make this strict, and not useful) - some small enhancements in balancer - robots parser without references in switchboard - changes synchronization in robots git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4969 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-05 00:35:20 +00:00
orbiter	474e29ce4a	added options to configure the 'corporate identity'-icons, the home page link and the greeting line from ... the skin menue. Additionally an example is given there how to integrate a search page with an iframe. Please see the skin menu. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4967 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-03 23:37:04 +00:00
orbiter	474659a71f	- modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order ... - added option to set minimum crawl delta for domains in balancer - added default values to crawl deltas in yacy.init - added configuration for these deltas in performance queues - enhanced performance setting computation (more time for indexing queue for a faster flush - remote crawling is now enabled during local crawling if indexer has space and time for more links - added database stub for new distributed file system - refactoring of time computation to get an abstraction level that will be used by a TTL rule in new distributed file system git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4966 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-03 13:08:37 +00:00