yacy_search_server/source/net/yacy/crawler
orbiter 354ef8000d - added 'deleteold' option to crawler which causes that documents are
deleted which are selected by a crawl filter (host or subpath)
- site crawl used this option be default now
- made option to deleteDomain() concurrency
2012-11-04 02:58:26 +01:00
..
data - added 'deleteold' option to crawler which causes that documents are 2012-11-04 02:58:26 +01:00
retrieval in case that a crawl profile has a collection assigned, use the 2012-10-31 14:08:33 +01:00
robots enhaced data structures for balancer and latency computation which 2012-10-30 17:30:24 +01:00
Balancer.java update to HostBrowser: 2012-11-02 13:57:43 +01:00
CrawlStacker.java in case that a crawl profile has a collection assigned, use the 2012-10-31 14:08:33 +01:00
CrawlSwitchboard.java in case that a crawl profile has a collection assigned, use the 2012-10-31 14:08:33 +01:00