yacy_search_server/source/net/yacy/crawler
2016-12-18 01:02:56 +01:00
..
data adjust Cache getHeader to prev. changes/commit 2016-12-18 01:02:56 +01:00
retrieval Customized name for Threads still using the default "Thread-n" pattern. 2016-10-22 17:17:21 +02:00
robots Added control over Robots.txt active threads maximum number. 2016-11-23 18:13:05 +01:00
Balancer.java removed warnings 2015-08-03 05:37:34 +02:00
CrawlStacker.java expanded error message on rejected crawl url due to faile dns lookup 2016-12-15 23:59:50 +01:00
CrawlStarterFromSraper.java Advanced Crawl from local file : better processing of large files. 2016-10-21 13:03:31 +02:00
CrawlSwitchboard.java remove wrong log line in CrawlSwitchboard 2016-07-02 20:33:23 +02:00
FileCrawlStarterTask.java Crawl from local file : faster task end when manually terminating crawl. 2016-10-22 09:11:20 +02:00
HarvestProcess.java fix for wrong display of error urls in HostBrowser 2012-12-07 00:31:10 +01:00
HostBalancer.java Customized name for Threads still using the default "Thread-n" pattern. 2016-10-22 17:17:21 +02:00
HostQueue.java to prevent crawler to concurrently access and alter same crawl queue 2016-07-05 23:22:35 +02:00
IllegalCrawlProfileException.java Crawl from local file : faster task end when manually terminating crawl. 2016-10-22 09:11:20 +02:00
LegacyBalancer.java use supplied url port to get robots.txt in crawlers hostqueue 2016-03-02 00:12:34 +01:00
RecrawlBusyThread.java init Recrawl job chunk size to max crawl loader during job start, to use some system preferences 2015-10-16 03:05:39 +02:00