yacy_search_server/source/de/anomic/crawler
Michael Peter Christen 96f6a5869f more robust OAI-PMH client (large time-out, three re-tries). OAI-PMH
server appeart to be very slow sometimes
2012-06-16 22:30:31 +02:00
..
retrieval more robust OAI-PMH client (large time-out, three re-tries). OAI-PMH 2012-06-16 22:30:31 +02:00
Balancer.java hack against 100% cpu during crawl delete 2012-05-23 15:45:07 +02:00
Cache.java flush the compressor cache when a cleanup is done 2012-06-07 19:42:33 +02:00
CrawlProfile.java removed warnings 2012-06-05 20:03:43 +02:00
CrawlQueues.java fixed bug in solr error document 2012-05-14 14:56:21 +02:00
CrawlStacker.java Rewrote all String blacklist types to enum 'BlacklistType', closes bug 2012-06-11 00:17:30 +02:00
CrawlSwitchboard.java Now used synchronization in all close() methods to make sure all objects 2012-05-14 07:41:55 +02:00
ImporterException.java
Latency.java enhanced crawler/balancer: better remaining waiting-time guessing 2012-05-15 12:24:54 +02:00
NoticedURL.java Now used synchronization in all close() methods to make sure all objects 2012-05-14 07:41:55 +02:00
ResourceObserver.java more logging in resource observer 2012-02-23 01:20:42 +01:00
ResultImages.java ConcurrentLinkedQueue has a VERY long return time on the .size() method. 2012-02-27 00:42:32 +01:00
ResultURLs.java ehanced location search: 2012-05-31 22:39:53 +02:00
RobotsTxt.java refactoring + parser bugfixes 2012-05-04 17:28:27 +02:00
RobotsTxtEntry.java - enhanced logging in robots.txt parser for remote debugging 2011-11-16 01:03:49 +00:00
RobotsTxtParser.java refactoring + parser bugfixes 2012-05-04 17:28:27 +02:00
RSSLoader.java refactoring: 2011-09-25 16:59:06 +00:00
SitemapImporter.java refactoring: 2011-09-25 16:59:06 +00:00
ZURL.java fixed bug in solr error document 2012-05-14 14:56:21 +02:00