yacy_search_server/source/de/anomic/crawler
Michael Peter Christen 3dd8376825 added automatic cleaning of cache if metadata and file database size is
not equal. It might happen that these data is different because one of
that caches is cleaned after a while or when it is too big. The metadata
is then not cleaned, but now wiped after a checkup process at every
application start. This should cause a bit less memory usage.
2012-06-06 14:15:24 +02:00
..
retrieval add-on to latest commit 2012-05-21 17:52:30 +02:00
Balancer.java hack against 100% cpu during crawl delete 2012-05-23 15:45:07 +02:00
Cache.java added automatic cleaning of cache if metadata and file database size is 2012-06-06 14:15:24 +02:00
CrawlProfile.java Added more steering in Crawler_p.html interface 2012-05-23 18:00:37 +02:00
CrawlQueues.java fixed bug in solr error document 2012-05-14 14:56:21 +02:00
CrawlStacker.java bugfix to http://bugs.yacy.net/view.php?id=181 2012-05-19 01:06:33 +02:00
CrawlSwitchboard.java Now used synchronization in all close() methods to make sure all objects 2012-05-14 07:41:55 +02:00
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
Latency.java enhanced crawler/balancer: better remaining waiting-time guessing 2012-05-15 12:24:54 +02:00
NoticedURL.java Now used synchronization in all close() methods to make sure all objects 2012-05-14 07:41:55 +02:00
ResourceObserver.java more logging in resource observer 2012-02-23 01:20:42 +01:00
ResultImages.java ConcurrentLinkedQueue has a VERY long return time on the .size() method. 2012-02-27 00:42:32 +01:00
ResultURLs.java ehanced location search: 2012-05-31 22:39:53 +02:00
RobotsTxt.java refactoring + parser bugfixes 2012-05-04 17:28:27 +02:00
RobotsTxtEntry.java - enhanced logging in robots.txt parser for remote debugging 2011-11-16 01:03:49 +00:00
RobotsTxtParser.java refactoring + parser bugfixes 2012-05-04 17:28:27 +02:00
RSSLoader.java refactoring: 2011-09-25 16:59:06 +00:00
SitemapImporter.java refactoring: 2011-09-25 16:59:06 +00:00
ZURL.java fixed bug in solr error document 2012-05-14 14:56:21 +02:00