yacy_search_server/source/de/anomic/crawler
orbiter a7df70221e refactoring
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7987 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-10-04 09:06:24 +00:00
..
retrieval - performance hacks (should affect the crawl balancer and reduce CPU load during crawl stack re-fill) 2011-09-30 07:57:50 +00:00
Balancer.java - fix for incomplete clear() in balancer 2011-09-30 10:27:14 +00:00
CrawlProfile.java added directDocByURL attribute in crawl profile 2011-09-30 12:38:28 +00:00
CrawlQueues.java refactoring 2011-10-04 09:06:24 +00:00
CrawlStacker.java refactoring 2011-10-04 09:06:24 +00:00
CrawlSwitchboard.java added directDocByURL attribute in crawl profile 2011-09-30 12:38:28 +00:00
ImporterException.java
Latency.java another performance hack: re-use of known host addresses for isLocal property; avoids look-up in local hash 2011-09-30 08:26:31 +00:00
NoticedURL.java added a handling of appearances of yacy bot entries in robots.txt if this entry addresses the yacy peer 2011-04-03 23:39:45 +00:00
ResourceObserver.java refactoring: 2011-09-25 16:59:06 +00:00
ResultImages.java - fixed a bug in crawl start with file name (npe in new url) 2011-04-18 16:11:16 +00:00
ResultURLs.java refactoring: moved all score-related classes to new ranking package 2011-08-22 22:37:53 +00:00
RobotsTxt.java - enhanced ybr ranking computation 2011-05-26 10:57:02 +00:00
RobotsTxtEntry.java hack to reduce resource contention caused by massive UTF8 decodings which use java.nio resources: 2011-05-27 08:24:54 +00:00
RobotsTxtParser.java - refactoring of robots 2011-05-02 14:05:51 +00:00
RSSLoader.java refactoring: 2011-09-25 16:59:06 +00:00
SitemapImporter.java refactoring: 2011-09-25 16:59:06 +00:00
ZURL.java - performance hacks (should affect the crawl balancer and reduce CPU load during crawl stack re-fill) 2011-09-30 07:57:50 +00:00