yacy_search_server/source/de/anomic/crawler
2010-10-13 13:00:36 +00:00
..
retrieval patches for bad proxy behaviour 2010-10-11 11:38:36 +00:00
Balancer.java redesign of crawl profiles data structure. target will be: 2010-08-31 15:47:47 +00:00
CrawlProfile.java custom + generic skins: 2010-10-11 00:00:10 +00:00
CrawlQueues.java enhanced remote crawling: 2010-09-16 09:34:17 +00:00
CrawlStacker.java replaced auto-dom filter with easy-to-understand Site Link-List crawler option 2010-09-30 12:50:34 +00:00
CrawlSwitchboard.java fixed a number of small bugs: 2010-09-30 23:57:58 +00:00
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
Latency.java preparations to move the HTCache into cora: 2010-08-23 12:32:02 +00:00
NoticedURL.java redesign of crawl profiles data structure. target will be: 2010-08-31 15:47:47 +00:00
ResourceObserver.java change in handling of the all-visible home path for storage in YaCy: 2010-09-02 19:24:22 +00:00
ResultImages.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
ResultURLs.java fixed a number of small bugs: 2010-09-30 23:57:58 +00:00
RobotsEntry.java - replaced pdfbox and fontbox version 1.1.0 with 1.2.1 2010-09-07 17:13:47 +00:00
robotsParser.java enhanced computation speed of many replaceAll string operations 2010-09-05 13:19:42 +00:00
RobotsTxt.java - moved yacybot user agent string definition to MultiProtocolURI since there are basic access mechanisms where the bot string is needed 2010-09-27 14:54:32 +00:00
RSSLoader.java fix for scheduling of rss feeds 2010-10-13 13:00:36 +00:00
SitemapImporter.java - moved yacybot user agent string definition to MultiProtocolURI since there are basic access mechanisms where the bot string is needed 2010-09-27 14:54:32 +00:00
ZURL.java fixed crawler bug caused by NPE in logging 2010-08-12 01:29:56 +00:00