yacy_search_server/source/de/anomic/crawler
orbiter 94c48500cc several fixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7383 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-12-17 00:11:42 +00:00
..
retrieval several fixes 2010-12-17 00:11:42 +00:00
Balancer.java fixed crawl queue delete function 2010-12-01 14:55:40 +00:00
CrawlProfile.java custom + generic skins: 2010-10-11 00:00:10 +00:00
CrawlQueues.java * fix system update if urls are in blacklist (for example for very general blacklists like *.de) 2010-12-15 19:20:00 +00:00
CrawlStacker.java - added CamelCase parser to MultiProtocolURI: generate better to-be-indexed words from urls 2010-12-15 00:03:19 +00:00
CrawlSwitchboard.java fixed a number of small bugs: 2010-09-30 23:57:58 +00:00
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
Latency.java preparations to move the HTCache into cora: 2010-08-23 12:32:02 +00:00
NoticedURL.java enhanced crawler: 2010-12-11 00:31:57 +00:00
ResourceObserver.java change in handling of the all-visible home path for storage in YaCy: 2010-09-02 19:24:22 +00:00
ResultImages.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
ResultURLs.java - added a tag cloud to search results (using the topics) 2010-10-15 22:01:39 +00:00
RobotsEntry.java - replaced pdfbox and fontbox version 1.1.0 with 1.2.1 2010-09-07 17:13:47 +00:00
robotsParser.java added a sitemap entry parser and loader for sitemaps 2010-11-03 19:48:33 +00:00
RobotsTxt.java - moved yacybot user agent string definition to MultiProtocolURI since there are basic access mechanisms where the bot string is needed 2010-09-27 14:54:32 +00:00
RSSLoader.java * fix system update if urls are in blacklist (for example for very general blacklists like *.de) 2010-12-15 19:20:00 +00:00
SitemapImporter.java enhanced crawler: 2010-12-11 00:31:57 +00:00
ZURL.java * fix system update if urls are in blacklist (for example for very general blacklists like *.de) 2010-12-15 19:20:00 +00:00