yacy_search_server/source/de/anomic/crawler
orbiter 735e2737e3 * added index segments
This is a major change in the organization of indexes.
Please consider a back-up of your data before you run this update.
All existing index files will be moved and renamed to a new position.
With this change, it will be possible to maintain different indexes for different purposes and it will be possible to have a distinction between DHT-in and DHT-out specific indexes. Tenants may also have their own index, and it may be possible to have histories and back-ups of indexes. This is just the beginning, many servlets must be adopted after this change, but all functions that had been there should still work.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6389 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-10-09 14:44:20 +00:00
..
retrieval * added index segments 2009-10-09 14:44:20 +00:00
AbstractImporter.java serialized all logging using concurrency: 2009-06-15 21:19:54 +00:00
Balancer.java - added more logging to balancer 2009-09-27 22:35:22 +00:00
CrawlProfile.java update to default ranking profile which has now some settings to deny some phpbb3 pages which are redundant in the index when crawling phpbb3. 2009-09-03 20:54:47 +00:00
CrawlQueues.java - some fixes to prevent blocking situations 2009-10-06 21:52:55 +00:00
CrawlStacker.java fix for deadlock 2009-07-30 09:08:44 +00:00
CrawlSwitchboard.java update to default ranking profile which has now some settings to deny some phpbb3 pages which are redundant in the index when crawling phpbb3. 2009-09-03 20:54:47 +00:00
ExternalIndexImporter.java refactoring: 2009-07-19 20:37:44 +00:00
Importer.java
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java serialized all logging using concurrency: 2009-06-15 21:19:54 +00:00
Latency.java - added more logging to balancer 2009-09-27 22:35:22 +00:00
LoaderMessage.java -removed superfluous crawl cache 2009-07-15 21:07:46 +00:00
NoticedURL.java added configuration to enable ram table copy 2009-09-07 20:30:57 +00:00
NoticeURLImporter.java added configuration to enable ram table copy 2009-09-07 20:30:57 +00:00
ResourceObserver.java refactoring: 2009-07-19 20:37:44 +00:00
ResultImages.java refactoring of parsers and document processing 2009-07-08 21:48:08 +00:00
ResultURLs.java serialized all logging using concurrency: 2009-06-15 21:19:54 +00:00
RobotsEntry.java * added index segments 2009-10-09 14:44:20 +00:00
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 2008-12-18 15:35:41 +00:00
RobotsTxt.java * added index segments 2009-10-09 14:44:20 +00:00
SitemapImporter.java refactoring: 2009-07-19 20:37:44 +00:00
ZURL.java added configuration to enable ram table copy 2009-09-07 20:30:57 +00:00