Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
99bf0b8e41
yacy_search_server/source/de/anomic/crawler
History
orbiter 99bf0b8e41 refactoring of plasmaWordIndex: 
divided that class into three parts:
- the peers object is now hosted by the plasmaSwitchboard
- the crawler elements are now in a new class, crawler.CrawlerSwitchboard
- the index elements are core of the new segment data structure, which is a bundle of different indexes for the full text and (in the future) navigation indexes and the metadata store. The new class is now in kelondro.text.Segment

The refactoring is inspired by the roadmap to create index segments, the option to host different indexes on one peer.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5990 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-28 14:26:05 +00:00
..
AbstractImporter.java refactoring of logging 2009-01-30 23:33:47 +00:00
Balancer.java - removed useCell option: the indexCell data structure is now the default index structure; old collection data is still migrated 2009-04-22 22:39:12 +00:00
CrawlEntry.java - added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up. 2009-04-01 12:39:11 +00:00
CrawlProfile.java migration of all databases that use the deprecated BLOBTree format into the BLOBHeap format. Old databases are migrated automatically. 2009-05-27 15:04:04 +00:00
CrawlQueues.java refactoring of plasmaWordIndex: 2009-05-28 14:26:05 +00:00
CrawlStacker.java refactoring of plasmaWordIndex: 2009-05-28 14:26:05 +00:00
CrawlSwitchboard.java refactoring of plasmaWordIndex: 2009-05-28 14:26:05 +00:00
FTPLoader.java refactoring of plasmaWordIndex: 2009-05-28 14:26:05 +00:00
HTTPLoader.java refactoring of plasmaWordIndex: 2009-05-28 14:26:05 +00:00
Importer.java refactoring: 2008-05-06 13:44:38 +00:00
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java more memory leak fixing hacks 2009-02-11 13:31:10 +00:00
IndexingStack.java refactoring of plasmaWordIndex: 2009-05-28 14:26:05 +00:00
Latency.java - removed deprecated threads 2009-04-01 20:13:57 +00:00
LoaderMessage.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
NoticedURL.java - removed useCell option: the indexCell data structure is now the default index structure; old collection data is still migrated 2009-04-22 22:39:12 +00:00
NoticeURLImporter.java refactoring of plasmaWordIndex: 2009-05-28 14:26:05 +00:00
ProtocolLoader.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
ResourceObserver.java refactoring of plasmaWordIndex: 2009-05-28 14:26:05 +00:00
ResultImages.java * refactoring 2008-08-02 13:57:00 +00:00
ResultURLs.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 2008-12-18 15:35:41 +00:00
RobotsTxt.java migration of all databases that use the deprecated BLOBTree format into the BLOBHeap format. Old databases are migrated automatically. 2009-05-27 15:04:04 +00:00
SitemapImporter.java more performance hacks 2008-12-04 12:54:16 +00:00
ZURL.java - added migration class to go from index collections to the index cell data structure. 2009-03-30 15:31:25 +00:00