yacy_search_server/source/de/anomic/plasma
orbiter 1e6d12f146 Major update to BLOB data structures:
- introduced a new BLOB file format: kelondroBLOBHeap. This is a flat file with an index in RAM.
  very similar to the eco-tables, but with flexible value sizes. It will replace the kelondroBLOBTree,
  which is based on a kelondroTree, a file-AVL-based index data structure.
- the HTCACHE header file was replaced by the new blob heap file structure
- the robots.txt file was replaced by the new blob heap file structure
- the robots parser was enhanced (bugfixing for double-loading of the same robots.txt)
- other BLOB-dependent data structures were prepared to use also the new BLOB heap
- fixed a bug in the snippet fetch process: the file header was not written to the header index
There should now be less IO during snippet fetch and during crawling


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4978 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-10 00:47:37 +00:00
..
cache - organize imports 2008-06-06 16:01:27 +00:00
parser added many missing user-agent declarations for yacy http client connections. 2008-07-04 11:03:03 +00:00
plasmaCondenser.java some code-cleanup and possible speed enhancements in different core methods 2008-06-17 23:56:39 +00:00
plasmaDbImporter.java - organize imports 2008-06-06 16:01:27 +00:00
plasmaDHTChunk.java - organize imports 2008-06-06 16:01:27 +00:00
plasmaDHTFlush.java - fix for index transfer 2008-07-06 13:16:17 +00:00
plasmaDHTTransfer.java - organize imports 2008-06-06 16:01:27 +00:00
plasmaGrafics.java - organize imports 2008-06-06 16:01:27 +00:00
plasmaHTCache.java Major update to BLOB data structures: 2008-07-10 00:47:37 +00:00
plasmaParser.java - added copyright header of ResourceObserver 2008-07-07 00:40:45 +00:00
plasmaParserConfig.java - organize imports 2008-06-06 16:01:27 +00:00
plasmaParserDocument.java - fixed a bug in parser (directory paths had not been recognized) 2008-06-11 09:54:58 +00:00
plasmaProfiling.java - organize imports 2008-06-06 16:01:27 +00:00
plasmaRankingCRProcess.java - modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order 2008-07-03 13:08:37 +00:00
plasmaRankingDistribution.java major step forward to network switching (target is easy switch to intranet or other networks .. and back) 2008-05-05 23:13:47 +00:00
plasmaRankingRCIEvaluation.java - organize imports 2008-06-06 16:01:27 +00:00
plasmaSearchAPI.java - organize imports 2008-06-06 16:01:27 +00:00
plasmaSearchEvent.java changed peer selection for search targets: 2008-06-30 22:42:52 +00:00
plasmaSearchImages.java added new default profiles to distinguish snippet fetch for local and global search 2008-04-24 08:42:08 +00:00
plasmaSearchQuery.java more access security regarding database access and snippet retrieval: restrict number of results for not-authorized searchers 2008-05-23 09:45:33 +00:00
plasmaSearchRankingProcess.java better SRU compliance 2008-07-07 21:50:24 +00:00
plasmaSearchRankingProfile.java - organize imports 2008-06-06 16:01:27 +00:00
plasmaSnippetCache.java - organize imports 2008-06-06 16:01:27 +00:00
plasmaStore.java replaced httpc with Apache Jakarta Commons HttpClient (includes some refactoring ;) 2008-04-05 13:17:16 +00:00
plasmaSwitchboard.java Major update to BLOB data structures: 2008-07-10 00:47:37 +00:00
plasmaWebStructure.java - modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order 2008-07-03 13:08:37 +00:00
plasmaWordIndex.java - modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order 2008-07-03 13:08:37 +00:00