yacy_search_server/source/de/anomic/plasma
orbiter ecba35de72 enhanced computing speed of kelondro core function: sorting
the enhancement was made by using better organized data structures and
multi-threading during the sort. A sort can be divided into two separate
processes when the first partition of the quicksort algorithm was done.
Generating a separate thread and starting the thread takes only 10 milliseconds,
so using a separate thread makes only sense if the data amount is large.
statistics about the speed-up:
without ehancement: 250 milliseconds for 100000 entries
with data structure enhancement: 170 milliseconds for 100000 entries
with additional second thread (if second processor is present): 130 milliseconds.

For dual-processor systems, this means about 100% speed-up
a test can be made with the following command:
java -classpath classes de.anomic.kelondro.kelondroRowCollection


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4198 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-11-09 00:51:38 +00:00
..
cache preparations for mass remote crawls: 2007-10-29 01:43:20 +00:00
crawler enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
dbImport preparations for mass remote crawls: 2007-10-29 01:43:20 +00:00
parser
urlPattern
plasmaCondenser.java
plasmaCrawlBalancer.java
plasmaCrawlEntry.java preparations for mass remote crawls: 2007-10-29 01:43:20 +00:00
plasmaCrawlEURL.java
plasmaCrawlLoaderMessage.java
plasmaCrawlLURL.java
plasmaCrawlNURL.java
plasmaCrawlProfile.java
plasmaCrawlRobotsTxt.java
plasmaCrawlStacker.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
plasmaCrawlZURL.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
plasmaDHTChunk.java
plasmaDHTFlush.java
plasmaDHTTransfer.java
plasmaGrafics.java
plasmaHTCache.java preparations for mass remote crawls: 2007-10-29 01:43:20 +00:00
plasmaParser.java removed parser object pool, see also svn 4106 2007-10-29 12:14:18 +00:00
plasmaParserConfig.java removed parser object pool, see also svn 4106 2007-10-29 12:14:18 +00:00
plasmaParserDocument.java
plasmaRankingCRProcess.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
plasmaRankingDistribution.java transferRanking(): Do not flush more ranking files than requested by caller. 2007-10-31 15:55:52 +00:00
plasmaRankingRCIEvaluation.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
plasmaSearchEvent.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
plasmaSearchImages.java
plasmaSearchProcessing.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
plasmaSearchQuery.java
plasmaSearchRankingProcess.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
plasmaSearchRankingProfile.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
plasmaSnippetCache.java removed parser object pool, see also svn 4106 2007-10-29 12:14:18 +00:00
plasmaStore.java
plasmaSwitchboard.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
plasmaSwitchboardQueue.java preparations for mass remote crawls: 2007-10-29 01:43:20 +00:00
plasmaWebStructure.java
plasmaWordConnotation.java
plasmaWordIndex.java enhanced computing speed of kelondro core function: sorting 2007-11-09 00:51:38 +00:00