yacy_search_server/source/de/anomic/kelondro
orbiter ecba35de72 enhanced computing speed of kelondro core function: sorting
the enhancement was made by using better organized data structures and
multi-threading during the sort. A sort can be divided into two separate
processes when the first partition of the quicksort algorithm was done.
Generating a separate thread and starting the thread takes only 10 milliseconds,
so using a separate thread makes only sense if the data amount is large.
statistics about the speed-up:
without ehancement: 250 milliseconds for 100000 entries
with data structure enhancement: 170 milliseconds for 100000 entries
with additional second thread (if second processor is present): 130 milliseconds.

For dual-processor systems, this means about 100% speed-up
a test can be made with the following command:
java -classpath classes de.anomic.kelondro.kelondroRowCollection


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4198 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-11-09 00:51:38 +00:00
..
kelondroAbstractIOChunks.java optimized memory allocation in kelondroRow.Entry 2007-04-03 12:10:12 +00:00
kelondroAbstractOrder.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroAbstractRA.java
kelondroAbstractRecords.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroArray.java fight against problems with remove-methods and synchronization 2007-04-17 15:15:47 +00:00
kelondroAttrSeq.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroBase64Order.java enhanced computing speed of kelondro core function: sorting 2007-11-09 00:51:38 +00:00
kelondroBinSearch.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroBitfield.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroBufferedIOChunks.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroBufferedRA.java - Changed yFormatter handling to be more flexible and produce more readable code for server pages. There are serverObject.putNum() methods to allow adding of number type values in a formatted form, and put() methods for number types that add them without formatting. This reduces the need to transform them into Strings in server pages and removes the HTML encoding step which is unecessary for numbers. 2007-10-19 04:13:46 +00:00
kelondroByteArray.java added a class for byte-array management. This was the result of a very large experiment 2007-03-30 08:44:43 +00:00
kelondroBytesIntMap.java enhanced computing speed of kelondro core function: sorting 2007-11-09 00:51:38 +00:00
kelondroCache.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroCachedRA.java
kelondroCachedRecords.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroCloneableIterator.java
kelondroCloneableMapIterator.java fixed non-termination bug for robinson remote crawl peer selection 2007-05-07 14:37:50 +00:00
kelondroCoding.java
kelondroCollectionIndex.java enhanced computing speed of kelondro core function: sorting 2007-11-09 00:51:38 +00:00
kelondroColumn.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroDyn.java distinct keepOrder strategy, more discrete implementation of enhancement introduced in SVN 4158 2007-10-22 15:26:47 +00:00
kelondroDynTree.java - added SSI parser and include directive for <!--# include virtual="<file>" --> 2007-06-26 14:37:10 +00:00
kelondroEcoRecords.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroException.java git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3735 6c8d7289-2bf4-0310-a012-ef5d649a1542 2007-05-16 17:45:39 +00:00
kelondroFileRA.java
kelondroFixedWidthArray.java fixed new EcoRecords-Nodes. Here I omitted object content copying before 2007-08-06 10:10:33 +00:00
kelondroFlexSplitTable.java distinct keepOrder strategy, more discrete implementation of enhancement introduced in SVN 4158 2007-10-22 15:26:47 +00:00
kelondroFlexTable.java enhanced computing speed of kelondro core function: sorting 2007-11-09 00:51:38 +00:00
kelondroFlexWidthArray.java fixed new EcoRecords-Nodes. Here I omitted object content copying before 2007-08-06 10:10:33 +00:00
kelondroHandle.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroHashtable.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroIndex.java distinct keepOrder strategy, more discrete implementation of enhancement introduced in SVN 4158 2007-10-22 15:26:47 +00:00
kelondroIntBytesMap.java enhanced computing speed of kelondro core function: sorting 2007-11-09 00:51:38 +00:00
kelondroIOChunks.java - better implementation of search query properties 2007-04-05 10:14:48 +00:00
kelondroLock.java
kelondroMapObjects.java fix for elementCount bug when db was reset 2007-07-06 09:50:59 +00:00
kelondroMapTable.java distinct keepOrder strategy, more discrete implementation of enhancement introduced in SVN 4158 2007-10-22 15:26:47 +00:00
kelondroMergeIterator.java
kelondroMHashMap.java
kelondroMScoreCluster.java
kelondroMSetTools.java some generalization of remote proxy configuration and setting handling in httpc 2007-08-02 00:42:37 +00:00
kelondroNaturalOrder.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroNIOFileRA.java
kelondroNode.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroObjectBuffer.java
kelondroObjects.java first version of next-generation search interface: 2007-09-03 23:43:55 +00:00
kelondroObjectsEntry.java
kelondroObjectsMapEntry.java
kelondroObjectSpace.java
kelondroOrder.java
kelondroOutOfLimitsException.java
kelondroProfile.java
kelondroRA.java - better implementation of search query properties 2007-04-05 10:14:48 +00:00
kelondroRAIOChunks.java - better implementation of search query properties 2007-04-05 10:14:48 +00:00
kelondroRecords.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroRotateIterator.java fix for 100% cpu bug during dht selection 2007-04-13 13:40:19 +00:00
kelondroRow.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroRowCollection.java enhanced computing speed of kelondro core function: sorting 2007-11-09 00:51:38 +00:00
kelondroRowSet.java enhanced computing speed of kelondro core function: sorting 2007-11-09 00:51:38 +00:00
kelondroSplittedTree.java distinct keepOrder strategy, more discrete implementation of enhancement introduced in SVN 4158 2007-10-22 15:26:47 +00:00
kelondroSQLTable.java distinct keepOrder strategy, more discrete implementation of enhancement introduced in SVN 4158 2007-10-22 15:26:47 +00:00
kelondroStack.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroTree.java enhanced local search speed. The ranking process is now 6 times faster that before. 2007-11-07 22:38:09 +00:00
kelondroXMLTables.java