yacy_search_server/source/de/anomic/kelondro
orbiter daf0f74361 joined anomic.net.URL, plasmaURL and url hash computation:
search profiling showed, that a major amount of time is wasted by computing url hashes. The computation does an intranet-check, which needs a DNS lookup. This caused that each urlhash computation needed 100-200 milliseconds, which caused remote searches to delay at least 1 second more that necessary. The solution to this problem is to attach a URL hash to the URL data structure, because that means that the url hash value can be filled after retrieval of the URL from the database. The redesign of the url/urlhash management caused a major redesign of many parts of the software. Since some parts had been decided to be given up they had been removed during this change to avoid unnecessary maintenance of unused code.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4074 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-09-05 09:01:35 +00:00
..
kelondroAbstractIOChunks.java optimized memory allocation in kelondroRow.Entry 2007-04-03 12:10:12 +00:00
kelondroAbstractOrder.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroAbstractRA.java PLEASE MAKE A BACK-UP OF YOUR COMPLETE DATA DIRECTORY BEFORE USING THIS 2007-02-20 08:35:51 +00:00
kelondroAbstractRecords.java joined anomic.net.URL, plasmaURL and url hash computation: 2007-09-05 09:01:35 +00:00
kelondroArray.java fight against problems with remove-methods and synchronization 2007-04-17 15:15:47 +00:00
kelondroAttrSeq.java replaced some toString() 2007-02-06 16:26:56 +00:00
kelondroBase64Order.java fixed wrong ordering that caused bad dht selection 2007-05-04 14:11:50 +00:00
kelondroBinSearch.java - consolidated different orderings to kelondroNaturalOrder 2006-01-11 00:32:44 +00:00
kelondroBitfield.java replaced some toString() 2007-02-06 16:26:56 +00:00
kelondroBufferedIOChunks.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroBufferedRA.java SSI fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=29 2007-06-29 10:45:13 +00:00
kelondroByteArray.java added a class for byte-array management. This was the result of a very large experiment 2007-03-30 08:44:43 +00:00
kelondroBytesIntMap.java - added SSI parser and include directive for <!--# include virtual="<file>" --> 2007-06-26 14:37:10 +00:00
kelondroCache.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroCachedRA.java added several consistency checks and small changes 2006-08-12 15:59:14 +00:00
kelondroCachedRecords.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroCloneableIterator.java bugfix for my last commit: 2007-03-08 22:07:17 +00:00
kelondroCloneableMapIterator.java fixed non-termination bug for robinson remote crawl peer selection 2007-05-07 14:37:50 +00:00
kelondroCoding.java - added base64 ordering methods 2006-01-04 01:45:23 +00:00
kelondroCollectionIndex.java joined anomic.net.URL, plasmaURL and url hash computation: 2007-09-05 09:01:35 +00:00
kelondroColumn.java more debugging lines to fix bug for 2007-04-30 23:05:19 +00:00
kelondroDyn.java - added SSI parser and include directive for <!--# include virtual="<file>" --> 2007-06-26 14:37:10 +00:00
kelondroDynTree.java - added SSI parser and include directive for <!--# include virtual="<file>" --> 2007-06-26 14:37:10 +00:00
kelondroEcoRecords.java fixed new EcoRecords-Nodes. Here I omitted object content copying before 2007-08-06 10:10:33 +00:00
kelondroException.java git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3735 6c8d7289-2bf4-0310-a012-ef5d649a1542 2007-05-16 17:45:39 +00:00
kelondroFileRA.java added several consistency checks and small changes 2006-08-12 15:59:14 +00:00
kelondroFixedWidthArray.java fixed new EcoRecords-Nodes. Here I omitted object content copying before 2007-08-06 10:10:33 +00:00
kelondroFlexSplitTable.java - added SSI parser and include directive for <!--# include virtual="<file>" --> 2007-06-26 14:37:10 +00:00
kelondroFlexTable.java first version of next-generation search interface: 2007-09-03 23:43:55 +00:00
kelondroFlexWidthArray.java fixed new EcoRecords-Nodes. Here I omitted object content copying before 2007-08-06 10:10:33 +00:00
kelondroHandle.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroHashtable.java PLEASE MAKE A BACK-UP OF YOUR COMPLETE DATA DIRECTORY BEFORE USING THIS 2007-02-20 08:35:51 +00:00
kelondroIndex.java some redesign of the handling of the index for kelondroFlexTable 2007-05-16 10:48:26 +00:00
kelondroIntBytesMap.java - added SSI parser and include directive for <!--# include virtual="<file>" --> 2007-06-26 14:37:10 +00:00
kelondroIOChunks.java - better implementation of search query properties 2007-04-05 10:14:48 +00:00
kelondroLock.java experiments with locks to remove synchronization 2005-12-08 12:30:55 +00:00
kelondroMapObjects.java fix for elementCount bug when db was reset 2007-07-06 09:50:59 +00:00
kelondroMapTable.java - added SSI parser and include directive for <!--# include virtual="<file>" --> 2007-06-26 14:37:10 +00:00
kelondroMergeIterator.java fixed wrong implemented row iterator in kelomdroFlexSplitTables 2007-03-09 13:55:26 +00:00
kelondroMHashMap.java * applied many compiler warning recommendations 2006-08-16 19:49:31 +00:00
kelondroMScoreCluster.java removed constants (no connection with yacySeed.dna identifier) 2007-02-02 14:52:54 +00:00
kelondroMSetTools.java some generalization of remote proxy configuration and setting handling in httpc 2007-08-02 00:42:37 +00:00
kelondroNaturalOrder.java fixed wrong ordering that caused bad dht selection 2007-05-04 14:11:50 +00:00
kelondroNIOFileRA.java added several consistency checks and small changes 2006-08-12 15:59:14 +00:00
kelondroNode.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroObjectBuffer.java re-design of database caching 2006-10-26 13:50:50 +00:00
kelondroObjects.java first version of next-generation search interface: 2007-09-03 23:43:55 +00:00
kelondroObjectsEntry.java re-design ob kelondroMap 2007-01-29 23:51:10 +00:00
kelondroObjectsMapEntry.java implemented new kelondroObjects into bookmarkDB 2007-01-30 00:17:55 +00:00
kelondroObjectSpace.java - code cleanup 2006-09-29 22:27:20 +00:00
kelondroOrder.java bugfix for assertion bugs documented in 2006-12-01 01:30:05 +00:00
kelondroOutOfLimitsException.java fixed some problems with new cache flush karenz 2006-03-10 13:57:30 +00:00
kelondroProfile.java added some profiling to kelondro caching classes 2006-06-23 12:49:42 +00:00
kelondroRA.java - better implementation of search query properties 2007-04-05 10:14:48 +00:00
kelondroRAIOChunks.java - better implementation of search query properties 2007-04-05 10:14:48 +00:00
kelondroRecords.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroRotateIterator.java fix for 100% cpu bug during dht selection 2007-04-13 13:40:19 +00:00
kelondroRow.java - fixed dht selction problem: the seed tables used a wrong ordering 2007-05-09 17:59:36 +00:00
kelondroRowCollection.java first version of next-generation search interface: 2007-09-03 23:43:55 +00:00
kelondroRowSet.java some redesign of the handling of the index for kelondroFlexTable 2007-05-16 10:48:26 +00:00
kelondroSplittedTree.java - added SSI parser and include directive for <!--# include virtual="<file>" --> 2007-06-26 14:37:10 +00:00
kelondroSQLTable.java refactoring of dbtest to create separated kelondro sql connector interface 2007-08-11 22:40:24 +00:00
kelondroStack.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroTree.java enhanced memory allocation during database access: 2007-08-03 11:44:58 +00:00
kelondroXMLTables.java "import ...*" removed; 2006-09-18 18:31:27 +00:00