yacy_search_server/source/de/anomic/server
orbiter 0241d070bc added concurrency to indexing process:
- the methods {parsing, semantic analysis (condensing), structure analysis (web structure)} in the serialized indexing path had been made concurrent.
- four BlockingQueues handle concurrency and hand-over of the indexing objects, the last object in the queue is stored into a blockingQueue of maximum size 1 to serialize the process for storage (which uses IO and therefore here should not be deserialized)
- a concurrency of (CPUs + 1) is default. Single-CPU users will profil from the change because large files cannot block the indexing process any more.
- removed the secondary indexing thread, which is superfluous now. Concurrency is default for all users.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4609 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-28 11:56:28 +00:00
..
logging - fixed bug with too much RAM in crawler queue 2008-01-31 23:40:47 +00:00
portForwarding - refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads 2008-03-27 12:03:16 +00:00
serverAbstractBlockingThread.java added concurrency to indexing process: 2008-03-28 11:56:28 +00:00
serverAbstractBusyThread.java added concurrency to indexing process: 2008-03-28 11:56:28 +00:00
serverAbstractSwitch.java - refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads 2008-03-27 12:03:16 +00:00
serverAbstractThread.java - refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads 2008-03-27 12:03:16 +00:00
serverBlockingThread.java - refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads 2008-03-27 12:03:16 +00:00
serverBusyThread.java added concurrency to indexing process: 2008-03-28 11:56:28 +00:00
serverByteBuffer.java some memory enhancements when generating and displaying ymage objects 2007-12-07 02:15:12 +00:00
serverCachedFileOutputStream.java - plasmaParserDocument can process subdocuments now (other archive-parsers may want to use this method) 2007-05-18 23:13:44 +00:00
serverCharBuffer.java - documentaton changes (removed old forum links) 2007-07-19 15:32:10 +00:00
serverClassLoader.java more generics 2008-01-09 09:58:56 +00:00
serverCodings.java modified dir servlet to cooperate with intranet indexing from the own HTDOCS repository: 2008-02-15 13:12:25 +00:00
serverCore.java - refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads 2008-03-27 12:03:16 +00:00
serverCoreSocket.java *) Bugfix for ArrayIndexOutOfBoundsException during SSL detection 2006-11-30 06:38:53 +00:00
serverDate.java last cleanup bits to serverDate before the release. only safe refactoring (method renaming) changes outside of serverDate. 2007-12-21 00:53:46 +00:00
serverDomains.java more multithreading support: 2008-02-27 15:16:47 +00:00
serverFileUtils.java - next try to fix the networking problem: 2008-03-14 00:16:04 +00:00
serverHandler.java some code enhancements and bugfixes 2008-03-09 23:48:24 +00:00
serverInstantBlockingThread.java added concurrency to indexing process: 2008-03-28 11:56:28 +00:00
serverInstantBusyThread.java - refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads 2008-03-27 12:03:16 +00:00
serverMemory.java consistent use of de.anomic.server.serverMemory to get information about memory statistics 2008-03-02 15:42:50 +00:00
serverObjects.java experiments wit openstreetmaps 2008-02-12 15:39:32 +00:00
serverPlainSwitch.java refactoring of switchboard queueing 2008-03-22 01:28:37 +00:00
serverProcessor.java added concurrency to indexing process: 2008-03-28 11:56:28 +00:00
serverProcessorJob.java added concurrency to indexing process: 2008-03-28 11:56:28 +00:00
serverProfiling.java more multithreading support: 2008-02-27 15:16:47 +00:00
serverSemaphore.java preparations for mass remote crawls: 2007-10-29 01:43:20 +00:00
serverSwitch.java - refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads 2008-03-27 12:03:16 +00:00
serverSwitchAbstractAction.java
serverSwitchAction.java
serverSystem.java - next try to fix the networking problem: 2008-03-14 00:16:04 +00:00
serverThread.java - refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads 2008-03-27 12:03:16 +00:00
servletProperties.java more generics 2008-01-06 19:23:38 +00:00