orbiter a31b9097a4 preparations for mass remote crawls: ... two main changes must be implemented to enable mass remote crawls: - shift control of robots.txt to crawl queue (away from stacker). This is necessary since remote crawls can contain unchecked urls. Each peer must check the robots to prevent that it is misused as crawl agent for unwanted file retrieval - implement new index files that control double-check of remotely crawled urls After removal of robots.txt checking from stacker threads, the multi-threading of this process is void. Multithreading has been removed. Also the thread pools for the crawl threads had been removed, since creation of these threads is not resource-consuming, for a detailed explanation see svn 4106 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4181 6c8d7289-2bf4-0310-a012-ef5d649a1542		2007-10-29 01:43:20 +00:00
..
logging	- Changed yFormatter handling to be more flexible and produce more readable code for server pages. There are serverObject.putNum() methods to allow adding of number type values in a formatted form, and put() methods for number types that add them without formatting. This reduces the need to transform them into Strings in server pages and removes the HTML encoding step which is unecessary for numbers.	2007-10-19 04:13:46 +00:00
portForwarding	re-designed some parts of DHT position calculation (effect is the same as before)	2007-10-01 12:30:23 +00:00
serverAbstractSwitch.java	synchronization of access tracker to avoid java-internal loop in TreeMap during shutdown	2007-07-31 10:42:11 +00:00
serverAbstractThread.java	- fixed charset problem in ConfigProfil_p.html (use accept-charset="UTF-8" in forms)	2007-06-05 11:37:19 +00:00
serverByteBuffer.java	fixed bug with decompression of index abstracts	2007-07-15 12:39:16 +00:00
serverCachedFileOutputStream.java	- plasmaParserDocument can process subdocuments now (other archive-parsers may want to use this method)	2007-05-18 23:13:44 +00:00
serverCharBuffer.java	- documentaton changes (removed old forum links)	2007-07-19 15:32:10 +00:00
serverClassLoader.java	*) changes required for the uploaderWrapper	2007-04-28 16:04:37 +00:00
serverCodings.java	- Changed yFormatter handling to be more flexible and produce more readable code for server pages. There are serverObject.putNum() methods to allow adding of number type values in a formatted form, and put() methods for number types that add them without formatting. This reduces the need to transform them into Strings in server pages and removes the HTML encoding step which is unecessary for numbers.	2007-10-19 04:13:46 +00:00
serverCore.java	re-designed some parts of DHT position calculation (effect is the same as before)	2007-10-01 12:30:23 +00:00
serverCoreSocket.java	*) Bugfix for ArrayIndexOutOfBoundsException during SSL detection	2006-11-30 06:38:53 +00:00
serverDate.java	- fixed problem with yacyVersion and own version generation	2007-07-16 23:47:21 +00:00
serverDomains.java	preparations for mass remote crawls:	2007-10-29 01:43:20 +00:00
serverFileUtils.java	extended client connection clean-up:	2007-10-03 15:06:12 +00:00
serverHandler.java	*) adding additional methods that should be implemented by all	2005-06-09 10:54:03 +00:00
serverInstantThread.java	made the plasmaHTCache static (there is only one internet, so we need only one cache)	2007-08-15 21:31:31 +00:00
serverMemory.java	* Complete number localization and provide a more reasonable interface to serverObjects:	2007-10-24 21:38:19 +00:00
serverObjects.java	* Complete number localization and provide a more reasonable interface to serverObjects:	2007-10-24 21:38:19 +00:00
serverPlainSwitch.java	changed release strategy:	2007-06-16 14:11:52 +00:00
serverSemaphore.java	preparations for mass remote crawls:	2007-10-29 01:43:20 +00:00
serverSwitch.java	added network definition for different YaCy networks	2007-06-22 14:29:14 +00:00
serverSwitchAbstractAction.java	code cleanup	2005-12-05 14:24:13 +00:00
serverSwitchAction.java	*) adding reference to logger	2005-06-09 10:57:42 +00:00
serverSystem.java	*) Better Bourne-Shell (OpenSolaris) compatibility, update and restart really work now. As the Bourne-Shell is the grandfather of most modern shells, it should also work with Linux (tested with Mandriva, works) and OSX (Please test!).	2007-08-20 21:52:52 +00:00
serverThread.java	added speed-buttons for easy performance setting	2007-03-12 16:24:28 +00:00
servletProperties.java	added new yacy protocol for mass url-pull for better remote crawling distribution	2007-08-22 00:59:05 +00:00