3839 Commits

Author	SHA1	Message	Date
orbiter	409538e17a	code cleanup and code simplifcation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6161 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-30 22:20:55 +00:00
orbiter	160031758d	fix for problem with initializer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6160 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-30 21:57:32 +00:00
orbiter	302a02cec8	moved all libraries from libx to lib ... removed libx directory all libraries are now in lib, instead the test libraries in libt which are not part of releases git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6157 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-30 14:55:23 +00:00
orbiter	1f1399e5c5	extending visibility of objects and methods to avoid synthetic accessor methods and increase performance ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6156 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-30 13:25:46 +00:00
orbiter	154bbc3364	code cleanup: call of static methods directly to the class ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6155 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-30 13:01:35 +00:00
orbiter	222850414e	simplification of the code: removed unused classes, methods and variables ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6154 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-30 09:27:46 +00:00
orbiter	93dfb51fd4	problems with code style ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6153 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-29 22:22:35 +00:00
orbiter	adf01c676e	reduce lookup time when merging a large number of BLOBs ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6152 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-29 16:07:10 +00:00
orbiter	9a674d8047	- After the removal of the Tree class some code simplifications are possible. This affects mostly the Records class, which can be refactored and the result of the refactoring results in a reduced number of classes. ... - The EcoTable was renamed to Table. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6151 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-28 21:37:37 +00:00
orbiter	c5122d6836	completed migration of BLOBTree to BLOBHeaps: ... - removed migration code - removed BLOBTree after the removal of the BLOBTree, a lot of dead code appeared: - removed dead code that was needed for BLOBTree Some more classes may have not much use any more after the removal of BLOBTree, but still have some component that are needed elsewhere. Additional Refactoring steps are needed to clean up dependencies and then more code may appear that is unused and can be removed as well. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6150 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-28 21:02:56 +00:00
orbiter	d1083a6913	maybe we have less problems with open connections to the server if we don't do BF forced sleeps (just a test) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6149 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-28 10:35:12 +00:00
low012	ebe6c823ac	*) changed svn properties agains (hopefully doing it right this time) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6147 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-27 09:56:01 +00:00
low012	a80ac3a415	*) fixed wrong parser descriptions ... *) changed svn properties git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6146 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-27 09:42:33 +00:00
low012	457b6c0d6d	*) updated Apache POI library to be able to parse Visio files ... *) updated PPT and XLS parsers to use new Apache POI library *) added new Visio (VSD) parser git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6145 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-27 09:33:09 +00:00
apfelmaennchen	a10c8022d1	DidYouMean: ... - limit the number of consumer threads to available CPUs - added some javadoc git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6144 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-27 07:23:34 +00:00
f1ori	7eb3bff5b3	* workaround for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2220&hilit=#p16128 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6143 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-26 14:05:39 +00:00
orbiter	99fa265e1d	fix for search bug caused by tenant patch ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6125 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-22 22:31:29 +00:00
orbiter	79875782af	be a bit more lazy when removing domain navigation entries ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6120 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-22 12:30:22 +00:00
orbiter	57af311627	fix for wrong urls in navigator when a tenant is used ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6119 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-22 12:25:18 +00:00
lotus	76b96337e2	just some chatty code ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6118 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-22 11:45:21 +00:00
low012	91785d895c	*) minor changes in comments ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6109 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-21 20:08:52 +00:00
orbiter	bdda140c02	fix for json output (no doubleqotes any more, doublequote quoting did not work) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6105 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-20 23:33:29 +00:00
orbiter	2f84736120	ignore signature files that cannot be downloaded because of failed encoding ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6103 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-20 20:46:58 +00:00
orbiter	041d9c253e	some refactoring and more error-awareness in LogalizeHandler ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6102 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-20 20:29:57 +00:00
orbiter	6b307d6d59	more tolerance for corrupted index entries in exported row sets ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6099 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-19 21:35:44 +00:00
orbiter	33aafa9b4b	better logging when writing merged dumps ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6098 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-19 17:02:50 +00:00
lotus	db70badcf0	possibility to set remote host on upnp device ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6097 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-19 15:32:59 +00:00
orbiter	4d29e90708	uaeh ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6096 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-19 14:54:39 +00:00
orbiter	3c3e6499ae	added more logging for merge operation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6095 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-19 14:51:35 +00:00
orbiter	15180fc95e	- patch for future computation in SplitTable ... - added same concurrent process for has() from SPlitTable in ArrayStack git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6093 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-18 23:24:23 +00:00
orbiter	9a5ec20b3c	avoid merge during startup ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6092 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-18 21:18:56 +00:00
lotus	bf6b92343c	try to avoid stuck pdf parser ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6091 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-18 06:31:55 +00:00
lotus	c695c7f512	try to remove hung swf parser from queue ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6090 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-17 17:48:02 +00:00
orbiter	fc69a76197	update to web structure picture: ... - allow bigger size - better instructions for api usage git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6089 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-17 12:37:31 +00:00
orbiter	ae015e8e98	refactoring of blob package classes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6088 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-17 09:58:15 +00:00
orbiter	8b8877c233	moved image collector ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6087 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-16 21:48:09 +00:00
orbiter	be1c7ddc64	refactoring of search classes -- moved Ranking Profile to search package ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6086 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-16 21:45:40 +00:00
orbiter	fd31a3616a	- more logging in server process ... - fix for bas ascii in comment git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6084 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-16 15:10:59 +00:00
orbiter	5a7fd6b4c8	just some comment lines ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6081 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-16 06:38:26 +00:00
orbiter	31f60a3b3e	when doing searches, also apply a online caution to DHT transmission and stop transmissions while heavy load caused by searching. This omits the many requests to the URL database that are needed for DHT transfer and it avoids collisions with URL retrieval needed for search results. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6080 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-15 22:03:27 +00:00
orbiter	17dc6d4be5	small fix for new Logger ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6079 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-15 21:39:24 +00:00
orbiter	ce1adf9955	serialized all logging using concurrency: ... high-performance search query situations as seen in yacy-metager integration showed deadlock situation caused by synchronization effects inside of sun.java code. It appears that the logger is not completely safe against deadlock situations in concurrent calls of the logger. One possible solution would be a outside-synchronization with 'synchronized' statements, but that would further apply blocking on all high-efficient methods that call the logger. It is much better to do a non-blocking hand-over of logging lines and work off log entries with a concurrent log writer. This also disconnects IO operations from logging, which can also cause IO operation when a log is written to a file. This commit not only moves the logger from kelondro to yacy.logging, it also inserts the concurrency methods to realize non-blocking logging. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6078 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-15 21:19:54 +00:00
lotus	aec3e7995a	autoconfig.pac can be used to browse .yacy-domains only ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6077 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-15 19:48:11 +00:00
orbiter	bc6dd8194b	refactoring: moved search query class to new search package ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6075 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-15 11:49:00 +00:00
orbiter	a4805defdd	added stub for new search process ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6074 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-15 11:46:23 +00:00
orbiter	b8e738a7be	a collection of ... - small bug fixes - better/more comments - more asserts - fixed synchronization - test case enhancements - code cleanup - performance hacks git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6073 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-14 22:09:08 +00:00
apfelmaennchen	39779e4796	DidYouMean: as I moved to only 8 consumer and 4 producer threads, I removed poison pills as it does not make sense anymore - threads are interrupted directly. Having a consumer thread per test case just didn't make sense either (see svn 6070) due to the massive overhead. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6072 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-14 16:31:31 +00:00
apfelmaennchen	c3c4dd0933	DidYouMean - changed to much simpler LinkedBlockingQueue ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6071 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-14 15:25:57 +00:00
apfelmaennchen	01ac1b5d7e	- blocking queue implementation of DidYouMean ... - timeout ist set to 500ms git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6070 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-14 11:53:09 +00:00
orbiter	b8bb1bb364	join with a timeout does not cause that the corresponding thread is stopped after the time-out. It does only cause that the waiting is stopped. Here we need additionally a signal to the thread to stop after we finished waiting. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6069 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-06-13 23:54:52 +00:00