3662 Commits

Author	SHA1	Message	Date
orbiter	d399444e49	added debug information to class loader ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5508 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-21 18:20:15 +00:00
orbiter	5080fc33bf	fix for http://forum.yacy-websuche.de/viewtopic.php?p=12247#p12247 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5506 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-20 22:57:58 +00:00
orbiter	335d6ce8fc	fix for class loading problem ... see also http://forum.yacy-websuche.de/viewtopic.php?p=12153#p12153 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5505 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-20 22:47:58 +00:00
low012	78778df464	*) this should adjust the Dev/Main detection of the updater to the new version numbers (0.7x is Dev, if x != 0) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5504 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-18 21:48:03 +00:00
orbiter	b423d0a036	moved all servlets from htroot/xml to htroot/api ... the file server contains a patch that temporary matches all xml paths to api, that means all interfaces still work. Please adopt all your interfaces to the new path. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5497 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-15 23:52:58 +00:00
orbiter	91af105373	last changes before release ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5493 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-13 23:49:08 +00:00
f1ori	7eade3f181	* fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1728 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5489 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-13 21:42:00 +00:00
orbiter	d1bace5e4d	enhanced cleanup function ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5488 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-13 15:34:11 +00:00
orbiter	cb76d9e0e4	more synchronized in BLOBHeap (will not fix problem with Runtime-Error as reported in forum) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5487 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-13 13:22:29 +00:00
orbiter	ff41da613e	removed exception printout during load of snippets ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5484 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-13 00:30:19 +00:00
orbiter	814a28775f	removed thread dump writing in case of invocation target exception in httpd (looked bad, not serious) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5483 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-13 00:27:01 +00:00
orbiter	bed38a5f8c	fix for uncaught exception in RSSReader ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5482 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-13 00:20:37 +00:00
orbiter	05c235de32	fix for npe ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5481 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-13 00:10:42 +00:00
low012	7608944081	*) bugfix for REMOTE_HOST environment variable in CGI code (shows hostname of client instead of hostname of YaCy peer now) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5480 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-12 22:15:00 +00:00
orbiter	a6b29cf72c	reverted change of search event processing in SVN 5460. The new code did not work properly, ... it gave remote search requests too less time git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5479 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-12 15:06:22 +00:00
orbiter	9ef77d57f5	added an access control to the search interface using white/blacklists: ... in the network configuration, you can configure a whiteliste and a blacklist - blacklistet clients cannot search - whitelistet client get never any search restrictions - for all other clients: apply DoS search restrictions Please see the example configuriation in yacy.network.freeworld.unit by default, all clients from localhosts get whitlistet. If you have your own YaCy network, please put all the IPs of your peers into the whitelist git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5475 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-12 10:55:48 +00:00
orbiter	efe801173c	better dht-in cache flush. see also: ... http://forum.yacy-websuche.de/viewtopic.php?p=11936#p11936 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5472 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-11 22:39:49 +00:00
orbiter	941ab78d9b	better termination for blocking threads ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5471 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-11 22:34:08 +00:00
apfelmaennchen	3dc208fad0	bugfix: bookmarks can now handle folder names like /news and /newspaper without getting confused... ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5470 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-11 19:39:51 +00:00
orbiter	e948df68ac	longer timeout for queues during shutdown ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5469 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-11 19:10:09 +00:00
orbiter	2b32248079	fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1516&p=10545#p10545 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5468 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-11 19:02:50 +00:00
low012	c1330f5743	*) added environment variable DOCUMENT_ROOT ... *) caught exception git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5466 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-10 18:31:10 +00:00
low012	f26b8fcb1b	*) comment mode is 'moderated' instead of 'activated' by default now (to avoid spam being visible) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5465 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-10 12:58:35 +00:00
orbiter	b2a8c653ee	small fixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5464 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-10 09:21:44 +00:00
orbiter	f675d47f86	better protection against database failures ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5463 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-10 09:19:46 +00:00
orbiter	4f45605f04	small update for timing in search result processing ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5460 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-09 15:28:45 +00:00
orbiter	9d119c6b61	migration of auto-update rules to new release strategy: ... next stable will be 0.7, development releases are 0.*x, experimental will be if x = 1, 2, 3 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5458 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-09 10:08:11 +00:00
orbiter	4d5b401f00	try to fix some performance problems with the internal index management: ... - ensuring that ordered indexes stay ordered during remove - no unnecessary ordering checks - better test logic in crawl stacker git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5457 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-09 00:06:36 +00:00
borg-0300	a0605325bb	fixed a NullPointer Exception ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5452 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-07 15:44:09 +00:00
orbiter	b2b7edae18	fixed interactive search ... - added dummy servlet class, because otherwise the template engine is not triggered. thats so because the yacy httpd works much faster as normal file server without a scan of the served pages. Therefore each page with templates must now have a class file associated to it. - fixed json output format of yacysearch git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5449 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-06 20:04:09 +00:00
lotus	2be119f0df	adjusted big peer to 28M links ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5448 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-06 18:20:06 +00:00
orbiter	c6880ce28b	removed the permanent cache flush and replaced it with a periodic cache flush ... The cache is now flushed only for one second every ten seconds. During a crawl the cache fills up completely, and is only flushed if space is needed for more documents. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5446 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-06 13:51:59 +00:00
orbiter	ef7fe537c5	fixed a cache-bug in cachedFileRA ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5445 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-06 10:51:56 +00:00
orbiter	6c7e83909b	- refactoring of data access methods to be prepared for new cell data structure ... - removed a memory overhead in collections which prevent OOM Exception in low memory configurations git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5443 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-06 09:38:08 +00:00
lotus	c8451614f3	fix for overflow ... http://forum.yacy-websuche.de/viewtopic.php?p=11696#p11696 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5440 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-05 18:28:27 +00:00
orbiter	c4c4c223b9	fixed a problem with attribute flags on RWI entries that prevented proper selection of index-of constraint ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5437 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-04 02:27:29 +00:00
orbiter	6072831235	no cr transmission for robinson peers ... see also: http://forum.yacy-websuche.de/viewtopic.php?p=10290#p10290 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5436 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-03 23:44:42 +00:00
low012	afe98bc11c	*) added changes as proposed by Halborinda in http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1674 ... *) changed indention git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5434 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-03 08:24:08 +00:00
orbiter	07fc115e90	removed active profiling in kelondroRowSet ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5433 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-02 12:33:06 +00:00
orbiter	be4c458951	refactoring (implemented Iterable in kelondroRowCollection) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5432 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-02 11:38:20 +00:00
low012	bb5c2cd12e	*) ISINDEX parameters will not be put on commandline anymore to prevent possible security hazards (better safe than sorry). Parmeters will have to be read from QUERY_STRING in ISINDEX case too which does not seem to be uncommon behaviour for web servers: http://vms.pdv-systeme.de/users/martinv/cgi_basics/cgi_basics.html#Datenuebergabe ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5431 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-02 11:18:26 +00:00
orbiter	b6bba18c37	replaced the storing procedure for the index ram cache with a method that generates BLOBHeap-compatible dumps ... this is a migration step to support a new method to store the web index, which will also based on the same data structure. made also a lot of refactoring for a better structuring of the BLOBHeap class. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5430 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-01 22:31:16 +00:00
low012	db1cfae3e7	*) cleaning up after myself ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5429 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-01 19:45:15 +00:00
low012	f547f9a78c	*) added CGI capabilities (run Perl scripts and other software via HTTP GET and POST) ... *) set cgi.allow to true in yacy.conf to enable CGI (CGI is disabled by default) *) edit cgi.suffixes in yacy.conf if necessary to use additional script types ATTENTION: This is a rather experimental feature, not all environment variables are set yet. Only enable CGI if you know what you are doing. Poorly implemented CGI scripts can put a system's integrity at risk! Implementation of more environment variables and documentation due for the next days. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5428 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-01 19:40:06 +00:00
f1ori	bdc380cd84	* add lastModified to templateCache ... -> no outdated files from cache anymore... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5427 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-01-01 14:56:53 +00:00
f1ori	025094675f	* remove empty directory ... * add necessary dependency for pdfParser git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5424 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-31 19:39:02 +00:00
f1ori	c5691180cb	* skip style-tags in HTML-files ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5423 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-31 19:34:24 +00:00
orbiter	3567c58b18	added another filed information for BLOBHeap dumps: the gaps ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5420 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-30 10:49:43 +00:00
orbiter	abdd4aa414	added a index dump for blob heaps: ... this will increase the shutdown time for at most some seconds, but will speed up the start-up git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5419 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-29 21:36:27 +00:00
orbiter	8c3205b62e	fix for OOB Exception ... see http://forum.yacy-websuche.de/viewtopic.php?p=11598#p11598 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5417 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-29 17:36:53 +00:00
orbiter	78c568331e	added test channel to /xml/feed.rss ... can be obtained with http://localhost:8080/xml/feed.rss?set=TEST returns always a single feed entry with a fresh date git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5416 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-29 12:39:07 +00:00
orbiter	e004da48d3	- added fast fingerprint computation for files (any). Will be used in new index dump method ... - refactoring git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5415 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-29 12:22:13 +00:00
f1ori	2d2ce24011	* remove all encoding-stuff from proxy ... encoding is handled by parsers or browser, proxy only passes through git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5410 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-23 19:14:54 +00:00
f1ori	73c8a0839c	* abort download, when proxy connection is closed ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5409 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-23 11:30:24 +00:00
orbiter	bb935fdbb0	less organization overhead for DNS caching and prefetching ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5408 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-23 10:06:49 +00:00
f1ori	4907697cfa	* make fileuploads through proxy bigger than 65500 bytes possible ... * remove gzip-encoding for files from cache git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5407 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-22 23:04:00 +00:00
orbiter	fc8189f3fb	better self-healing of corrupted databases ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5406 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-22 16:43:49 +00:00
f1ori	963da8c3f9	* updated tm-extractors to new version 1.0 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5405 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-21 14:51:03 +00:00
orbiter	e34ac22fbd	- added new monitoring servlet at ... http://localhost:8080/PerformanceConcurrency_p.html - used the new monitoring to do some fine-tuning of the indexing queue git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5402 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-19 15:26:01 +00:00
lotus	449e697436	fix for null-seed in seedfile ... http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1653 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5401 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-19 12:10:01 +00:00
orbiter	d376d81fc4	replaced busy thread control of crawl stacker by blocking threads ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5400 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-18 23:18:34 +00:00
orbiter	f29b48d9ff	patch for IndexOutOfBoundsException ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5399 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-18 22:05:26 +00:00
f1ori	0881190b19	* Robots.txt: don't interpret Crawl-Delays for other robots ... fixes: http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1647 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5398 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-18 15:35:41 +00:00
orbiter	243e73f53b	removed unnecessary usage of kelondroBLOBTree ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5397 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-18 00:18:37 +00:00
orbiter	8cb7170b75	- set status of kelondroTree, kelondroBLOBTree and kelondroFlexTable to deprecated ... - removed initialization and/or usage of kelondroFlexTable (should meanwhile not be used any more) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5396 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-18 00:08:17 +00:00
orbiter	7535fd7447	- refactoring of CrawlEntry and CrawlStacker ... - introduced blocking queues in CrawlStacker to make it ready for concurrency - added a second busy thread for the CrawlStacker The CrawlStacker is multithreaded. It shall be transformed into a BlockingThread in another step. The concurrency of the stacker will hopefully solve some problems with cases where DNS blocks. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5395 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-17 22:53:06 +00:00
lotus	18513e2ee2	npe fix: http://forum.yacy-websuche.de/viewtopic.php?t=1646 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5393 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-16 13:36:13 +00:00
orbiter	2802138787	- refactoring of CrawlStacker (to prepare it for new multi-Threading to remove DNS lookup bottleneck) ... - fix of shallBeOwnWord target computation heuristic git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5392 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-15 00:02:58 +00:00
orbiter	db6b3bf5a3	speed enhancement for integrated http server: ... - tuning hacks in template engine - bypassing the template engine if no servlet present git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5389 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-11 20:10:37 +00:00
orbiter	7cd08bd5fb	fix for NPE in BLOBCompressor ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5388 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-11 13:33:24 +00:00
orbiter	5b94498643	fine-tuning of cache usage from SVN 5386 and a bug fix for overflow in available() method ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5387 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-10 14:35:01 +00:00
orbiter	1779c3c507	- added a read cache to the RAFile interface to RandomAccessFile ... - added a write buffer to BLOBHeap - modified the BLOBBuffer (is now only to buffer non-compressed content) - added content compression to the HTCache The new read cache will decrease the start/initialization time of BLOB files, like the HTCache, RobotsTxt and other BLOBHeap structures. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5386 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-10 11:15:19 +00:00
orbiter	e1acdb952c	fix for problem with userDB and bookmarksDB which was caused by changes in kelondroRA in SVN 5376 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5385 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-08 00:17:45 +00:00
orbiter	4a2dac659e	more speed hacks: ... - modified and activated write buffer - increased cache flush factor - fixed a problem with deadlocking of indexing process git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5382 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-05 13:55:48 +00:00
orbiter	47292e696a	more performance hacks ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5379 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-04 12:54:16 +00:00
orbiter	759cef23dd	fix for bug in kelondroAbstractRA.readFully ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5378 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-03 23:32:07 +00:00
orbiter	d39d420b39	performance hacks ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5376 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-03 15:38:29 +00:00
orbiter	0b4808ba3d	added new interactive search feature: ... - during the user types search queries, the local database is searched - results are presented interactively This was implemented using a new JSON result format for search results in YaCy - added JSON as file format for servlets - refactoring of current search servlets (xml and html) - added JSON output format for search results - added AJAX-based search page, that uses the yacysearch.json selrvlet to print results as a query is typed git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5373 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-02 15:24:25 +00:00
orbiter	74a3d86114	fixed a error response that might present classified information ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5372 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-01 23:14:42 +00:00
orbiter	c6525ab75f	fix for NPE in seed handling ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5371 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-12-01 23:08:27 +00:00
lotus	1951d30a62	addendum to last commit ... handle words with length < 3 correctly git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5369 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-26 19:43:40 +00:00
lotus	325ba7bfb8	only query words with length > 2 ... this is not complete, yet git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5368 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-26 16:41:38 +00:00
low012	e423fa9846	*) added method to only get file names in directory listing which match a filter ... *) only files which end with .black will be listed as blacklists *) added a little bit of Javadoc git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5366 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-25 20:26:06 +00:00
orbiter	513179f404	changed interface to colletctionIndex and adopted all implementing classes: ... do not return a result of a double-check when adding entries with addUnique git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5363 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-23 23:55:08 +00:00
orbiter	9d64693cfb	reverting again the changes to new concurrent chunkIterator ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5362 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-23 22:22:44 +00:00
orbiter	45ad1c3dd5	- re-activated concurrent iterator for EcoFiles ... - added javadoc for new concurrent intialization in kelondroBytesLongMap - switched default value for commons storage to false - version step git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5361 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-23 18:25:40 +00:00
orbiter	2e2120046f	speed enhancement for BLOBHeap opening process ... using concurrency of FileIO and content processing git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5360 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-23 17:38:01 +00:00
orbiter	fa26a8f25a	fix for deadlock-like behavior in balancer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5358 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-22 11:25:01 +00:00
orbiter	1918a0173e	added more exception handling during crawling ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5357 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-22 00:40:18 +00:00
orbiter	10f5ec1040	reverted last commit (more testing needed) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5356 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-22 00:12:50 +00:00
f1ori	5af8923f37	* distribute forgotten jar-file in parser ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5355 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-22 00:05:04 +00:00
orbiter	b0f2003792	fast database initialization and fast start.up of yacy: ... - applied knowledge about concurrent files stream reading and index processing from the wikimedia reader to the EcoTable initialization process: the file reader is now concurrent to the index generation - changed also some initialization processes to avoid some pauses during initialization git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5354 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-21 23:21:33 +00:00
orbiter	0ca4bc7b79	- added reader and visualization for mediawiki-export files: ... files exported from mediawiki using the xml schema according to http://www.mediawiki.org/xml/export-0.3/ can be processed to be viewed in a YaCy servlet. To acces such a file, place it into DATA/HTCACHE/mediawiki/ i.e. the export from german wikipedia would be: DATA/HTCACHE/mediawiki/wikipedia.de.xml This file can then be accessed using the URL http://localhost:8080/mediawiki_p.html?dump=wikipedia.de.xml&title=YaCy if this is done the first time, an index file is created (for this case: more than 4 million lines must be written, this takes about 15 minutes) Then try the same url again. - enhanced also the md5 computation speed git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5352 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-20 18:31:52 +00:00
danielr	2e63f03ca5	copy&paste vergessen :/ ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5351 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-20 11:41:11 +00:00
danielr	cd8082b4e3	fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1111#p11166 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5350 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-20 11:18:19 +00:00
lotus	4f996a7651	fix for logparser pattern ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5349 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-17 16:23:17 +00:00
f1ori	d18c18971e	* dirlisting in UTF-8 encoding ... * fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1550&hilit=#p11108 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5348 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-15 20:49:03 +00:00
orbiter	867d0f2f56	removed some unnecessary pause delays ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5346 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-14 23:36:33 +00:00
f1ori	d49ffcd818	* files distributed by yacy are utf-8, files from repository use the system default charset ... * fixes http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1564#p11092 and http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1550 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5345 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-14 20:49:16 +00:00
orbiter	8c96bc2ac1	do not use proxy caching rules for crawling ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5344 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-14 16:31:04 +00:00
orbiter	dba7ef5144	extended crawling constraints: ... - removed never-used secondary crawl depth - added a must-not-match filter that can be used to exclude urls from a crawl - added stub for crawl tags which will be used to identify search results that had been produced from specific crawls please update the yacybar: replace property name 'crawlFilter' with 'mustmatch'. Additionally, a new parameter named 'mustnotmatch' can be used, which should be by default the empty sring (match-never) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5342 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-14 09:58:56 +00:00
orbiter	96174b2b56	more debugging / better result status logging for parser/caching errors ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5341 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-13 23:41:43 +00:00
f1ori	90e78b2cf6	* improve encoding detection of http service ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5337 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-12 21:06:32 +00:00
orbiter	ef66438662	- more space in error db to store larger error messages ... - added hash to HTCACHE storage files which will make it possible to join separate caches by just copying files git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5329 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-11 21:42:12 +00:00
orbiter	674ad2d55b	different handling of error cases that occur during loading files with http or ftp: ... methods throw exception instead of returning an error string git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5328 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-11 21:33:40 +00:00
danielr	538359a0ff	simple fix to get DHT working again (maybe something more has to be done ;) ... fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1578 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5327 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-11 18:55:16 +00:00
f1ori	7e1fe05e3c	* added utf8-encoding to many getBytes-calls ... * utf8 should work now git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5323 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-08 20:24:31 +00:00
lotus	fad044fb54	update to snippet marker: ... - do not display indexed html (solves xss issues) the single words are analyzed for already marked parts. this is needed to avoid false encoding of the marker (<b>) tags. - improved speed for existing routine heavy used regex pattern are precompiled now git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5322 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-08 10:08:53 +00:00
lotus	16723d0fa6	ask another peer if crawljob loading fails ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5321 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-06 14:14:34 +00:00
orbiter	1b18d4bcf3	enhancement to crawling and remote crawling: ... - for redirector and remote crawling place crawling url on notice queue instead of direct enqueueing in crawler queue - when a request to a remote crawl provider fails, remove the peer from the network to prevent that the url fetcher gets stuck another time again git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5320 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-06 12:30:55 +00:00
orbiter	3f746be5d4	- consolidation and refactoring of many DHT target - computing methods ... - implemented vertical DHT acceptance ("my own DHT") to accept new targets - added new target computation for global search: addresses vertical targets also - enhanced remote crawling: collection of remote crawl urls if queue has less than 100 entries (was: 0 entries) - better performance value computations for PPM selection in network configuration git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5319 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-06 10:07:53 +00:00
orbiter	d014b2728a	Design-check, Extension and Refactoring of DHT target position computation: ... - two different computations (but mathematical equivalent) of the DHT distance had been consolidated - moved from 0.0 .. 1.0 double-range position computation to 0 .. Long.Max range for DHT targets - added fast Long - to - hash computation - high-precision target computation of gaps for new peers - added new target computation for horizontal and vertical DHT targets (not yet in use) - old horizontal-only DHT targets will be upwards compatible to new horizontal and vertical DHT positions git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5318 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-03 00:27:23 +00:00
orbiter	dd27ce7216	added control logic to ECO tables that deletes ram copies of the tables if they get too large ... table copies in ram are now abandoned if less than 20 MB ram is left git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5317 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-02 23:53:09 +00:00
orbiter	38e6ba5d00	forgot to re-rename commonsPath ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5316 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-02 23:39:02 +00:00
orbiter	22989d0d8a	added property index.storeCommons to switch commons storage on or off ... with index.storeCommons=false all currently stored commons are deleted! Default is now 'true', but in future full releases it will be switched to 'false' git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5315 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-02 23:30:09 +00:00
f1ori	4b4ce75396	* http-server: submit charset from html metatags ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5314 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-01 23:17:51 +00:00
f1ori	69e695bd4b	* detect charset for directory index ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5313 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-01 22:14:31 +00:00
f1ori	340ecd919d	* include non ascii characters in visible characters ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5312 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-01 21:13:57 +00:00
lotus	5cf0cbb47e	javadoc ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5311 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-11-01 08:56:58 +00:00
lotus	8d07607d1d	update to resource observer: ... - returns high/medium/low disk space - pauses crawling on medium disk space - disables index receive on low disk space git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5310 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-31 11:33:17 +00:00
f1ori	d0543a7c39	* fix the debug ant-target ... * fix yacy-subdomain handling (http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1556) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5307 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-27 22:16:56 +00:00
low012	baae3d91b1	*) fixed warning when compiling listManager ... *) fixed display of values of information for which part of YaCy (crawler, proxy, ...) blacklist is activated for *) replaced regular put() with putXML() in several cases git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5305 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-27 16:56:19 +00:00
danielr	a4fb76e93c	undo r5300 (not fixed as seen after longer run) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5303 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-25 23:20:09 +00:00
low012	a99a629ed4	*) quick fix to prevent comments for blog entries which don't exist (http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1554) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5302 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-25 12:04:10 +00:00
low012	00e27e5050	*) fixed bug which made it possible to write files outside of the DATA/LIST directory when creating a new blacklist ... *) a blacklist will only be created if no blacklist with same name exists (some refactoring has been necessary for this) *) further minor fixes *) to be continued... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5301 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-25 00:11:03 +00:00
danielr	0f9c0bd0d5	fix for ConcurrentModificationException at de.anomic.index.indexContainerHeap$heapCacheIterator.next(indexContainerHeap.java:324) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5300 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-24 14:00:41 +00:00
danielr	103ad2a437	some javadoc ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5299 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-24 13:58:26 +00:00
orbiter	b098522977	some very small advances to index utf-8 (not working yet), inserted also debugging code ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5298 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-22 22:04:13 +00:00
orbiter	2f49666908	integrated the character decoding into the parser, removed old code ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5297 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-22 20:56:13 +00:00
orbiter	49293c1358	fix for deadlock in new encoder :-( ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5296 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-22 19:36:34 +00:00
orbiter	0edec2b760	FULL redesign of algorithms in htmlTools to encode/decode strings from/to unicode and html. ... The old process used a not really efficient way to detect html encoding strings in texts. All calling methods had been adoped to call the new class in an enhanced way with less parameters. Many classes in interfaces used a XML encoding only (instead of full html conversion from unicode to html); this behavior was not changed with this commit but should be controlled again since it points out possible XSS leaks git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5295 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-22 18:59:04 +00:00
orbiter	958ec20cd0	removed specialized umlaute-handling in html parser. This has to be replaced by something that is able to transfer all possible html encodings into utf-8. Please see SVN 5293 for test cases. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5294 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-22 11:11:55 +00:00
f1ori	2e53cbc66a	should compile now ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5292 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-22 08:50:30 +00:00
f1ori	f3bf2e379e	should compile again ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5291 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-22 07:35:49 +00:00
f1ori	dd8441f102	fix bug: data from plasmaParser is allready converted to UTF-8 ... After removing the restrictions in the code, YaCy should be able to index Unicode-charaters! git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5290 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-21 20:19:10 +00:00
orbiter	6941bf42b1	performance hacks ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5288 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-20 14:07:09 +00:00
orbiter	9b0c4b1063	redesign of parts of the new BLOB buffer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5287 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-19 22:30:44 +00:00
orbiter	1778fb420d	- added some performance tweaks to the new BLOB buffer ... - removed the now superfluous HT storage thread - reduced number of file decompression by shifting the compression moment to the future git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5286 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-19 18:10:42 +00:00
orbiter	9663e61449	added another class to handle BLOB writings to the new HTCACHE data storage: ... - entries are buffered and written as stream with many entries at once (saves many IO accesses) - entries are compressed with gzip: increases capacity of cache - concurrency for stream-writing and compression: all writings to the cache are non-blocking git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5284 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-18 08:57:48 +00:00
orbiter	382226da94	fix for bug introduced in SVN 5281: parameters were switched ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5282 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-17 12:14:57 +00:00
danielr	f2fd043797	refactoring (moved duplicate code into methods) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5281 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-17 10:39:32 +00:00
danielr	c612046e5e	r5278 java 1.5 compatible ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5280 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-17 09:59:59 +00:00
f1ori	af71ec93bf	ops, forgot to import something ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5279 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-16 22:44:25 +00:00
f1ori	9e65e9141c	* always use UTF-8 for encoding hashes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5278 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-16 22:35:27 +00:00
orbiter	826ca79735	refactoring and new architecture to store the files of the web cache: ... - files are not stored any more as individual files - a new database structure using BLOBHeap files stores many cache entries in common files - all file-writing procedures had been migrated to generate byte[] objects which are written with the new database methods this is only an intermediate step to the final architecture, where cached files are written together with their metadata in one single database structure. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5276 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-16 21:24:09 +00:00
danielr	f095137238	- respecting httpdMaxBusySessions (refusing new connections if limit is hit) ... - comments in serverBusyThread converted to JavaDoc - better debug output for npe-case in diskUsage git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5274 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-16 10:53:32 +00:00
orbiter	8ba33f104e	fix for npe ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5269 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-13 21:59:53 +00:00
orbiter	998861acfd	- some refactoring in BLOBHeap to enable more gap processing functions ... - better gap merging in BLOBHeap - shrinking of heap file if gap is at end of file when file is closed git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5268 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-13 21:15:54 +00:00
lotus	9d50bfd0b3	fix for npe: http://forum.yacy-websuche.de/viewtopic.php?p=10562 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5267 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-13 09:09:53 +00:00
orbiter	766cad6e93	enhancement in memory management of BLOB Heap files / merging of deleted entries ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5266 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-12 22:15:01 +00:00
orbiter	7860d5d632	fix for bug in seed list management (cause was bad class overloading, only visual effects!) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5265 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-12 19:51:53 +00:00
orbiter	ffed5fc415	fixed problem with lost peers in database ... migrated seedDB from BLOBTree to BLOBHeap git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5263 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-10 14:40:02 +00:00
orbiter	6fb865fbdc	- fix of bug in iterator in kelondroBLOBHeap which caused bug in crawl profile listing ... - some refactoring of classes that use kelondroMap (Map instead of HashMap) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5262 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-10 08:39:11 +00:00
orbiter	2d65887723	- fix for bug in new profile handling ... - added a new feature in ymageChart (cannot be seen yet, just wait... will be used in profiling chart) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5261 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-09 22:31:43 +00:00
orbiter	ff68f394dd	fix for problem with balancer and lost crawl profiles: ... if crawl profile ist lost, no robots.txt is loaded any more git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5258 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-08 18:26:36 +00:00
lotus	fb8d9850ea	fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1462 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5248 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-05 10:03:02 +00:00
lotus	0d1a2f6183	fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1461 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5247 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-04 12:36:11 +00:00
orbiter	9ac16f565b	- fixed several bugs in database management functions ... - fixed a display bug for the performance graph - fixed deadlock when initialization of awt happens simultanously - removed some debugging output git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5245 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-03 18:57:02 +00:00
orbiter	820a03f9d6	- removed some warnings ... - used fix in SVN 5233 for ysearch.java and search.java git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5237 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-01 20:20:39 +00:00
lotus	fe2792e9ce	use accept-language header instead of user agent for language detection ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5235 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-10-01 17:47:11 +00:00
orbiter	c8bdd965ec	- larger update time for status page ... - balancer writes cause of robots.txt in log file for crawl delay - removed log output for forced GC - smaller RAM flush for RWI cache, should cause more usage of cache and faster crawling git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5228 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-30 11:09:46 +00:00
lotus	dda771db9d	- search result layout ... - tray only for windows git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5222 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-29 12:39:57 +00:00
orbiter	ce4715e305	removed indexing of anchor links and tagging such words as part of urls (that was wrong) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5219 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-28 21:12:26 +00:00
orbiter	ce57de6cb3	- fixed re-setting of DHT Send/Receive settings ... - small change to network grafics: smaller circles / more URLs necessary for full radius; more PPM necessary for full crawling circles - fixed exclusion search ('-' did not work any more) - fixed NPE bug when FTP loader wrote to the error-db git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5218 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-28 20:01:10 +00:00
lotus	31c31e54e4	new tray icon image for different icon sizes (e.g. linux) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5216 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-28 08:54:33 +00:00
f1ori	9589dfe080	* removed trayicon popupmenu title ... * added some menu items to trayicon git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5213 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-27 08:25:16 +00:00
lotus	5a637f004d	localized tray ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5212 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-26 11:09:54 +00:00
lotus	9d4f0325e1	- removed shutdown from search page (we have it in tray now!) ... - fixed doubleclick action for tray git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5211 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-26 10:55:08 +00:00
lotus	214277dad6	- revert r5202 ... - cleanup - installer checks for JRE 1.6 only git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5210 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-26 06:52:36 +00:00
f1ori	7afa084207	* add nativ java trayicon, using reflections ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5209 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-25 19:36:49 +00:00
apfelmaennchen	b97ff24b43	bookmarksDB / xbel.xml: ... - added support for folder=/foldername - it crashes if foldername ends with / git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5207 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-24 21:16:13 +00:00
orbiter	6e7d113eac	fix for wrong index initialization after network switch ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5203 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-23 23:30:25 +00:00
lotus	0a0cc3bf67	added missing classes to build target "run" ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5201 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-23 15:54:12 +00:00
orbiter	7b35d54c6c	fixed some problems with network switching (was not completely 'clean') ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5200 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-23 12:11:19 +00:00
orbiter	f0b42e5a98	fixed NPE ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5199 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-22 14:04:38 +00:00
orbiter	8e0de7f180	update to language statistic evaluation: ... - the condenser does not abandon too small words any more before feeding the statistics - for text indexing no more urls are used to feed the index (this was wrong, but in contrast the indexing of urls for media search is necessary) - urls are not used any more to feed the statistics git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5197 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-21 20:25:47 +00:00
orbiter	1198eeecc7	added language selection to search query: ... - the language can be selected using a LANGUAGE:<language> element in the query line, i.e.: java LANGUAGE:en - the language can be selected with a post element in google-style syntax with the 'rl' element: ?lr=lang_en&query=java git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5193 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-21 07:28:57 +00:00
orbiter	00c1535f84	added ranking and evaluation of language type in a search ... the wanted language is taken from the browser user-agent string git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5192 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-21 00:04:42 +00:00
lotus	a81cb78211	finally some putHTML on htroot/xml/ ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5188 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-20 07:55:30 +00:00
orbiter	bfcf9b7aa3	- added language detection using metadata from documents: html and odt documents provide this information ... - metadata and results from statistical analysis are compared and result is printed out as debug lines - added ranking profile for wanted language - added class with ISO 639 table, a list of all valid country codes that will be used for the language identification git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5187 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-19 22:19:11 +00:00
apfelmaennchen	5e8bd0f29c	small fixes to getpageinfo_p.xml and htmlFilterContentScraper.java with respect to keyword extraction ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5185 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-19 14:27:44 +00:00
apfelmaennchen	5b2a57bfd0	- /xml/util/getpageinfo_p.xml added <desc> and <lang> tags ... - changed htmlFilterContentScraper.getKeywords() to split either space or comma charater not both git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5183 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-18 21:01:23 +00:00
orbiter	e1f67262f7	- added and removed some debugging output ... - fixed a bug with merge method - patched wrong output of language identification (not fixed, only patched!) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5181 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-18 14:12:15 +00:00
orbiter	ce2a7ed116	integrated language detection classes into condenser environment ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5180 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-18 13:12:33 +00:00
orbiter	2b13705839	fixed a mistake in indexing queue processing: documents had been parsed before it was checked if they should be indexed or not. parsing was not necessary for this check, so the check was moved in the queue in front of the document parsing ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5179 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-18 11:36:09 +00:00
orbiter	21dbb39afa	switched two balancer cases ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5177 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-17 22:13:25 +00:00
orbiter	1bbf362cef	update to the crawl balancer: better organization and better crawl delay prediction ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5176 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-17 21:45:21 +00:00
orbiter	ddcf285499	- fixed a bug in performance setting (did not work with german translation) ... - reduced maximum number of error url references to save some memory (this was actually a small memory leak) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5174 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-16 23:04:24 +00:00
orbiter	0cd0fee546	fixed bug with wrong proxy result enqueueing. See: ... http://forum.yacy-websuche.de/viewtopic.php?p=8130#p8130 - removed the online status property. This influenced the proxy behavior and created some complexity that was not needed because the online status was never used as it was ceated for (offline browsing) - checked all proxy identification procedures during crawling and enhanced transparency and error checking - fixed a proxy identification routine that caused the wrong selection of the proxy result queue git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5173 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-16 21:56:23 +00:00
orbiter	670244849d	fix for http://forum.yacy-websuche.de/viewtopic.php?p=9835#p9835 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5164 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-15 18:29:37 +00:00
lotus	fd9233244e	configurable free disk space via disk.free ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5163 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-15 17:33:06 +00:00
orbiter	25a62cdc3f	small fixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5161 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-15 15:11:59 +00:00
lotus	73f233bb11	* set resource observer to 1000MB ... * transparent favicon git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5160 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-15 12:41:27 +00:00
orbiter	5fbccfd75e	fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1366&p=9348#p9348 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5155 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-14 20:10:43 +00:00
orbiter	a28faabfd2	fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1351&p=9242#p9242 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5154 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-14 20:03:59 +00:00
apfelmaennchen	7b63c66a08	- bugfix in bookmarksDB.Tag.hasPublicItems() ... - this anoying little bug prevented display of public items without admin login for /xml/bookmarks/... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5151 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-14 18:45:08 +00:00
orbiter	1fb1665e71	increased dht interval to avoid peer selection failure ... (maybe too less peers available to fill the big gaps) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5143 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-12 13:38:27 +00:00
orbiter	1eb813bd43	shifted index deletion-on-exit rule to the class where the errors are produced ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5141 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-12 11:51:48 +00:00
f1ori	ba76995d2c	* fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1415 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5140 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-12 10:54:11 +00:00
f1ori	bea6c13139	* with r5137 robotParser didn't work at all -> fix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5139 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-12 09:06:38 +00:00
lotus	3ded1efe84	kelondroExceptionCounter didn't work ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5138 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-11 18:51:47 +00:00
f1ori	ae677e1738	* fix problem in robotparser, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1421&p=9742 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5137 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-11 18:12:17 +00:00
lotus	383d89481e	count errors before deleting collection.index ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5136 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-10 16:40:20 +00:00
lotus	0bb4fbc403	delete corrupted collecion.index on exit for rebuild on next start ... see http://forum.yacy-websuche.de/viewtopic.php?p=9725#p9725 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5135 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-10 12:55:14 +00:00
lotus	b68d06a6e8	performance settings based on network's remote crawl speed ... removed some _pro values from config git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5134 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-10 12:52:17 +00:00
danielr	d60b2b198d	proxy fixed 'not modified' http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1419 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5133 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-10 11:06:22 +00:00
f1ori	bd0318ba81	* YaCy only supports gzip-encoding, so remove any other encoding from request ... * fixes http://www.yacy-forum.org/viewtopic.php?f=2&t=163 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5132 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-09 14:04:52 +00:00
orbiter	bb5c898441	enhancements to localsearch behavior ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5131 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-09 10:24:42 +00:00
orbiter	42e2d195ac	added hint from http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1294 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5130 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-08 22:37:58 +00:00
orbiter	39964e88fa	fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1329#p9121 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5129 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-08 22:06:45 +00:00
orbiter	3f3673b6e5	extended balancer: ... - added automatic time delay in case that a large number of urls come from the same domain - added additional time delay in case that an url is a dynamic (CGI) url. This shall cause less IO on targets git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5128 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-08 21:50:37 +00:00
orbiter	3c6e8d2015	set default ppm when network is switched ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5127 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-08 18:20:05 +00:00
orbiter	3288c19c1a	reduce remote crawl PPM for fresh peers in freeworld to 6 PPM ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5124 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-08 09:49:08 +00:00
lotus	5ce9a100bb	fix(2) for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1416 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5122 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-07 13:57:53 +00:00
danielr	cf29ca19d4	possible fix for POST character encoding http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1374 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5121 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-07 13:10:46 +00:00
danielr	a2eeb6138c	fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1416 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5120 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-07 13:04:17 +00:00
orbiter	d09ddabd09	corrected a design mistake (5-byte hashes not necessary) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5119 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-04 21:28:00 +00:00
orbiter	c97d0fcee7	modified the domain list export function: ... - used the new superfast domain list generation from the domain statistics - better interactive behavior git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5118 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-04 20:28:36 +00:00
orbiter	77ee0765a4	- added domain statistic generation to IndexControlURLs_p.html servlet ... - added 'delete all' button to all results of such a domain statistic output which causes that all urls to this domain are deleted - extended stack cleaner to clean also the statistics: they are not completely destroyed, only the smallest counting domains are removed git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5117 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-04 19:41:57 +00:00
orbiter	80a7bc93d6	- added statistical evaluation about domains that appear during crawling ... - added tables that show this statistics in CrawlResults web pages git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5113 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-04 09:59:17 +00:00
orbiter	4fbee21cea	- added fetch-ahead again (had been removed in last commit) ... - reverted default query mode to verify=false git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5111 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-03 23:50:13 +00:00
lotus	423a89ebe8	* fix if yacy was installed to a path with whitespace ... * show nice dots when waiting for restart/update git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5110 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-03 18:49:02 +00:00
orbiter	fc03b0437a	fixed a error case where a second search after a first search with a different search word failed ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5109 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-03 15:55:25 +00:00
orbiter	eca171ba2e	fix for case where javascript was not filtered by the html parser ... see http://forum.yacy-websuche.de/viewtopic.php?p=9667#p9667 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5108 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-03 14:41:20 +00:00
lotus	e645bae29f	display table in log ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5106 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-03 13:14:01 +00:00
orbiter	ead39064c5	fixed problem with wrong result number calculation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5105 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-03 10:04:46 +00:00
hermens	2437beb96c	fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1360&p=9321#p9321 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5104 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-03 07:39:03 +00:00
orbiter	7b12e77a63	fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1393&hilit=&p=9655#p9655 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5103 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-03 00:50:42 +00:00
orbiter	05dbba4bab	added logging conditions to all fine and finest log line calls ... this will prevent an overhead for the generation of the log lines in case that they then are not printed git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5102 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-03 00:30:21 +00:00
orbiter	d3d41e2ee4	- fixed problem with searching with quotes (still not complete, but not as bad as before) ... - fixed parsing of crawl-delay statements when seconds were given with float numbers - enhanced performance of profiling (not too many loggings; not more than one per second) - removed some debug output - fixed wrong return type in logging - added a logging condition in httpd to prevent that logging statements are generated when they are not written (should be added everywhere!) - fixed wrong word distance computation in RWI management git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5101 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-02 23:49:48 +00:00
lotus	3fbfd5a78b	* fix for non-changing offset on new search term ... * dht-heap doesn't has to be deleted (5097), we simply write a new one on exit * do not install YaCy in startup because a Windows-shutdown might corrupt something. Installing YaCy as a service would solve this. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5099 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-09-02 15:09:31 +00:00
danielr	219b93df6a	- fixed internal error after receiving chunked POST ... - removed debug output - added info for "501 Unknown" messages git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5098 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-29 13:51:22 +00:00
lotus	c245c7a45e	delete index.dhtin/out.heap if restore fails ... see http://forum.yacy-websuche.de/viewtopic.php?p=9613#p9613 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5097 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-29 13:10:41 +00:00
danielr	cd19d0aee6	- added warnings for failed transferRWI (dht-in) ... - fixed parseMultipart (uncompress gzipped body) (dht-in) - fixed parseMultipart (using content-length only if uncompressed) - better gzipped POST (chunked instead of content-length) (dht-out) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5096 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-29 09:42:39 +00:00
orbiter	df4ff423c4	added additional properties to query id's to distinguish search events better ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5093 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-28 21:15:59 +00:00
danielr	d6d9b0f14a	fixed transferRWI.html 'Read timed out' ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5092 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-28 08:37:51 +00:00
danielr	e503158527	Proxy: fix for never ending loading after POST ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5091 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-27 20:46:34 +00:00
danielr	1a1d57e449	Proxy: added binary passthrough for POST ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5089 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-27 08:07:18 +00:00
apfelmaennchen	aa6ae77e5e	- autoReCrawl: fix for filter settings ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5088 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-26 21:51:05 +00:00
apfelmaennchen	8ae29bad57	- fix to previous change of Crawl Profile Names ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5087 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-26 20:42:29 +00:00
apfelmaennchen	434104e4a0	- change Crawl profile name for autoreCrawl ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5085 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-26 18:08:48 +00:00
danielr	9ff4fc11da	partial fix (images,audio,video) for proxy and content-type problem http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1374 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5084 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-26 16:34:24 +00:00
lotus	0df2e47012	changed auto recrawl to comply with new date format ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5083 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-26 13:36:10 +00:00
lotus	d9d9c522a1	addendum to last commit ... moved recrawl times for standard profiles to constants calculate new specific dates in cleanup job git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5082 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-26 13:20:18 +00:00
lotus	480497f7c9	changed recrawl ... use a specific date to define old documents this solves an unwanted recrawl-loop during a running crawl git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5081 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-25 20:31:32 +00:00
orbiter	da1b0b2fc6	added two new classes that will be used for the new htcache ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5080 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-25 18:22:23 +00:00
orbiter	536e77e8b7	modifications towards a single database operation to read/write http header and cached file at once: ... - removed distinction between header file types for http and ftp; ftp is simulated by using http properties - removed all old resourceInfo classes that handled this distinction - introduced a new distinction between http request and http response objects - unified new response objects with two other object types that had been introduced elsewhere - changed all servlet call methods to use the new http request header object type - divided static object keys for http header properties into request and response types - refactoring here and there (a large number of type changes and many methods merged/moved) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5079 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-25 18:11:47 +00:00
borg-0300	08cdf6db8a	fix for wrong "VegaYacyB" peers ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5077 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-24 11:30:00 +00:00
danielr	4d937f6b21	fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1396 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5073 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-22 23:46:32 +00:00
apfelmaennchen	bd931a82f7	- added dynamic filters to autoReCrawl.conf ... - Restrict to sub-path: sub - Restrict to start-domain: dom git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5070 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-22 18:05:05 +00:00
apfelmaennchen	b3fc5e96a3	- removed unused import from bookmarksDB ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5067 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-20 21:26:06 +00:00
apfelmaennchen	bc048db7b6	- bugfix for bookmarksDB's rebuildDates() ... - dates are now saved as String.valueOf(TimeStamp) - it might be a good idea to delete (backup) bookmarkDates.db and restart YaCy to rebuild it git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5066 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-20 21:25:05 +00:00
danielr	3c68905540	remove redundant null checks ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5065 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-20 08:37:39 +00:00
danielr	753a1ae430	- changed default browser from netscape to firefox ... - fixed "Inefficient use of keySet iterator instead of entrySet iterator" [WMI_WRONG_MAP_ITERATOR, FindBugs] - fixed some possible null pointer accesses git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5063 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-20 07:54:56 +00:00
orbiter	7989335ed6	Preparations to replace the HTCache with a new storage data structure: ... - refactoring of the HTCache (separation of cache entry) - added new storage class for BLOBs. (not used yet, this is half-way to a new structure) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5062 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-19 14:10:40 +00:00
danielr	be28af50f5	- fixed "yacy2yacy no proxy"-problem ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5058 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-17 10:16:32 +00:00
f1ori	f99c307eff	* correct debian build dependencies ... * add huge mem page detection in general initscript * disable logging completely in jmimemagic-library git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5056 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-14 21:01:21 +00:00
orbiter	bdae051d9a	- extended new performance graph (better timing) ... - added paths for new libraries in classpath for eclipse - refactoring to remove compiler warnings (static access to finals variables) - removed some unused import git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5055 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-13 10:37:53 +00:00
danielr	d9cea5ff23	removed annotations which broke the build with java 1.5 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5054 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-13 09:07:23 +00:00
danielr	a087090bbb	fixed starting crawl results in "No parser available to parse mimetype 'application/octet-stream'" ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5047 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-10 11:31:40 +00:00
danielr	7e7e6a099a	undo 5044 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5046 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-10 10:54:13 +00:00
danielr	f2d0bd7790	fix for NPE in JakartaHttpClient.setProxy ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5045 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-10 09:37:32 +00:00
danielr	bb6a6fc233	fixed 'FileUploadException Stream ended unexpectedly' ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5044 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-09 22:44:17 +00:00
danielr	8422ee5ec4	- fixed UnsupportedEncoding (in proxy) using defaultCharset if no characterEncoding can be determined ... - serverFileUtils.copy* use now Charset instead of String - added some warnings for ignored exceptions git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5043 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-09 12:00:31 +00:00
hermens	3ac1988059	Add some sanity checks for invalid seeds ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5042 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-08 13:56:29 +00:00
hermens	cff4393f0c	Fix HTCache so oldest Files get deleted first ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5041 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-08 08:06:06 +00:00
danielr	31d97f2b9f	replaced httpd.parseMultipart() by a 'right' implementation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5040 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-08 01:40:28 +00:00
danielr	621b473b18	* removed some warnings of findbugs (http://findbugs.sf.net) ... - removed unnecessary code (unused variables, String.toString) - corrected some calculations (cast int to double or long ;) - improved little performance (using Integer.valueOf() instead of new Integer) - log if some File-actions fail (mkdir(), delete(), ...) and some ignored exceptions - finalized some (more) fields - finally close some streams - made inner classes static if not using environment - generalized some equals (from specificClass to Object) - fixed some potential nullpointer accesses git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5039 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-06 19:43:12 +00:00
apfelmaennchen	0500b1179e	added a 2 min start up delay to serverBusyThread autoReCrawl to avoid a Null Pointer Exception... ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5035 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-05 05:50:15 +00:00
apfelmaennchen	e1574fe02e	- added autoReCrawl folders to bookmarks (DATA/SETTINGS/autoReCrawl.conf) ... - the serverBusyThread checks folders every 60 min. (==> autoReCrawl_idlesleep in yacy.conf) - added option to create bookmarks from CrawlStart URL git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5033 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-04 20:43:36 +00:00
orbiter	ebb40d324b	enhanced memory chart: shows now also the size of the word cache as third vector. ... The PPM is now shown without a scale, but with a new anotation at the chart entry. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5032 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-04 10:47:26 +00:00
danielr	17b7845eb5	* refactoring ... - moved constants from plasmaSwitchboard to own class (all 232 ;) - moved remoteProxy-Methods to httpRemoteProxyConfig, better names - removed some unnecessary code (else-statements) * formatting (correct indentation) * minor bugfixes (due to findbugs.sf.net) * hopefully fixed "missing quote" (announcing StringParts as UTF-8) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5031 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-02 13:57:00 +00:00
danielr	3bb870bfcd	added final where possible ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5030 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-02 12:12:04 +00:00
lotus	7e92484400	fix for open browser on windows 2000 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5029 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-08-01 12:58:36 +00:00
f1ori	b0724e5ec0	* add config option to disable cookie monitoring (disabled by default) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5028 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-30 21:19:06 +00:00
lotus	0b2f67577e	Index Transfer: ... - fix for chunk size calculation - fix: if chunk size was 1, an infinite selection loop ran because no entries were found. if chunk size fails <=3 it will be set back to 500 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5023 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-27 18:53:51 +00:00
lotus	694084c570	fix for NPE on shutdown ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5021 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-27 06:59:56 +00:00
lotus	5f77f55ed7	possible fix for negative speed values ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5019 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-27 06:58:35 +00:00
orbiter	50ef5c406f	- refactoring of robots parser (removed opaque Objects[] result vector) ... - added Allow-component to robots result object git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5016 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-24 11:54:37 +00:00
danielr	7913bdb75b	Flextable: filename in errormessage if inconsistent ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5015 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-24 08:22:36 +00:00
lotus	d42eae25f8	yacyTray: ... fix for unproper shutdown some messages installer: start shortcuts minimized git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5014 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-24 06:49:30 +00:00
orbiter	c3d461d191	- removed superfluous copyright statement ... - updated my email address git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5011 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-20 17:14:51 +00:00
orbiter	3ca98fee42	removed superfluous copyright statement ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5010 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-20 00:21:07 +00:00
danielr	c049d80fbd	fixed login problem with yacy as proxy (POST and Cookies) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5009 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-19 15:10:00 +00:00
lotus	62afea0c9f	some improvements for yacyTray ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5008 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-18 14:17:52 +00:00
danielr	7c110e07f0	removed debug ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5006 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-16 12:39:38 +00:00
danielr	eadc204130	gzip POST wiederholbar gemacht (macht transferURL stabiler) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5004 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-16 09:46:25 +00:00
lotus	28c39e2aa4	fix for new starter files ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5002 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-14 18:41:11 +00:00
lotus	fa695c2d9f	tray is now only shown on Windows and doesn't block on linux ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4997 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-13 19:03:38 +00:00
lotus	d77ed28e2f	temporary disabled tray because of flaws on only-shell-linux ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4996 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-13 08:41:39 +00:00
lotus	f8a1e3175e	new yacyTray ... this will make a YaCy icon in the tray area on supported platforms enabled by default the search page will open on double click used JDIC 0.9.4 from https://jdic.dev.java.net/ git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4992 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-13 07:51:45 +00:00
orbiter	05c26d58d9	fixed missing remove operation in balancer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4990 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-11 12:03:18 +00:00
orbiter	606b323a2d	fixed bug that appeared when a new crawl ist started ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4989 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-11 10:59:06 +00:00
orbiter	38eb5bd1ee	fixed a bug in kelondroBLOBHeap. The following files are probably inconsistent and should be deleted: ... DATA/HTCACHE/responseHeader.heap DATA/PLASMADB/crawlRobotsTxt.heap git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4988 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-11 10:38:20 +00:00
orbiter	28d5703f8a	- fixed a bug in Robots.txt loader which could have caused that robots.txt files had been loaded from the same domain more than once ... - patch in BLOBHeap to prevent OOM during startup git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4987 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-11 09:12:54 +00:00
orbiter	7b1c9e6aee	discovered and removed a (possibly large) memory leak: ... many classes used the kelondroMapDataMining (was: kelondroMapObjects) which adds statistical functions to the kelondroMap (was: kelondroObjects), but these functions were not used by these classes. Especially the HTCACHE and robots.txt database allocate a very large number of objects for statistical use, but never used them. By replacing the kelondroMapDataMining with the kelondroMap object for these classes now less memory is allocated. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4986 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-11 07:34:48 +00:00
orbiter	0f5fe8cc53	refactoring of method calling for objects from kelondroMapDataMining ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4985 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-11 07:15:46 +00:00
orbiter	01d1ae6676	patch for negative time in case that the time of the computer is changed ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4984 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-11 07:05:08 +00:00
orbiter	4acf0a61cd	refactoring of kelondroObjects (mainly renaming to kelondroMap) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4982 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-10 22:08:16 +00:00
orbiter	441e9c861e	fix for npe in HTCache cleaning process ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4981 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-07-10 21:30:39 +00:00