1376 Commits

Author	SHA1	Message	Date
allo	2ba56f70a8	XML-safe put. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2848 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-23 10:35:48 +00:00
orbiter	6a73d858de	voting of surftipps can now be done with comments ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2846 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-23 01:10:29 +00:00
allo	5a6488256d	catch the "username too short" exception ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2844 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-22 21:40:16 +00:00
theli	ac13fa763a	*) bugfix for blacklist remove (blacklist was not informed about remove) ... *) adding new soap service class for blacklist management *) new junit class to test soap blacklist service git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2841 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-22 08:32:55 +00:00
daburna	6251944012	-updated languagefile ... -corrected little mistakes git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2837 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-21 15:44:41 +00:00
allo	a831c83025	create servletProperties, with the servlet specific funktions from serverObjects ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2835 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-21 15:01:53 +00:00
allo	a17c43779f	removed wrong part of template ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2830 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-20 14:50:57 +00:00
allo	27f9e0b1c6	xml interface for blacklists ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2829 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-20 14:47:18 +00:00
orbiter	06854988da	- full integration of new LURL database in INDEX ... - added migration method for urlHash.db into INDEX git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2819 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-19 21:14:37 +00:00
theli	52466067d8	*) Bugfix for ArrayIndexOutOfBoundsExceptions which occure because SimpleDateFormat is not thread-safe ... See: http://www.yacy-forum.de/viewtopic.php?t=2995 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2810 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-19 08:33:53 +00:00
orbiter	b79e06615d	- added new LURL.Entry class for next database migration ... - refactoring of affected classes git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2802 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-18 22:25:07 +00:00
daburna	c97984bbac	-corrected link and updated language file for simpleheader.template ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2799 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-18 18:41:46 +00:00
karlchenofhell	b14a500b88	- removed debug output from PerformanceMemory_p ... - added URL escaping (tested, nevertheless watch out for possibly broken URLs) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2797 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-18 14:51:37 +00:00
karlchenofhell	ebf0da2a45	- now the fix http://www.yacy-forum.de/viewtopic.php?t=2974 works ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2796 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-18 12:07:17 +00:00
karlchenofhell	98a84ddb12	- reverted last change partly, can't handle the template system ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2793 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-17 22:22:36 +00:00
karlchenofhell	b5e40e2fa2	- fix for http://www.yacy-forum.de/viewtopic.php?t=2974 (no cache-sizes for new db) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2792 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-17 21:01:35 +00:00
daburna	6d1db21d0b	-updated German language file ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2790 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-17 11:08:06 +00:00
orbiter	77a59a115d	refactoring of indexing methods ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2787 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-16 15:04:16 +00:00
orbiter	688cbfb776	- bugfixing for flextable bug ... - bugfixing for collection index bug - several other bugfixes git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2785 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-16 00:27:25 +00:00
allo	74f09a0510	some more xml-backend files. ... ConfigAdvanced_p.java: list settings after changing. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2784 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-15 21:41:47 +00:00
allo	a29b4d4fb5	extended Supertemplates for Headerincludes. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2780 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-15 13:43:46 +00:00
theli	3bebe72544	*) Default Rex.Exp. changed back to .*.* ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2778 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-15 08:37:19 +00:00
daburna	ea9411f9d2	-surftips now working correct ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2775 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-14 14:13:12 +00:00
theli	5b114249ce	*) Bugfix for ViewLog problem with multiline logging messages ... See: http://www.yacy-forum.de/viewtopic.php?t=2972 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2774 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-14 13:21:07 +00:00
daburna	a1736675ca	-ups ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2769 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-14 11:19:43 +00:00
daburna	2de939f544	-updated translation ... -removed wrong spelling; there is only 1 p in the English tip. I think the surftipps.java have to be updated. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2768 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-14 11:17:14 +00:00
auron_x	c628df43a4	*) removed unused image-file ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2762 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-13 09:23:55 +00:00
orbiter	50f2578c55	- some bugfixing and code cleanup ... - now assortments can completely left out if they do not exist before startup and collection index is selected. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2757 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-13 01:19:26 +00:00
orbiter	a5dd0d41af	- refactoring of plasmaCrawlLURL.Entry to prepare new Entry format ... - added test migration method to migrate the old LURL to a new LURL the new LURL will be splitted into different tables for each month this solves several problems: - the biggest table in YaCy is splitted in different parts and can also be managed in filesystems that are limited to 2GB - the oldest entries can easily be identified, used for re-crawl und deleted - The complete database can be limited to a specific size (as wanted many times) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2755 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-12 23:14:41 +00:00
auron_x	e126598a0f	*) small enhancement to webinterface, progressbars are now not stretched images, but <div>'s with colored background ... -> all skin files were set to use green progressbars (should be changed to colors fitting the skins appearence) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2751 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-12 17:10:28 +00:00
rramthun	581dd2ec72	*)Proper arrow-function on Network.html, but ordering is still broken. Perhaps someone could fix that? ... *)Removed double creation of DATA directory. New warning message in case of insufficient rights. *) Removed roland-ramthun.de-seedlist temporarily, because of server changes git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2747 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-11 18:27:38 +00:00
orbiter	918b59dc5e	- bugfix for snippet profile (no delete button) ... - bugfix for search process (avoided null pointer exception in case other peer does not respond) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2742 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-10 20:16:20 +00:00
orbiter	2bb529cedb	added peer tags for peers in robinson mode ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2741 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-10 20:09:26 +00:00
low012	f7447894f1	*) fixed link to WatchCrawler_p.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2740 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-10 12:39:29 +00:00
orbiter	afbb547f3d	extended options for abstracts generation in remote search interface ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2739 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-10 12:22:16 +00:00
allo	3730ec3440	moving to a _p page. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2738 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-10 10:31:21 +00:00
orbiter	c8f3a7d363	added snippet-url re-indexing ... - snippets will generate an entry in responseHeader.db - there is now another default profile for snippet loading - pages from snippet-loading will be indexed, indexing depth = 0 - better organization of default profiles git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2733 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-09 23:07:10 +00:00
orbiter	2e4aa6a170	refactoring of Advanced Config: ... - removed settings that are in Basic Settings - joined pages that belong together - moved include pages from yacy/ to / git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2726 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-09 10:24:54 +00:00
orbiter	0f10bdde22	more generic cache methods ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2721 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-09 02:13:13 +00:00
hermens	440c6ee657	Implement alternative htcache layout ... mostly according to: http://www.yacy-forum.de/viewtopic.php?p=26205#26205 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2718 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-08 17:25:19 +00:00
allo	226f2c5b2c	first version, of the Serverlet Debugger ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2717 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-08 14:25:54 +00:00
allo	e25172853a	fixed license notice ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2714 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-07 22:25:05 +00:00
allo	1d0c0edda3	first version of posts/get from the del.icio.us api ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2713 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-07 22:16:09 +00:00
orbiter	1969522dc1	removed lowercase of snippets (and other things): ... - added new sentence parser to condenser - sentence parsing can now handle charsets to do: charsets must be handed over to new sentence parser git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2712 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-07 00:06:09 +00:00
low012	07155ef3b0	*) added a few constraints to prevent exceptions when clicking on stop or pause on IndexCleaner_p.html when no thread is started ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2710 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-05 21:32:07 +00:00
orbiter	db294687ea	enhanced logging ... - more logging output - fix in log line preparation - added filter to log page - some small bugfixes git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2707 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-03 22:55:59 +00:00
theli	f17ce28b6d	*) plasmaHTCache: ... - method loadResourceContent defined as deprecated. Please do not use this function to avoid OutOfMemory Exceptions when loading large files - new function getResourceContentStream to get an inputstream of a cache file - new function getResourceContentLength to get the size of a cached file *) httpc.java: - Bugfix: resource content was loaded into memory even if this was not requested *) Crawler: - new option to hold loaded resource content in memory - adding option to use the worker class without the worker pool (needed by the snippet fetcher) *) plasmaSnippetCache - snippet loader does not use a crawl-worker from pool but uses a newly created instance to avoid blocking by normal crawling activity. - now operates on streams instead of byte arrays to avoid OutOfMemory Exceptions when operating on large files - snippet loader now forces the crawl-worker to keep the loaded resource in memory to avoid IO *) plasmaCondenser: adding new function getWords that can directly operate on input streams *) Parsers - keep resource in memory whenever possible (to avoid IO) - when parsing from stream the content length must be passed to the parser function now. this length value is needed by the parsers to decide if the parsed resource content is to large to hold it in memory and must be stored to file - AbstractParser.java: new function to pass the contentLength of a resource to the parsers git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2701 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-03 11:05:48 +00:00
orbiter	bcf2b800b4	applied UTF-8 encoding parameter to yacy-internal protocol communication ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2694 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-02 13:35:38 +00:00
orbiter	5a40ea7866	refactoring of wget string list generation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2692 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-02 09:59:20 +00:00
orbiter	dbc2e039bb	added time-out option parameter to call hierarchy ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2691 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-02 09:40:18 +00:00
orbiter	b59d4576af	increased version number to emphasise that the snippet fix ... _dramatically_ increased search speed git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2690 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-02 01:50:57 +00:00
orbiter	d4c239e4be	- fixed problem in collection index with deletion of single url references ... - added automatic deletion of not-found snippets after search git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2689 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-02 01:40:52 +00:00
orbiter	00746ca232	identified and fixed search performance problem caused by ... snippet loading. Some access to header-db had been twice and even more times in some cases. Snippet resource loading fixed. Furthermore the snippet loading during remote search within the remote peer has been disabled, but can be switched on remotely by new flag 'includesnippet=true' git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2688 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-02 01:15:02 +00:00
orbiter	4d9e1b43dd	surftipps appearance update ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2687 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-02 00:13:59 +00:00
orbiter	310f1c41cd	added option to see ranking scores in surftipps ... and some cleanups git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2684 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-30 23:28:03 +00:00
orbiter	7c0e6de366	bugfix for surftipps votes (wrong page) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2683 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-30 23:06:38 +00:00
orbiter	3ad0709b53	added a delete button to crawl profile list. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2682 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-30 22:35:59 +00:00
theli	a2e3095044	*) Bugfix. Add missing plasmaParserDocument.close() calls ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2680 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-30 10:09:01 +00:00
theli	cd5f349666	*) Better handling of large files during parsing ... Extracted text of files that are larger than 5MB is stored in a temp file instead of keeping it in memory *) plasmaParserDocument.java; getText now returnes an inputStream instead of a byte array *) plasmaParserDocument.java: new function getTextBytes returns the parsed content as byte array Attention: the caller of this function has to ensure that enough memory is available to do this to avoid OutOfMemory Exceptions *) httpd.java: better error handling if the soaphander is not installed *) pdfParser.java: - better handling of documents with exotic charsets - better handling of large documents - better error logging of encrypted documents *) rtfParser.java: Bugfix for UTF-8 support *) tarParser.java: better handling of large documents *) zipParser.java: better handling of large documents *) plasmaCrawlEURL.java: new errorcode for encrypted documents *) plasmaParserDocument.java: the extracted text can now be passed to this object as byte array or temp file git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2679 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-30 09:31:53 +00:00
theli	8b2ceddb91	*) Displaying servere and warning logging messages in different colors on ViewLog_p.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2678 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-30 08:12:22 +00:00
orbiter	df1629b05a	- code cleanup ... - version 0.471 - moved surftipps to own web page git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2676 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-29 22:27:20 +00:00
theli	ed8227d222	*) Bugfix for NullpoinerException in IndexCreateIndexingQueue_p.java ... See: http://www.yacy-forum.de/viewtopic.php?p=25874 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2667 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-27 04:35:02 +00:00
theli	c0f7a4124c	*) Bugfix for soap templates ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2666 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-27 04:24:32 +00:00
theli	3433dfb5e2	*) Bugfix for soap search template: correction for resultCount tags, cdata for snippet tag ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2664 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-26 16:18:04 +00:00
theli	d42dcead1d	*) Bugfix renaming snippet tag in soap search template ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2663 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-26 16:11:38 +00:00
theli	97615af406	*) Restructuring of YaCy SOAP services ... - general functions moved to abstract service class - service class splitted into SearchService, CrawlService, StatusService *) Bugfix for SOAP search services - Attention: some xml tages where renamed See: http://www.yacy-forum.de/viewtopic.php?p=25877 *) New SOAP service function urlInfo to view the parsed content of an URL See: http://www.yacy-forum.de/viewtopic.php?p=25869 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2660 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-26 14:47:44 +00:00
rramthun	b0cab1e731	*)Adapted surftipps to use common 0/1 parameters ... *)Added translation of WatchCrawler.html *)Changed format of German translation. Formal description will probably follow. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2657 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-24 20:15:28 +00:00
allo	4922ab8920	try to fix a nullpointer on snippet generation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2653 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-22 22:51:44 +00:00
hermens	d8fde14c3a	Make maximum number of words in DHT-In cache configurable at runtime ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2652 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-22 12:44:58 +00:00
hydrox	740696f6c3	*) few fixes XHTML-validation ( there is still much to do) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2648 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-22 08:04:24 +00:00
theli	57415b6889	*) Bugfix for surftipps UTF-8 problem ... See: http://www.yacy-forum.de/viewtopic.php?t=2864 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2647 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-22 05:40:29 +00:00
theli	706572f18d	*) Bugfix for ArithmeticException caused by setting max crawling thread count was to 0 ... See: http://www.yacy-forum.de/viewtopic.php?t=2862 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2646 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-22 04:29:31 +00:00
orbiter	2d3b96eeba	bugfixes for surftipps ... - added missing authorization check for votes - second vote on same entry was possible after complete publishing of current vote git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2645 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-21 21:37:40 +00:00
hydrox	85f3617835	*) moved HTML from class-file to template-file (please check if it is valid HTML) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2644 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-21 20:36:46 +00:00
hydrox	9434dba8f2	*) corrected title of IndexCleaner_p.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2643 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-21 07:26:41 +00:00
theli	b6c7b91582	*) Parser now throws an ParserException instead of returning null on parsing errors (e.g. needed by snippet fetcher) ... *) better logging of parser failures *) simplified usage of plasmaparser through switchboard *) restructuring of crawler - crawler now returns an error message if it is used in sync mode (e.g. by snippet fetcher) *) snippet-fetcher: more verbose error messages *) serverByteBuffer.java: adding new function append(String,encoding) *) serverFileUtils.java: adding functions to copy only a given number of bytes between streams git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2641 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-20 12:25:07 +00:00
orbiter	aa38721cf6	new features for surftipps ... - new generation with less memory - removal of doubles - positive votes can generate entries without original news (so they can live on) - link deletion on search results are now also negative votes for surftipps (but they may rarely hit any news) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2640 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-20 12:01:51 +00:00
orbiter	e03427871e	enhanced surftipps: ... - added switchh to show or hide surftipps - more news contribute to surftipps - added voting system for surftipps git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2638 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-20 07:17:41 +00:00
theli	e745b63c77	*) Bugfix for different behavior of indexDistributeWhileCrawling to other checkboxes on IndexControl_p.html ... See: http://www.yacy-forum.de/viewtopic.php?t=2849 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2637 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-20 04:44:56 +00:00
borg-0300	42173462f5	rename cutUrlText to shortenURLString; ... other little things; git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2635 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-19 20:47:45 +00:00
borg-0300	16ba5d1b46	topwords: only [a-z] words, quality is better; ... blank removes; properties added; git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2632 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-19 10:44:45 +00:00
orbiter	ec031eb993	first version of surftipps ... see http://localhost:8080/index.html git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2627 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-18 20:14:21 +00:00
orbiter	f453c14b5d	removed unreacheable catch blocks and unused imports ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2619 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-18 11:23:58 +00:00
theli	97d2a08ef1	*) restructuring needed to support parsing of documents using various charsets ... - serverFileUtils.java: -- adding methods to copy from stream to writer and readers to writers -- moving httpc writeX methods into serverFileUtils class - serverCharBuffer.java: removing inheritance from Writer class - replacing htmlFilterOutputStream by htmlFilterWriter class which handles content as char stream - htmlFilterContentTransformer.java: deactivating getText mode (still needs to be migrated to use char streams instead of byte streams) - changes in several classes to use htmlFilterWriter instead of htmlFilterOutputStream - changes in Scraper and Transformer classes to operate on chars instead of bytes - httpdProxyHandler.java: bugfix. clientTimeout setting was missing in config file git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2617 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-18 10:12:11 +00:00
orbiter	3aac5b26da	- added automatic tag generation when a web page from the search results is added ... - added new image 'B' in front of search results for bookmark generation - added news generation when a public bookmark is added - the '+' in front of search results has new meaning: positive rating for that result - added news generation when a '+' is hit git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2613 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-18 00:37:02 +00:00
michitux	2d9496577f	Removed double labels for forms in Blacklist_p.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2610 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-17 08:07:21 +00:00
michitux	aa46269eff	Less margin/padding for dls (e.g. in Messages) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2609 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-17 07:42:07 +00:00
michitux	567c40f5f0	Bookmark/delete-links now visible when mouse is over the searchresult, in standard-compliant browsers with css, in Microsoft Internet Explorer via JavaScript ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2608 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-16 16:56:22 +00:00
rramthun	20e1754379	Various fixes for the languages ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2600 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-15 16:02:37 +00:00
orbiter	d54144a4e3	fixed bad snippet behavior (hopefully) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2596 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-15 14:17:18 +00:00
orbiter	5015e780c2	- simplified watchCrawler code ... - changed display of watchCrawler slightly git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2594 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-15 13:54:10 +00:00
michitux	31d6cdea53	WatchCrawler.html now valid xhtml, added the class TableCellActive to default skin, please update your skins (sorry, I removed it before because I hadn't seen it in any html-file) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2590 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-15 11:50:25 +00:00
allo	9bed90f8dc	bugfix in js ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2587 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-15 06:33:22 +00:00
orbiter	c42b011648	added watch crawler to menu ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2584 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-15 01:09:34 +00:00
michitux	92157febcd	Bugfix for Blacklist_p.html: Adding of new patterns possible again ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2582 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-14 15:20:32 +00:00
low012	f4af607b79	*) just some typos ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2576 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-14 01:11:49 +00:00
orbiter	e03740c306	small fix for last commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2575 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-14 00:57:41 +00:00
orbiter	c89d8142bb	replaced old 'kCache' by a full-controlled cache ... there are now two full-controlled caches for incoming indexes: - dhtIn - dhtOut during indexing, all indexes that shall not be transported to remote peers because they belong to the own peer are stored to dhtIn. It is furthermore ensured that received indexes are not again transmitted to other peers directly. They may, however be transmitted later if the network grows. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2574 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-14 00:51:02 +00:00
orbiter	6e2907135a	bugfixes for remote search server part ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2573 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-13 22:19:34 +00:00
rramthun	2c6f2a1f74	First language fixes for new XHTML-layout ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2572 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-13 20:03:15 +00:00
orbiter	cf9884e22b	first attempt to implement a secondary search ... this is a set of search processes that shall enrich search results with specialized requests to realize a combination of search results from different peers. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2571 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-13 17:13:28 +00:00
allo	13d0cff257	right dhtml. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2568 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-13 14:02:34 +00:00
orbiter	dfc0ac1958	syntax error fixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2565 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-13 12:02:02 +00:00
allo	6e03f61daa	fix for highlighting searched words in snippets ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2564 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-13 11:26:26 +00:00
michitux	3bbe6a77da	Smaller font-size for tables in PerformanceQueues_p.html and PerformanceMemory_p.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2560 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-12 21:41:16 +00:00
michitux	d6204fd956	Forms in Blacklist_p.html splitted as suggested by KoH to avoid wrong submits when pressing [enter] ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2559 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-12 21:34:02 +00:00
michitux	b573f5b4c2	New layout in Blacklist_p.html, more padding and margin for fieldsets ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2558 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-12 20:31:42 +00:00
michitux	48d8da44d1	Design changes: less margin in fieldsets, search form in yacysearch.html not centered, smaller rows in IndexMonitor.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2557 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-12 16:15:02 +00:00
michitux	140c3e1db9	Some bugfixes: updated ids for labels in DetailedSearch.html, fixed a template-bug in Network.html and added a workaround for a bug in the template engine in IndexTransfer_p.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2556 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-12 14:16:36 +00:00
orbiter	75b198bc02	- updated references to indexContainer ... - more bugfixes and debugging for indexAbstract processing git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2555 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-12 11:13:27 +00:00
orbiter	4f9e42d5ed	more changes towards better join-search ... - fixed problems with index-abstract generation - added analysis output for index abstract receive git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2551 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-12 00:42:42 +00:00
orbiter	8219ce6c67	bugfix inn DetailedSearch form names ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2550 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-11 23:07:28 +00:00
orbiter	462c64a935	removed superfluous file ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2549 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-11 22:13:41 +00:00
orbiter	1137605edf	- small change to DetailedSearch layout ... - version 0.463 for new xhtml interface git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2548 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-11 22:11:05 +00:00
michitux	31393312d0	New XHTML-template for a large part of the frontend, for details see http://yacy-websuche.de/wiki/index.php/Dev:XHTML ... If you don't use the default skin, the style will be broken or at least not complete. YaCy now has two css-files: base.css in htroot/env and the skin. In base.css the layout and black/white text-formating-rules are defined. Colors are only defined in the skin. The skin is now very easy to read and to change. If you want to make more changes than the colors you see in the default-skin, feel free to use the full power of css, but you are warned: The code is still not ready and may change, but we try to avoid changes which affect anything in the default-style. Translation will be broken too because the language-files contain HTML-Code which has changed. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2547 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-11 18:18:12 +00:00
orbiter	82a6054275	- fixed bug with new indexAbstract generation ... - added partly evaluation of indexAbstracts during remote searches git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2544 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-11 10:39:25 +00:00
theli	fded1f4a5d	*) better handling of maximum file size limit in crawler ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2543 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-11 08:26:39 +00:00
theli	7b1881754d	*) Corrections for FF search plugin ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2540 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-11 06:30:34 +00:00
orbiter	74d1dea30b	changes towards better join-search ... - added generation of a compressed index within remote peers during global search - added selection of specific urls within remote peers during secondary global search git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2539 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-10 22:36:47 +00:00
auron_x	4a494464af	*) splitted form to avoid unwanted remove of selected entries as suggested by KoH ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2538 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-10 21:03:34 +00:00
theli	63893003be	*) Adding settings page for the crawler which allows to specify a file size limit and the timeout to use. ... *) adding first version of maximum filesize check for the crawler git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2534 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-09 15:06:49 +00:00
theli	ecbce206b7	*) Bugfix for UNRESOLVED_PATTERN in threadpool configuration ... See: http://www.yacy-forum.de/viewtopic.php?p=25377#25377 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2533 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-09 13:07:40 +00:00
theli	92e986bb91	*) adding missing return prop (requested by allo) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2532 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-09 12:34:24 +00:00
allo	f0529fe53e	update for ftp urls ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2531 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-09 12:28:28 +00:00
orbiter	c543028dd4	fixed double/missing null check for LURLs ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2520 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-08 11:54:28 +00:00
orbiter	96c6e4e322	- enhancements to detailed search page ... - enhancements to search ranking computation process - removed bugs in postranking git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2516 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-08 01:26:06 +00:00
orbiter	e33eb528ba	fixed DetailedSearch ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2514 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-07 22:54:49 +00:00
orbiter	9340dbb501	fixed all possible problems with nullpointer exception for LURLs ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2513 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-07 18:24:39 +00:00
hermens	ff4362b02d	some more fixes for new plasmaCrawlLURL.load behavior ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2511 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-07 14:32:46 +00:00
theli	35b70f164c	*) Status_p.inc: link to memory configuration added ... *) startYACY.bat: comment added See: http://www.yacy-forum.de/viewtopic.php?p=25311#25311 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2500 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-07 04:36:58 +00:00
orbiter	4866868c0e	added write cache for LURLs ... This was necessary to speed up the index receive process during global search git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2498 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-07 01:13:03 +00:00
orbiter	8a0e35618b	enhancements to search result preparation ... - added detailed count on remote search results - enhanced search sequence during remote searches (doing local search in sequence) - strict adherence to timout limits git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2497 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-06 17:51:28 +00:00
theli	dae763d8e3	git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2495 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-06 14:31:17 +00:00
theli	413e6b9855	*) direct access to responseheaders of sbQueue.Entry removed to make it more http independent ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2489 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 15:56:49 +00:00
theli	2126c51906	*) bugfix for ViewFile.java. Wrong http header were used ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2488 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 15:49:51 +00:00
theli	7a35b8e237	*) direct access to responseheaders of sbQueue.Entry removed to make it more http independent ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2487 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 15:36:19 +00:00
theli	3870d615e3	*) setting htCache.Entry fields to private ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2485 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 15:06:58 +00:00
theli	5847492537	*) next step of restructuring for new crawlers ... - IndexCreate_p.java: correcting problems with ftp urls - URL.java does not cutout the userinfo anymore (needed to transport authentication info in ftp urls, e.g. ftp://username:pwd@ftp.irgendwas.de) - plasmaCrawlLoader.java: -- hack to re enable https urls -- adding function getSupportedProtocols git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2482 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 13:17:11 +00:00
theli	4e2a950ac9	*) next step of restructuring for new crawlers ... - avoid using the http crawler class directly. Using the interface class instead git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2476 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 09:24:24 +00:00
theli	f94131c13d	*) Bugfix for Blacklist_p.java ... - avoid nullpointerexception git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2475 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 09:02:23 +00:00
theli	eb9b138986	*) next step of restructuring for new crawlers ... - conversion of the crawler pool into a keyed object pool - crawlers are now loaded based on the url protocol (of course works only for http now) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2473 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 06:52:55 +00:00
theli	1395aae742	*) starting restructuring which is needed to add crawlers for additional protocols ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2472 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 06:09:20 +00:00
theli	857a2d76a2	*) better handling of server shutdown ... See: e.g. http://www.yacy-forum.de/viewtopic.php?p=25234 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2471 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 05:47:17 +00:00
orbiter	7df572756a	fist step+attempt so solve the snippet marking problem. ... See: http://www.yacy-forum.de/viewtopic.php?p=22855#22855 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2469 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-03 23:22:23 +00:00
theli	f3ac4dbbb9	*) better handling of server shutdown ... See: e.g. http://www.yacy-forum.de/viewtopic.php?t=2584 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2468 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-03 14:59:00 +00:00
auron_x	57dda1a92c	*)again fixing for wrong version display, now totally working with double instead of float ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2464 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-28 17:54:07 +00:00
orbiter	18b6876860	new cache flush configuration settings ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2460 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-25 22:31:21 +00:00
orbiter	27a159b401	* documentation update ... * removed doc from release * release information in doc/News.html * release 0.46 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2442 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-23 11:36:09 +00:00
orbiter	d78b824e85	fixed problem with default path after first start-up ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2440 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-22 13:35:51 +00:00
low012	c2264962d1	*) Fixed a bug. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2438 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-21 21:34:45 +00:00
low012	b387bd47db	*) Added a Wiki Code help page and links to it at every textbox Wiki Code can be used in. Maybe this will encourage people to play around with the Wiki and the Blog more. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2437 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-21 21:23:29 +00:00
rramthun	38c4248814	Some language updates ... Removes the ; behind Slovenky in language list git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2430 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-20 11:52:02 +00:00
orbiter	23dd972608	fixed memory calculation in performanceMemory web page ... fixed also maximum cache size computation git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2429 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-20 01:20:34 +00:00
orbiter	1ce3c22761	better memory control: ... - added memory monitor for preNURL-db in performanceMemory - changed default memory assignments git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2427 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-19 13:09:04 +00:00
orbiter	39b4c26bdc	more memory control: ... - catchup of OutOfMemoryError in server threads - automatic adoption of word cache size after a Short Mem Cycle git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2426 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-19 00:06:39 +00:00
orbiter	3e9d509c39	some small fixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2425 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-18 22:50:05 +00:00
low012	479861a3cf	*) Value entered in searchfield will not get lost anymore when link "more options..." is clicked. If Javascript is disabled or function does not work for any other reason, there should be no change to current behaviour. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2424 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-18 21:53:15 +00:00
orbiter	16993e84dd	replaced non-7bit umlaut ascii ... @Franz: sorry, ich hab hier ein ant das daran rumzickt. Bitte in deinem Namen ein 'ss' statt der sz-Ligatur benutzen git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2422 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-18 12:45:19 +00:00
orbiter	0187c60010	because of a bug in the JRE 1.4.2 there was no memory protection ... see http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4686462 this commit fixes the bug by using a memory-computation patch. All uses of Runtime.maxMemory had been replaced by serverMemory.max The bug is not present any more in Java 1.5 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2419 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-18 01:33:54 +00:00
auron_x	4eca0f8830	*) fixed PPM calculation for multiple indexer-threads ... *) fixed totalPPM calculation and added total PPM to Network.html git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2418 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-17 19:15:30 +00:00
orbiter	6ad471ef96	* applied many compiler warning recommendations ... * cleaned up code * added unit test code * migrated ranking RCI computation to kelondroFlex and kelondroCollectionIndex git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2414 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-16 19:49:31 +00:00
low012	9add56dc09	*) Cursor gets placed in search field when page is loaded. If Javascript is disabled or function does not work for any other reason, there will be no change to current behaviour. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2411 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-15 22:21:33 +00:00
theli	34831d2d9f	*) Check validity of crawl filter reg.exp. before adding it into the crawler queue ... See: http://www.yacy-forum.de/viewtopic.php?p=24671 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2410 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-14 16:11:22 +00:00
theli	5e0b6f8f83	*) sorting peer name list on Blacklist_p.html ... *) restructuring of sharedBlacklist_p.java git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2405 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-13 13:29:50 +00:00
theli	6c8366aea1	*) Bugfix for blacklist import function ... - wrong property name - list was accidentally imported into a new blacklist file git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2404 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-13 09:20:43 +00:00
orbiter	d0000a15d6	adjusted opensearchdescription to match requirements of A9 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2403 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-13 00:25:32 +00:00
orbiter	248627ab92	added open search compatibility ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2401 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-12 17:59:13 +00:00
theli	eee44be602	*) adding an interface for customized blacklist classes ... - now it's possible to use a customized blacklist engine instead of the default one - this can be done by configuring the property BlackLists.class See: http://www.yacy-forum.de/viewtopic.php?t=2108 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2397 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-12 14:28:14 +00:00
theli	79f27c298e	*) next bugfix for blacklist ... - added items were not displayed properly - bugfix for disabled usage git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2395 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-12 12:18:39 +00:00
theli	4abc04dac0	*) make Blacklist_p.html more failsafe if no blacklist file is available of the user has entered empty strings ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2394 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-12 12:03:44 +00:00
theli	28c84e5b57	*) Bugfix for NullPointerException in Blacklist_p if blacklist directory is empty ... See: http://www.yacy-forum.de/viewtopic.php?p=24563 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2392 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-12 11:03:14 +00:00
theli	66f1eb07d9	*) Bugfix for IllegalArgumentException in transferURL ... See: http://www.yacy-forum.de/viewtopic.php?p=24560 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2391 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-12 10:54:19 +00:00
theli	d2e8e76218	*) now it's possible to configure the yacy blacklist separately for dht, search, proxy, crawler ... See: http://www.yacy-forum.de/viewtopic.php?t=2541 http://www.yacy-forum.de/viewtopic.php?p=24516 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2389 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-12 02:42:10 +00:00
orbiter	f43c90fa98	fixed handling of null referer in crawlOrder ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2384 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-11 21:46:34 +00:00
rramthun	23a99b8283	Small changes to the language ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2383 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-11 20:55:40 +00:00
orbiter	abf22f6e60	removed url normalform computation from htmlFilterContentScraper. ... This method was implemented in de.anomic.net.URL git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2377 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-11 15:09:22 +00:00
orbiter	718fbc2dae	enhancements in kelondroCollectionIndex: ... * synchronized array and index objects * auto-fix function for slightly corrupted index entries * generalized internal access methods also extended kelondroIndex interface to support ordering access which is used in kelondroCollectionIndex for string comparisments git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2366 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-07 23:29:26 +00:00
orbiter	ec5149ff3b	fix for busyCacheFlush detection ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2365 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-07 22:28:09 +00:00
orbiter	f58283def2	better control of index flush ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2364 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-07 22:07:17 +00:00
orbiter	80b6c90d54	enhancements to prevent blocking during dht transfer receive ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2362 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-07 21:49:39 +00:00
auron_x	4fb8fddd99	*)made the domainlist of the blacklist sorted ... if a new domain is added it is still appended to the end of the list and sorted in with next refresh, may need a fix. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2361 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-07 17:34:27 +00:00
hermens	d56f06401e	- Cache known URLs during indexReceive to avoid getting blocked during loadedURL.exists() whenever possible ... - Small logging updates git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2359 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-07 11:42:00 +00:00
theli	c09f734d06	*) offer router configuration on ConfigBasic.html ... - checkbox to allow router configuration is shown if - a) the UPnP forwarder is installed - b) a UPnP enabled router was found - c) no other forwarder was configured See: http://www.yacy-forum.de/viewtopic.php?p=24264 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2358 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-07 11:31:18 +00:00
hermens	dcbb4d0a6b	Display the size of HashBlacklistedCache on PerformanceMemory page. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2357 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-07 11:19:54 +00:00
theli	c7b6389ca1	*) renaming indexDistribution.dhtReceiptLimitEnabled property to indexDistribution.transferRWIReceiptLimitEnabled ... so that the default value is taken over by all peers git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2356 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-07 11:01:01 +00:00
theli	988341cf81	*) some comments added ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2352 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-06 14:44:04 +00:00
theli	d54767f634	*) last step of removing embedded html from dir class ... - migration finished *) dir list now sorts the dirlist entries. - directories are listed before files - files are sorted alphabetically, case insensitive git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2351 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-06 14:38:07 +00:00
rramthun	96b774e427	Adding link to newsletters as agreed in forum. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2350 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-06 10:22:53 +00:00
theli	8283df2d77	*) first step of removing embedded html from dir class ... - dir list generation uses templates now git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2349 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-06 08:09:39 +00:00
orbiter	279b1d969d	Integrated new indexing data structure 'collections' into the main class ... for indexing, the plasmaWordIndex. The new data structure is ready-to-use, but currently disabled. It can be activated by setting the static plasmaWordIndex.useCollectionIndex to true. This shall be done for testing purpose. The new index is stored to DATA/INDEX/PUBLIC/TEXT The directory PLASMA shall be used only for crawler in the future. Attention: during testing the data structure in INDEX may change, and created indexes with the new data structure may get useless. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2348 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-05 22:22:14 +00:00
allo	132cd7da45	no need to copy dir.* ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2346 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-05 18:39:25 +00:00
allo	0164321160	fix for the actions (uploading/deleting, loggin in, ...) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2345 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-05 18:34:31 +00:00
orbiter	9183d21f25	renamed new index class to old name ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2342 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-02 20:01:59 +00:00
orbiter	c4e922885a	replaced indexURLEntry by new class that uses a kelondroRow.Entry object ... to store the index entry. This is another step to move to the new database structure. A side effect of this change is, that index storage uses much less RAM space, which affects the index RAM cache. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2341 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-02 19:59:28 +00:00
orbiter	e357599f92	* fixed problem with indexContainer iteration from RAM: ... indexContainers from RAM must be cloned explicitely to prevent side-effects on stored indexContainer objects in Cache * changed behaviour of urlReference deletion from indexContainers: deletion does not user retrieval of all Elements from the assortments * added textual configuration of kelondroRow and kelondroColumn definition * update of kelondroRow usage in yacyNews * modified kelondroAttrSeq to use modified kelondroColumn parser git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2339 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-08-01 10:30:55 +00:00
orbiter	8b77afd72c	some fixes to new container merger ... and some code cleanup git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2336 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-26 22:40:11 +00:00
theli	6e676224d0	*) adding support for upnp ... A new port forwarding method for upnp was added. If this method is enabled, yacy automatically determines an UPnP capable internet gateway and configures the gateway port forwarding settings properly. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2328 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-26 14:26:45 +00:00
orbiter	417ed5102e	redesign of database iterators: ... an iteration of key elements in kelondroTree databases is no longer supported. this is now replaced by an iteration of kelondroRow.Entry objects from the database Iteration of keys from the database was mostly followed by retrieval of the row from the database, whcih caused unnecessary database load. The index selection was also redesigned to use the new row iteration methods. This affects many funktions, most important is the DHT selection routine which is now much faster. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2327 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-26 11:21:51 +00:00
orbiter	ad692fc6c7	implemented option to extract nurls from the database ... (plus some iteration enhancements for nurls) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2325 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-24 16:40:59 +00:00
orbiter	5f72be2a95	some redesign of EURL storage ... * store() is now called explicitely * more urls are written to the EURL table * the EURL stack does not store the complete entry any more, now only the URL hash git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2323 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-24 15:25:47 +00:00
orbiter	58df8b7bbf	a large collection of different changes ... * mainly for the transition to the new indexing database structure * a bugfix for an endless loop inside kelondroTree iteration * a bugfix for bulk read inside a kelondroTree iteration; the bug caused that some elements had been iterated twice * very strong speed enhancement for url/domain extraction git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2320 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-23 22:39:41 +00:00
theli	b3c569f706	*) renaming of function getTransferedEntitySpeed to getTransferedEntrySpeed to avoid confusion ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2308 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-19 13:52:33 +00:00
allo	01363bc7f6	missing file for the supertemplate demonstration. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2307 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-19 11:59:55 +00:00
allo	67c486a023	some example Code, how supertemplates can be used. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2304 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-19 07:08:15 +00:00
allo	7b0e2521bb	Support for a supertemplate, which can do all thing, a normal template can do. ... Its a layer under the servlets, this means, #[page]# will be replaced by serverletcode, the rest can be set by you. (TODO: if we use this for layout, we need to read "TITLE" from the servlet's tp, to set it outside of the servlet.) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2302 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-18 15:51:19 +00:00
allo	ff39a7a0d1	Overlay for welcome.* ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2299 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-18 11:07:30 +00:00
rramthun	b5ec7de936	Correction to last commit + spelling ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2296 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-17 16:23:47 +00:00
allo	8e08125657	security fix (known path on yacy host / known path on remote ftp server) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2292 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-13 19:15:28 +00:00
orbiter	3879a0ecd0	replaced java.net.URL usage by use of new class de.anomic.net.URL ... This shall be seen as an experiment to exclude all cases where there could be a DNS lookup during URL comparisment. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2290 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-13 01:21:53 +00:00
allo	933a9e02ab	fix for broken build ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2284 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-09 14:35:20 +00:00
allo	360056b30c	fix ajax bug (no valid xml) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2283 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-09 10:59:55 +00:00
allo	f4d200ffa2	typo ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2281 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-07 20:44:45 +00:00
orbiter	e22cbaee97	- extended logging for preload ... - reduced preload-time for IndexImport_p.java git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2278 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-05 09:02:58 +00:00
orbiter	92f4cb4d73	added option to configure the start-up delay time for kelondro database files. ... the start-up delay is used to pre-load the database node cache git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2276 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-03 23:57:33 +00:00
orbiter	675d1081a4	code clean-up: switched off unused variables ... (bitte solche Variablen die nicht benutzt werden vermeiden. Ich habe hier ein strafferes Warning an, da bekommt man die immer angezeigt) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2273 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-03 13:39:08 +00:00
theli	31b5d8980e	*) Bugfix for basic config redirection bug ... see: http://www.yacy-forum.de/viewtopic.php?p=23503 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2269 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-02 13:03:01 +00:00
rramthun	068d82c4c2	Important update of YPStats ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2258 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-29 20:30:50 +00:00
theli	b594ee9a5a	*) Adding possibility to configure if the http proxy should send the ... X-forwarded-for header (requested by TeeSee) See: http://www.yacy-forum.de/viewtopic.php?t=2577 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2257 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-29 16:01:03 +00:00
rramthun	0e9192a622	Updated YPStats_p.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2253 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-28 09:51:38 +00:00
hydrox	8ba8e2b7d9	*) added cache for blacklists urlhashs recieved by DHT. DHT does not request URLs listed in this cache. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2251 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-28 08:51:34 +00:00
rramthun	db2405533a	New YPstats possibility. ... Users can enter the details of their system configuration and we are able do work-out profiles for special uses and hardware-configurations. Default DB running on yacy-forum.de, but URL can be changed. User can see all data, which will be submitted. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2249 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-27 15:45:38 +00:00
hermens	53cbcc6d6e	Implement emergency break in index receive when the limit of the ramCache is exceeded by more than cacheLimit ... See: http://www.yacy-forum.de/viewtopic.php?p=22911#22911 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2248 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-27 11:14:30 +00:00
orbiter	4cc6e6551f	bugfix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2245 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-26 09:52:23 +00:00
orbiter	66964dc015	removed high/med/low from kelondroRecords cache control. ... this was done because testing showed that cache-delete operations slowed down record access most, even more that actual IO operations. Cache-delete operations appeared when entries were shifted from low-priority positions to high-priority positions. During a fill of x entries to a database, x/2 delete situation happen which caused two or more delete operations. removing the cache control means that these delete operations are not necessary any more, but it is more difficult to decide which cache elements shall be removed in case that the cache is full. There is not yet a stable solution for this case, but the advantage of a faster cache is more important that the flush problem. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2244 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-25 10:31:38 +00:00
theli	b20496e42b	*) make DHT DoS check configurable (requested by KoH) ... - check can be disabled via property indexDistribution.dhtReceiptLimitEnabled - upper bound can be configured via indexDistribution.dhtReceiptLimit git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2234 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-21 19:28:42 +00:00
allo	032b3fdd94	allow Creation of gettext only with password, because it causes high cpu-usage. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2227 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-21 10:39:25 +00:00
allo	c264cda678	support to parse gettext files and to generate updated files, where only the new strings are empty. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2222 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-20 18:52:17 +00:00
allo	f95c006dc2	generation of empty gettext files from yacy html-files ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2218 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-19 19:34:00 +00:00
allo	0621106ef3	git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2214 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-18 12:15:26 +00:00
allo	6fe2fed87e	cookieauth works with static Admin. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2208 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-16 08:04:02 +00:00
theli	4ca0857c0c	*) Index transfer now considers the pause time send by busy peers during ... index transfer / index distribution See: http://www.yacy-forum.de/viewtopic.php?p=22647#22491 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2205 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-14 09:40:42 +00:00
allo	958408ca4a	bugfix for httpauth logout. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2203 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-12 20:22:15 +00:00
allo	b23703f260	using cookieAuth. ... logout for httpauth seems to be broken :-( git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2202 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-12 16:16:13 +00:00
allo	bd22634c44	HTML-login, logout fixed. ... TODO: If you login with the form, then logout with the form, and then try to login with httpauth, the first try will fail. (should logged_out be resettet in ipAuth? but if there is ipAuth before proxyAuth, the logout would be broken. Maybe a combined method can help.) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2200 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-12 13:47:44 +00:00
hermens	3f1ebc097e	Limit the size of the DNS cache to 5000 and the age of the entries to one day. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2199 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-12 12:14:11 +00:00
allo	d7a3fdb18b	no white pages, when clicking cancel on the password-dialog ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2198 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-12 12:12:21 +00:00
allo	ac772d4ef0	more RAM for our powerusers ;-) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2195 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-11 09:09:22 +00:00
allo	11123416f3	Form-Login function. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2193 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-10 21:03:33 +00:00
allo	251b3b636e	some refactoring for js ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2191 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-09 17:20:17 +00:00
theli	d2dc848902	*) correcting validation of proxyStoreHTCache in ProxyIndexingMonitor configuration ... See: http://www.yacy-forum.de/viewtopic.php?p=22663 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2188 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-09 04:49:00 +00:00
hermens	38a1410361	Don't test a remote peer's seed during hello.respond as its IP might not be proper, especially while still virgin ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2187 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-07 23:59:45 +00:00
rramthun	5625937d1c	Language improvements ... One very minor HTML fix git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2181 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-06 16:30:32 +00:00
auron_x	71228cfc56	*)added ip to Blog.xml ... *)added possibility to import Blog.xml-files *)included german translation for new Blog-features git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2178 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-05 18:47:31 +00:00
auron_x	7b47055d6c	*)added Blog.xml for backup and exporting purposes, no importing at this time ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2177 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-05 10:34:27 +00:00
auron_x	3af867c7ba	*)fix for broken subject in Blog-News ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2175 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-04 12:30:23 +00:00
rramthun	962bc705d4	Fixed broken link ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2174 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-03 22:59:28 +00:00
orbiter	b4efd7fc4b	changed default number of search results ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2169 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-06-02 19:40:50 +00:00
orbiter	5041d330ce	refactoring ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2150 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-28 11:44:50 +00:00
orbiter	7b3b12888c	refactoring: integrated indexContainer abstraction layer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2149 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-28 01:09:31 +00:00
rramthun	bc94a714b2	Better explanation for the auto-dom-filter. ... Some javadoc. Small change to DetailedSearch. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2146 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-26 12:18:12 +00:00
orbiter	196b8abb30	refactoring ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2144 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-26 09:32:50 +00:00
orbiter	24686e50a2	- fixed a caching bug ... - added counter for cache delete to distinguish between flush and delete - changed some default paramenters for cache size settings git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2143 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-25 11:46:09 +00:00
orbiter	4d8f8ba384	added cache-performance analysis for node caches ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2140 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-24 09:40:08 +00:00
orbiter	1b4a27cd99	added monitoring for new miss-cache ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2137 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-23 22:59:39 +00:00
orbiter	cda087f43b	- integrated cache miss storage into object cache ... - removed cache-miss handling from indexURL todo: new Monitoring in PerformanceMemory_p git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2132 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-23 16:43:28 +00:00
orbiter	757ec28430	refactoring: better data capsulation for indexURL ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2131 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-23 08:59:45 +00:00
rramthun	fd27d55385	One more table in ConfigBasic by Kebron ... Nicer blog-newssymbol by Kane HTML corrections/improvements by /me git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2130 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-22 10:01:46 +00:00
theli	61078b3885	*) adding support for delayed shutdown ... - needed by Ismael to receive the Steering page properly on shutdown - now the steering page should always be displayed properly in the web browser git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2129 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-22 08:02:35 +00:00
theli	97393196fa	*) Avoiding wrong java heap size settings. ... Xmx must be greater or equal Xms See: http://www.yacy-forum.de/viewtopic.php?p=21782 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2128 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-20 15:15:52 +00:00
theli	8b7626f8d1	*) Automatic redirection of browser if user changes port settings in ConfigBasic ... See: http://www.yacy-forum.de/viewtopic.php?t=2415 *) If ssl is available, the browser conntects to yacy via https on yacy startup See: http://www.yacy-forum.de/viewtopic.php?p=21649#21649 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2127 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-20 14:05:49 +00:00
rramthun	955462d6b8	Some HTML cleanup/validation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2126 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-20 13:20:46 +00:00
auron_x	e7199c6c7e	*)fixed "Umlaute"-Bug in Blog ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2125 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-20 12:21:01 +00:00
auron_x	ee1cc99c2f	*) fixed some minor bugs in blog ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2123 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-20 11:45:58 +00:00
orbiter	90d569d70f	refactoring of index management: ... url storage is part of index management; moved plasmaURL to indexURL git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2122 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-19 23:50:55 +00:00
orbiter	a930be4ba3	refactoring of index management: ... generalized the index entry git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2121 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-19 23:19:20 +00:00
orbiter	7dd57a3828	added a busy-time estimation at DHT/RWI-Receive ... to be done: usage of this value on client-side git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2116 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-19 14:52:00 +00:00
theli	fcec40fcc6	*) don't accept messages without subject or payload ... See: http://www.yacy-forum.de/viewtopic.php?p=21656 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2115 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-19 11:57:17 +00:00
orbiter	82b2bc6932	patch for index-transfer DoS problem ... see http://www.yacy-forum.de/viewtopic.php?p=21627#21627 note that this function will make the index-transfer functionality void git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2114 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-18 22:24:51 +00:00
hermens	df7e1d9df3	Changes to plasmaURL and subclasses: ... - Improve performance of plasmaURL.exists() by remembering URL-hashes that are not present - Use a more realistic estimation of memory usage by the existsIndex cache - Routine cleanup of the existsIndex to limit its memory usage git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2113 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-17 13:08:57 +00:00
allo	70ef53a89d	html fix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2112 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-16 17:33:46 +00:00
orbiter	a474669338	start with refactoring of index management ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2110 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-16 16:11:55 +00:00
(no author)	63a08307c2	Updated WikiLink ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2109 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-16 11:47:20 +00:00
orbiter	bfc1a6a383	interface update ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2108 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-16 10:42:22 +00:00
orbiter	20958acfd8	- fix for display problem for new blog news banner ... - created 'real' ip-based links instead of '.yacy'-links git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2103 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-15 21:45:26 +00:00
orbiter	19c6e67003	- added generation of news for blog entries ... - added display of blog banner in Network view - extended lifetime of blog, wiki and crawl news git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2102 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-15 20:48:39 +00:00
rramthun	f08e33680c	Added Blog-news-symbol as requested. ... I think I will change the character distance a little bit later. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2101 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-15 15:42:06 +00:00
theli	df068cf23c	*) adding first version of native SSL support for yacy ... VERY EXPERIMENTAL! See: http://www.yacy-forum.de/viewtopic.php?p=18516 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2096 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-15 09:41:29 +00:00
auron_x	55ea4cbfe6	*)reverted patch for memory-display issue ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2095 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-14 18:09:28 +00:00
orbiter	ba9798dcb7	better fix for ... http://www.yacy-forum.de/viewtopic.php?t=2370 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2093 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-14 17:19:43 +00:00
auron_x	53d9ab6db7	*)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers ... see http://www.yacy-forum.de/viewtopic.php?t=2370 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2091 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-14 08:42:41 +00:00
theli	9c5ec2c8db	*) fix for broken html on IndexTransfer_p.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2089 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-13 15:43:00 +00:00
theli	bcc950c533	*) Bugfix for Index Transfer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2088 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-13 15:28:57 +00:00
rramthun	fb064fdbee	Many additions/corrections to the German language file ... Increased default time for DHT distribution, because many people complained about the high load on their systems, see http://www.yacy-forum.de/viewtopic.php?p=20922#20922 Avoided problems with some browsers and ampersands, see http://www.htmlhelp.com/tools/validator/problems.html#amp Removed nearly invisible "bug" in menu git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2087 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-12 21:25:46 +00:00
auron_x	586b256627	*)fixed Blog-bug with german Umlaute ... *)corrected wrong html in blog see http://www.yacy-forum.de/viewtopic.php?t=2330 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2083 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-11 14:03:15 +00:00
allo	9938c252dd	better Errorhandling for proxyAccounts ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2082 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-11 13:12:35 +00:00
orbiter	015d044c25	tried to fix some problems with latest changes to httpc ... very experimental! git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2078 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-10 16:01:14 +00:00
orbiter	26e3216bcc	update to profile fetch behavior ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2076 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-10 09:37:18 +00:00
orbiter	3e31820c3d	- corrections to PerformanceMemory display of object cache ... - configuration of object cache size in kelondroTree initializer git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2075 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-10 09:08:42 +00:00
orbiter	fd7c17e624	added virtual host support: ... all yacy-to-yacy communication now send the <peer-hexhash>.yacyh virtual domain inside the http 'Host' property field. This shall enable running a yacy peer on a virtual host. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2074 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-09 13:11:00 +00:00
orbiter	29b1b0823c	added monitoring of new object cache to performanceMemory page ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2072 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-09 10:03:12 +00:00
low012	465319caf3	*) HTML-Tags in headlines and author names were not filtered. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2061 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-06 00:47:16 +00:00
allo	799c04091d	Bugfix for Spam-Bug (Header manipulation) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2057 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-04 16:41:30 +00:00
low012	97c6a70b71	*) Fixed XSS vulnerability. I was able to crawl a PDF that caused the loading of an image in the admin's browser. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2056 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-04 16:07:35 +00:00
orbiter	f9c953481a	fix for icq+jabber icons ... see http://www.yacy-forum.de/viewtopic.php?p=20533#20533 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2046 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-29 21:37:49 +00:00
rramthun	007b8008c2	-spelling/translation ... -adding hint for text-browsers git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2045 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-29 16:33:49 +00:00
orbiter	b0036249c1	added some attributes to network picture ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2032 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-21 21:21:35 +00:00
orbiter	dbe96e6541	added hand-over of search filter and prefer ranking to yacy protocol ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2029 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-20 10:15:00 +00:00
low012	ae0bdf5d71	*) added status indicator for Jabber ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2025 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-19 08:39:49 +00:00
orbiter	00a5d435e2	- fixed some bugs with domain filter ... - added new ranking filter "prefermask": urls that match the filter are ranked better git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2022 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-13 23:19:36 +00:00
orbiter	b00756378f	adopted ViewProfile to be used in search interface to fetch local profile ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2021 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-11 14:18:25 +00:00
orbiter	41afccaf34	small update to search interface ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2020 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-10 23:05:01 +00:00
orbiter	14d6e476c9	tried to solve some problems with new picture viewer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2019 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-10 22:34:47 +00:00
auron_x	aaaaf88ecd	*)fixed error when setting empty language/skin ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2016 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-08 17:06:33 +00:00
orbiter	d0dd8b14d2	fixed picture tag and presentation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2014 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-07 22:09:59 +00:00
orbiter	51999578bf	fixed bug created with last commit of borg ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2013 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-07 17:13:09 +00:00
orbiter	00e768b259	added Picture button to search results ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2011 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-07 13:38:09 +00:00
daburna	7f167be945	small update of German language file ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2008 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-06 21:50:12 +00:00
orbiter	f0833b0328	introduced simple search interface ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2007 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-06 21:48:24 +00:00
orbiter	bd283b8443	fixed bugs: ... - null pointer exception during startup of a robinson-configured peer - wrong time calculation of default value of re-crawl option git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2005 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-06 16:28:28 +00:00
rramthun	52d3d7b008	Added the new chatscript by Allo and _cato ... The usual language stuff Reordered superseed.txt after reliability git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2003 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-06 15:46:16 +00:00
orbiter	c5087710a4	fixed type/cat properties ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2002 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-05 10:47:42 +00:00
orbiter	47b541b2d1	added better option handling in yacysearch ... added depth option for image presentation git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2001 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-05 10:34:24 +00:00
orbiter	c9e16bfd48	first try to insert image search (does not work yet) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2000 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-04 23:12:10 +00:00
auron_x	0bf2eb4813	*) fixed Blog updating timestamp on edit (now always keeps creation-date) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1997 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-04 15:10:59 +00:00
orbiter	83e0e765ec	redesigned some parts of the html scanner & parser ... to better support image tags git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1995 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-04 14:36:01 +00:00
orbiter	e2e8d0c188	some kind of refactoring of yacysearch: ... made 'room' for new picture search result presentation git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1993 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-03 22:47:59 +00:00
orbiter	6b63e26cbb	- removed search function from index.html/java, only imput left ... - added media fetcher/crawler class (not ready yet) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1992 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-03 15:36:53 +00:00
low012	80ef2355a8	*) added login link to blog ... *) added copyright notice to blog.java *) deleted some whitespaces in the code git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1991 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-03 11:28:12 +00:00
orbiter	d8d0ac29c3	added image-viewer servlet that can do: ... - each image that is requested is stored in the cache - the image is taken from the cache if exists there - the image can be scaled The purpose of creation a scaled image is because of copyright problems In a further stept the retrieval of not-shrinked images is restricted to either access from localhost or with given authentication This servlet can be used for image-preview purpose after an image search git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1989 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-02 22:59:53 +00:00
orbiter	e566d1d8d6	some bugfixes regarding new crawling options ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1980 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-28 22:54:36 +00:00
orbiter	c7f1300300	-fixes for last commit ... -some more ranking attributes (comments only) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1979 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-28 15:37:45 +00:00
orbiter	860a7b545b	enhanced input options for crawl start ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1978 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-28 15:25:58 +00:00
orbiter	7a650d0023	several bugfixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1971 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-27 16:45:29 +00:00
borg-0300	57fc0cf063	added ranking icon to Network.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1970 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-27 15:55:31 +00:00
orbiter	59d52fb4a9	fixed some problems with crawl profiles ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1967 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-26 14:52:01 +00:00
allo	44d72f06c4	more Caching ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1965 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-24 15:08:27 +00:00
allo	918445a2f4	Bugfix for last commit. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1964 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-24 14:34:27 +00:00
orbiter	219d847aaa	fix for appearance of radio buttons ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1963 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-24 14:07:23 +00:00
orbiter	8cac4a1e73	syntax fix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1962 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-24 14:00:28 +00:00
orbiter	7310d2de1f	small fix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1961 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-24 13:56:58 +00:00
orbiter	0c9b61820e	enhanced re-crawl settings ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1960 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-24 13:45:01 +00:00
orbiter	708cc6c8d9	fixed some bugs for auto-filter and added monitor in profile list ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1959 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-24 00:38:40 +00:00
orbiter	1f32ad8fd9	very small enhancements to indexCreate page ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1958 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 23:32:04 +00:00
allo	c58789177f	bookmarkCache ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1956 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 21:33:09 +00:00
rramthun	42b0b10a95	-Adding Windows Media to types which are not sended compressed ... -Renaming writeandzip to writeandgzip to avoid confusion about type of compression -Adding new startup message to windows script -The usual language "enhancements" ;-) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1953 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 20:12:23 +00:00
orbiter	63f39ac7b5	added 3 new crawling steering options: ... - re-crawl by age of page (enter in minutes) - auto-domain-filter - maximum number of pages per domain NOT YET TESTED! git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1949 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 16:05:16 +00:00
orbiter	1fc3b34be6	some pre-work (without function yet) to implement: ... - re-crawl (by age of last crawl) - auto-crawl-filter by crawl depth (to be explained..) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1948 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-22 15:28:17 +00:00
orbiter	0a4c2e89ed	remote crawl orders are now only accepted if sum over all ... queues is less than 100 (the indexing queue was not measured before) see also: http://www.yacy-forum.de/viewtopic.php?p=19374#19374 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1947 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-22 14:23:24 +00:00
orbiter	1f4412a146	adopted isListed to discussed new behavior as discussed (url, getFile) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1940 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-20 22:31:59 +00:00
borg-0300	cb23fc3d83	keywords added ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1934 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-19 12:36:39 +00:00
borg-0300	1258df8133	no "[0-9]+" in topwords ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1933 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-19 12:33:50 +00:00
orbiter	6c70f4a0cf	renamed wordHashes for a word hash set generation to wordHashSet ... This was done because the wordHashes iterator will get another integer parameter and then conflicts with the wordHashes set generation git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1921 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-18 01:04:16 +00:00
orbiter	dba02f399f	starting of re-design of kelondroTree iterator ... - new access to iterator - added many IOException handling in other Classes git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1914 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 20:52:43 +00:00
allo	d2f34a2e94	skin in DATA/HTDOCS (works after upgrade, works when only DATA is writable). ... preference of skinfiles: -style.css will be overwritten on every new SVN, if "DATA/SKINS/"+currentSkin+".css" exists. -DATA/SKINS will be overwritten with defaultskins from /skins so develop your skins in DATA/SKINS, and put them into skins for distribution. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1913 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 20:48:00 +00:00
orbiter	3286b1f498	re-organisation of lurl-creation and -stacking ... this was necessary to prevent useless write to the database in case of blacklist appearance of the url git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1905 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 10:16:07 +00:00
hermens	289da326e5	*) Bugfix: remove blacklisted URL from loadedURL, when received via DHT transfer ... see: http://www.yacy-forum.de/viewtopic.php?p=18976#18976 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1904 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-16 23:58:44 +00:00
borg-0300	9b94b374cc	Bugfix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1903 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-16 23:16:01 +00:00
orbiter	60995a3a67	changed behaviour of "search again" appearance ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1902 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-16 23:07:59 +00:00
orbiter	3881f9ccde	fixed total number in network list ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1894 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-15 22:40:30 +00:00
orbiter	a6a3f4b694	fix for svn 1888 ... this is a redesign of the no-iterator solution git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1892 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-15 16:01:42 +00:00