87 Commits

Author	SHA1	Message	Date
orbiter	a45216b479	fix to prevent bad-formed news messages ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3960 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-07-13 09:41:55 +00:00
orbiter	6518bb6c08	changed release strategy: ... we will provide two different releases in the future, one standard release and one 'pro'-release. the 'pro'-release contains all additional parsers AND has different default performance values. The pro-version differs therefore from the previous 'all'-version by this default values. The pro-configuration is automatically choosen if the libx-folder exists. If a version is once initialized, its configuration stays independently from an existing libx folder. The ant targets had been changed. There are now 3 different targets to create standard and pro-releases, and one target to upgrade: - dist: creates a standard release (only, no libx target any more) - distPro: creates a pro-release (includes the libx) - distExt: creates a libx-release which includes the libx-folder only. It may be used to upgrade from standard to pro Furthermore, the naming of 'dev'-releases had been removed. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3902 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-06-16 14:11:52 +00:00
karlchenofhell	71ca9aa6d4	- fix for changed blacklist types ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3857 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-06-11 09:56:16 +00:00
theli	99062c0c9e	*) SOAP should support authentication against the user-DB now (requested by KoH) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3846 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-06-09 15:49:04 +00:00
(no author)	f89517203d	*) SOAP: new function to get the Performance Settings of Queues and Processes ... No items left in the yadmin SOAP-TODO :-) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3776 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-05-31 15:47:58 +00:00
(no author)	92351c4dcb	*) SOAP: bookmarks list now indicates if a bookmark is private (requested by KoH) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3775 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-05-31 14:54:56 +00:00
(no author)	e0e46d3aec	*) SOAP: new function doGarbageCollection (requested by KoH) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3773 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-05-31 14:32:41 +00:00
(no author)	1efe607c34	git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3771 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-05-31 11:24:59 +00:00
theli	651b05ba43	*) wsdl file updated (requested by KoH) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3758 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-05-24 16:07:58 +00:00
orbiter	33ad0c8246	added a web structure computation and logging: ... - all web page parsing operations will now increase a web structure file - the file is computed in memory and dumped at shutdown-time to PLASMASB/webStructure.map in readable form (not a database) - the file can be used externally to analyse the link structure of the crawled pages - the web structure can also be retrieved using a xml-interface at http://localhost:8080/xml/webstructure.xml - the short-term purpose is the computation of a link-graph image (before linuxtag!) - a long-term purpose could be a decentralized computation of the citation rank git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3746 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-05-22 08:13:48 +00:00
karlchenofhell	601fc7d1c5	- added source to J7Zip-modifed.jar and it's license (changelog is still to come) ... - moved HTML-*replace-methods from wikiCode to de.anomic.data.htmlTools - prepared use of different wiki parsers as suggested here: http://www.yacy-forum.de/viewtopic.php?p=34444#34444 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3741 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-05-20 13:29:12 +00:00
orbiter	b33cef421e	better routing for public clusters ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3620 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-04-29 00:08:38 +00:00
theli	ec225f9ab6	*) SOAP: adding methods to get the comment and MD5 checksum of a single file ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3604 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-04-27 05:10:31 +00:00
orbiter	f8de19fb2f	robinson cluster: added client-side protocol implementation ... - the network configuration page shows a new option: robinson clusters - when a global search is made, all robinson peers are excluded, but: - robinson peers/clusters that provide peer tags and where search words match such tags, they are included in global search. Therefore, robinson peers/clusters support the global yacy network with their indexes, without doin DHT-exchange git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3598 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-04-26 09:51:51 +00:00
theli	50e1e61fa5	*) SOAP: adding functions to rename and move files ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3595 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-04-25 05:36:28 +00:00
orbiter	ca79362b9d	disabling auto-setting of remote crawl performance ... see also http://www.yacy-forum.de/viewtopic.php?t=3849 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3577 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-04-18 18:36:06 +00:00
theli	def0d6124e	*) trying to solve SecurityManager problem during init of soap engine ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3534 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-03-31 16:01:52 +00:00
theli	75eb65028a	*) adding a test if a seucrity manager is active ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3533 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-03-31 14:30:09 +00:00
theli	1b7fda12ee	*) SOAP: separate function to get the active/passive/potential peer list ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3526 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-03-28 07:34:44 +00:00
theli	f20b596dc0	*) adding servlet to display all deployed SOAP Services ... - soap related servlets are located in htroot/soap *) new serverContext class for soap git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3511 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-03-22 08:30:57 +00:00
theli	589cbd8cbf	*) replacing all yacy-news-category strings with corresponding constants ... Note: please use these constants from now on git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3495 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-03-21 11:09:15 +00:00
theli	c72605ecab	*) adding a function to determine if a given URL is bookmarkt ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3428 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-03-03 11:57:49 +00:00
karlchenofhell	6fbe31425a	- some code-cleanup (no more syntax-warnings here) ... - added deletion from loadedURLs of URLs to be blacklisted in IndexControl_p git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3404 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-02-26 12:56:50 +00:00
karlchenofhell	26f5757b40	- added support for multiple paths per domain to default-blacklist ... warning: an interface-change had been neccessary: - remove(String, String) has been renamed to removeAll(String, String), because it removes all path-entries for the specified host - remove(String, String, String) has been added to delete only a path-entry - geBlacklistType(String) has been renamed to getBlacklistType(String) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3391 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-02-24 13:56:32 +00:00
orbiter	d25caa07bf	redesigned some parts of http authentication ... added another access check for peer hops git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3340 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-02-05 19:46:50 +00:00
allo	14f2068daf	some more bookmark changes towards multiuser bookmarks ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3291 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-01-28 17:38:43 +00:00
theli	49972b6193	*) SOAP: getPeerHash returns the proper value now ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3273 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-01-23 09:47:13 +00:00
allo	0c81bd39d4	XSS-safe put as default. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3217 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-01-16 14:07:54 +00:00
theli	a9f1d3a065	*) SOAP: adding function to get the local peer hash ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3117 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-12-22 11:31:48 +00:00
orbiter	61798f0ae6	added option to distinguish between text crawl and media crawl ... - for each crawl start, there is now a flag for text and media - the localCrawl flag is superfluous - added new crawl profiles - if an image search is done, only media links are crawled for the snippets git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3100 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-12-19 03:10:46 +00:00
allo	782db9099d	version independent name for commons-pool lib ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3082 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-12-15 07:12:33 +00:00
orbiter	052f28312a	removed assortments from indexing data structures ... removed options to switch on assortments git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3041 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-12-02 19:34:59 +00:00
theli	eb20ec3837	*) soap-service: adding function to check if a specific url is blacklisted ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3014 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-26 08:53:43 +00:00
theli	58d79a9ac1	*) more error logging ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2974 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-19 13:28:09 +00:00
theli	73552db482	*) bugfix adding missing lib names to copy and zip commands ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2971 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-18 16:52:17 +00:00
theli	5c0669429e	*) soap: adding function to query the peer list ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2968 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-17 19:26:55 +00:00
theli	9ea9a9f157	*) bugfix for bookmark service: get didn't work when using date=null ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2963 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-16 16:20:00 +00:00
theli	203f2bde9a	*) adding function to query the pause/resume state of the crawling queues ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2958 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-13 06:25:15 +00:00
orbiter	497428c8ec	refactoring ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2949 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-10 01:13:33 +00:00
theli	4147c9f490	*) better error logging on soap engine initialization ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2946 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-09 17:20:34 +00:00
theli	892b9f2fc4	*) additional soap function to query peer status ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2920 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-05 16:46:32 +00:00
theli	bd3710a974	*) new xml template to view peer profile as xml ... *) bugfix for wrong profile display (some fields where displayed twice) *) new soap functions to get and set peer profile git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2919 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-05 16:26:25 +00:00
theli	d1afe1ce6b	*) adding xml template to get the message list as xml ... *) Bugfix in client stub jar generation (too many files where added) *) new soap service to manage peer messages git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2918 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-05 15:18:33 +00:00
theli	f37e2041e8	*) adding soap function to import yacy bookmarks from xml or html (transfered via soap attachments) ... *) soapHandler: code cleanup for service deployment git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2915 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-05 09:56:39 +00:00
theli	4a3ec63e34	*) new soap service to manage yacy bookmarks ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2906 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-04 13:47:43 +00:00
(no author)	9b3fd2b9e5	*) removing doctype definition to avoid problems with xml parser ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2905 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-03 19:48:33 +00:00
(no author)	c64d5018b4	*) Bugfix. Problem in XML Parser ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2903 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-03 19:34:31 +00:00
theli	5e57e0814d	*) new soap function to display log ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2902 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-11-03 14:39:48 +00:00
theli	c7bea4addb	*) soap api ... - adding function to get and set message forwarding - adding new testclass git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2878 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-29 08:40:48 +00:00
theli	ee4d4e8567	*) Soap-handler: bugfix. wrong content-length was send when using content-encoding ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2877 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-10-29 08:39:48 +00:00