4409 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
danielr	48ffd61e6a	changed "patched wrong" to warning, so it goes to the logfile ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4716 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-19 07:54:44 +00:00
orbiter	2f629d20a7	- tried to fix the '4217666-problem' ... - removed more unused code git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4715 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-19 04:24:29 +00:00
orbiter	512f48e7d6	- removed unused methods ... - fixed xss attack on peer list in CrawlStartSimple git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4714 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-19 03:33:07 +00:00
orbiter	14384e7a45	deactivated unnecessary and very CPU-intensive deletion check for blacklisted URLs in index receive ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4713 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-19 03:02:44 +00:00
f1ori	701f769c66	* removed comma, which caused invalid xml ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4711 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-18 15:07:36 +00:00
orbiter	3c76342619	- added servlet to configure the search page greeting line ... - added information output about the current network definition in the network servlet - better description and usage of profile entries in User Profile servlet regarding FOAF format - reformatting of menues at status page git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4710 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-18 13:58:56 +00:00
f1ori	b9602e891a	* added CrawlProfileEditor_p.xml for monitoring in yacybar ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4708 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-18 09:13:02 +00:00
orbiter	d03940f2ec	- included patch from http://forum.yacy-websuche.de/viewtopic.php?p=7193#p7193 ... - fixed problem with crawl profile editor after deletion of a crawl profile git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4706 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-17 22:21:03 +00:00
danielr	d1ee231866	HTTPC close more unused connections ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4702 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-15 16:37:51 +00:00
danielr	181796cffb	- HTTPC ConnectionInfo entfernen bei Exceptions, unnötigen Code entfernt ... - FTPC (GET-)connections bei Fehlern auf jeden Fall schliessen git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4701 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-15 15:27:32 +00:00
orbiter	04c1226c80	added/fixed missing integrity-test else-case during deploy in case that we update with a tar file ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4700 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-15 15:20:35 +00:00
orbiter	6155f0e634	last small changes until main release ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4699 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-14 07:26:33 +00:00
orbiter	45ae3da7e7	another patch to prevent NPE in EcoTable ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4698 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-14 05:33:32 +00:00
orbiter	cb93ded5c6	applied configuration path patch ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4697 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-14 04:10:51 +00:00
danielr	96e39b297a	reduced StackTraces (by connect timed out) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4696 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-14 03:50:49 +00:00
orbiter	93376acdca	fixed a bad chunkcache limit check which could have caused ArrayIndexOutOfBoundsExceptions ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4695 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-14 03:49:02 +00:00
orbiter	1cab240198	patch for possible NPE in EcoTable iterator ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4694 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-14 03:20:37 +00:00
orbiter	9a32a4c328	fixed concurrentModificationException during hello-process ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4693 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-14 03:04:28 +00:00
danielr	64c33e717f	catched ConcurrentModificationException in ConnectionInfo.cleanUp so cleanUp is not interrupted ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4692 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-14 03:02:44 +00:00
daburna	70826bb501	-small update for de.lng ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4691 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-14 01:14:44 +00:00
danielr	d8677ba611	fixed ConcurrentModificationException in HttpConnectionInfos ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4690 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-13 11:25:41 +00:00
orbiter	c7021c14bb	patch for ArrayIndexOutOfBoundsException in BMP parser ... (may occur in case of malformed BMPs) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4689 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-13 03:28:26 +00:00
orbiter	8dd35f74c8	fixed redirect problem (does not work for POST) ... see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1068&hilit= git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4687 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-12 16:35:09 +00:00
orbiter	8313d58ae7	- integrated the collage into the Web Visualization menu ... - added a counter for the public and private queue on the page (testing..) - fixed wrong public/private categorization git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4686 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-12 15:45:57 +00:00
danielr	c5d1d7faca	undo wrong commited files ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4685 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-12 15:22:57 +00:00
danielr	2617f4dcdb	Connections_p.html: better formatting and remove very old entries ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4684 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-12 15:19:18 +00:00
orbiter	82bf9ac1c8	- added Collage servlet from datengrab and modified it: ... * all images are queued * private/public is respected * inserted into switchboard * added collageQueue class that stores all the queued images git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4683 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-12 13:24:21 +00:00
danielr	959f448e5f	- disabled redirects in proxy (so client sees real path) ... - added connection stats (only connections currently in use) - remove "old" connections (closed or idle for some time) - synchronized shared parts of proxyHandler git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4682 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-12 11:39:48 +00:00
orbiter	8fe39ebd74	-fixed file transmission with POST. The only usage was in ranking transmission, therefore: ... -fixed ranking transmission git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4681 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-12 08:12:51 +00:00
orbiter	82a9861779	fix for last commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4680 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-11 12:55:43 +00:00
orbiter	5d1fbb25e7	fix for bad deploy: ... - the name of downloaded release files is adopted if the httpc delivers uncompressed tar.gz files (the .gz is removed from the file name) - the deploy method is able to handle tar-file (not tar.gz-files) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4679 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-11 12:37:17 +00:00
orbiter	202a3adb3e	refactoring of HttpClient Writer processes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4678 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-10 22:47:05 +00:00
danielr	8aa9fd8f24	HTTPC with only 1 retry ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4677 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-10 16:47:57 +00:00
orbiter	444dce7e81	more performance hacks ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4676 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-10 15:28:58 +00:00
orbiter	2c2dcd12a2	- enhanced performance of Eco-Tables: less time-consuming size() - operations ... - will increase speed of indexing and collection.index creation git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4675 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-10 13:24:55 +00:00
orbiter	e356625b22	- refacotring of stream copy handling to support time-consuming operations ... - made usage of BufferedStreams explizit to distinct different copy method in serverFileUtils (byte-by-byte and using an own buffer) - introduced another timeout setting (java internal property) - more restrictions to clients accessing a single host (a security setting to prevent DoS by mistake) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4674 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-10 09:53:07 +00:00
danielr	f01c50cf8d	Proxy logging error (first step to resolution!?) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4673 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-10 06:56:06 +00:00
orbiter	c3342e1178	- removed class with only one static method ... - removed connection method with too long time-out git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4672 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-09 23:35:20 +00:00
orbiter	f97971b63b	fixed NPE problems doing a shutdown from command-line ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4671 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-09 22:59:17 +00:00
danielr	7a35126e91	http timeouts von alten httpc wieder gesetzt ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4670 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-09 11:02:14 +00:00
orbiter	2c1c3bb6eb	- some refactoring (sorry Daniel, hab in deinem Code rumgewütet) ... - fixed broken downloads (flush was missing) - different problem handling when download is corrupted - different default values in yacy.init git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4669 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-08 21:36:33 +00:00
danielr	d96e2badc7	- fixed POST in proxy ... - prepared http connection tracking - refactoring (mainly moving StreamTools to serverFileUtils) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4668 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-08 21:17:40 +00:00
orbiter	14404d31a8	- enhanced performance graph (more info) ... - added conditions for rarely used logging lines to prevent unnecessary CPU usage for non-printed info git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4667 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-08 14:44:39 +00:00
orbiter	696b8ee3f5	fix for http://forum.yacy-websuche.de/viewtopic.php?p=6806#p6806 ... - removed all InputStream.available() because this does not work for files > 2GB - iterator terminate when a IOException occurs - added handling of non-executing index.add methods to enhance assert usage - added index for file indexes > 2GB, to be used in new indexHeap git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4666 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-08 11:55:59 +00:00
danielr	94d3d3a86f	fixed Proxy (for GET, POST still does not work!) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4665 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-08 09:34:20 +00:00
danielr	081ed1d3ec	HTTPLoader: reduced stackTraces ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4664 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-07 16:56:15 +00:00
danielr	8b2efb6f8c	fixed garbage in HTCACHE ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4663 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-07 16:46:45 +00:00
orbiter	225f9fd429	various fixes ... - shutdown behavior (killing of client sessions) - EcoFS reading better - another synchronization in balancer.size() git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4662 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-07 13:12:58 +00:00
orbiter	6e36c156e8	added more logging to EcoFS ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4661 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-07 09:52:25 +00:00
danielr	fb541f9162	HTTPC: default timeout half-hour ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4660 6c8d7289-2bf4-0310-a012-ef5d649a1542	2008-04-07 09:48:49 +00:00