414 Commits

Author	SHA1	Message	Date
orbiter	ba0a486328	moved printStackTrace() to logging ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@539 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-14 23:35:18 +00:00
orbiter	3094045d34	fix for http://www.yacy-forum.de/viewtopic.php?p=7454#7454 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@536 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-14 16:16:11 +00:00
orbiter	8d6c288f04	display of peer name in headline; see http://www.yacy-forum.de/viewtopic.php?p=7466#7466 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@535 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-14 15:45:48 +00:00
orbiter	cd10370992	several bugfixes and dht selection / logging improvement ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@531 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-14 00:57:30 +00:00
orbiter	3610fe6b3a	see http://www.yacy-forum.de/viewtopic.php?p=7410#7410 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@530 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-13 22:04:18 +00:00
orbiter	c8a7a85ce2	fix for http://www.yacy-forum.de/viewtopic.php?p=7384#7384 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@529 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-13 21:41:22 +00:00
orbiter	98b028038c	bugfix, see http://www.yacy-forum.de/viewtopic.php?p=7370#7370 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@527 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-12 23:30:42 +00:00
orbiter	6594541ef5	fix for http://www.yacy-forum.de/viewtopic.php?p=7361#7361 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@526 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-12 22:53:49 +00:00
orbiter	7db543a9fa	fixes for several dht misbehaviours ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@524 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-12 22:14:24 +00:00
rramthun	20002b6386	Added Regex tutorial to Help.html, because many people don't understand Regex. ... Added german translation for Regex tutorial. Added bold and underline to bbCode. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@522 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-12 20:16:38 +00:00
orbiter	5716f8521d	bug fixes for word ordering and dht index selection ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@521 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-12 14:06:47 +00:00
orbiter	f5259f29e8	word cache behaviour fix and other fixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@519 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-11 23:33:19 +00:00
orbiter	c796a38424	doc update ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@515 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-11 00:30:43 +00:00
jerri	fa154e6ce5	Added some more javadoc into httpc.java. Moved the inner class response to the ... end of the class definition, as this eases the reading of the outer class. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@514 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-10 21:50:17 +00:00
allo	5d511d651e	fix for Windows ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@513 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-10 17:11:37 +00:00
orbiter	2c234e1b82	better log output for search result ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@512 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-10 09:52:50 +00:00
theli	89c9faa89e	*) More graceful logging output in crawler ... See: http://www.yacy-forum.de/viewtopic.php?t=894 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@511 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-10 06:15:47 +00:00
orbiter	248c24b60a	intermission-feature usage in case of local and remote search ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@510 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-09 20:43:37 +00:00
orbiter	6be19d76c9	preparation for intermission feature (pausing all threads, i.e. for search requests) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@509 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-09 18:33:13 +00:00
allo	ee0a9a2d9b	recursive Translations. ... You can now translate the Menu and other things in subfolders, too git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@508 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-09 14:27:18 +00:00
theli	b32e7c516c	git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@507 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-09 09:07:19 +00:00
orbiter	ec07928807	faster listing and news aging enhancement ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@505 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-08 18:05:43 +00:00
allo	53dcbadfbf	using Wikicode instream of bbCode ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@504 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-07 17:56:44 +00:00
jerri	09193023fe	Began with some documentation for the httpc-class. The code of the httpc-class ... looks very disordered? Inner classes and methods mixed together. Maybe the code should be cleaned up a little bit? git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@503 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-07 16:27:38 +00:00
jerri	7792e5ae9b	Added an build-target to the ant-configuration to create the ... yacy-javadoc-documentation in doc/api. Just do ant create-doc and point your favourite browser to doc/api/index.html. As most of the classes are not documented right now this just gives a great overview of all classes. Hopefully this helps stimulating the creation of javadoc-insource-documentation. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@502 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-07 15:16:33 +00:00
rramthun	1eadbc6b91	Modified build.xml to include Win9x scripts ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@501 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-07 09:26:23 +00:00
allo	8659a689f4	seperate Class for the wikiParser ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@500 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-06 17:03:12 +00:00
allo	7665712faa	fix for altenativeTemplates by Index ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@499 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-06 16:12:40 +00:00
allo	3762acde6e	alternatives By Name ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@498 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-06 15:57:31 +00:00
theli	86305f051d	*) Trying to solve "java.net.BindException: Address already in use: JVM_Bind" Problem ... by retrying Socket bind See: http://www.yacy-forum.de/viewtopic.php?p=6935 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@497 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-06 14:38:58 +00:00
theli	865b9490a2	*) Making DHT Transfer while Crawling configurable ... See: http://www.yacy-forum.de/viewtopic.php?p=6904 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@496 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-06 11:40:12 +00:00
theli	1d83d7e4d7	*) httpdFileHandler.java: ... no stacktrace will be printed into log file for "Connection timed out" Errors now See: http://www.yacy-forum.de/viewtopic.php?p=6381 *) plasmaCrawlWorker.java: If a "Read timed out" error occurs while crawling a site, the failed crawl will be retried. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@493 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-04 11:05:04 +00:00
theli	e6aced0162	*) Setting higher priority for session threads ... See: http://www.yacy-forum.de/viewtopic.php?p=6120#6120 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@490 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-03 17:48:11 +00:00
orbiter	2dd2533e6d	cut for 0.394 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@489 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-03 14:28:28 +00:00
orbiter	2d8557cb10	minor changes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@487 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-03 02:02:39 +00:00
orbiter	91163db52e	fix for more time-related problems in proxy ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@486 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-03 00:52:32 +00:00
orbiter	fb6f238d70	fix for expires-problem ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@485 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-03 00:28:12 +00:00
rramthun	eacff63eda	Typos... ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@482 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-02 16:09:19 +00:00
orbiter	40da910f41	bugfixes and automatic news-cleanup ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@481 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-02 16:03:35 +00:00
theli	228b04b499	*) Bugfix for "wrong seed-upload timestamp" problem ... http://www.yacy-forum.de/viewtopic.php?t=817 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@480 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-02 15:36:10 +00:00
theli	470839a16a	*) Crawler/Session pool settings will now be stored properly into configfile ... Bugfix for: - http://www.yacy-forum.de/viewtopic.php?t=502 - http://www.yacy-forum.de/viewtopic.php?t=778 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@477 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-02 12:20:03 +00:00
orbiter	4377e119f3	bugfix for http://www.yacy-forum.de/viewtopic.php?p=6620#6620 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@476 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-02 10:41:59 +00:00
orbiter	e84a177c49	many bigfixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@475 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-02 02:18:01 +00:00
orbiter	9ee8a5ba6c	fixed big in yacynews ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@474 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-02 00:50:20 +00:00
orbiter	7e3e9ba0de	fix for http://www.yacy-forum.de/viewtopic.php?p=6563#6563 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@472 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-01 20:36:27 +00:00
orbiter	bcc292ad12	added self-news; added news in case of wiki update; added crawl announcement on Network page ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@469 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-01 12:47:47 +00:00
orbiter	cc38c5e77b	bugfix for wiki key-length ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@468 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-01 10:56:40 +00:00
orbiter	d34eb23e4e	fixed news; added news appearance on Network and IndexCreate page; added intention string to global crawl ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@466 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-08-01 01:12:02 +00:00
orbiter	5672709ef3	several bugfixes for YaCyNews ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@465 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-31 14:59:31 +00:00
allo	2013d031e5	better Logging ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@464 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-31 12:07:34 +00:00
orbiter	e24dbde217	better logging for WRONG seed ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@463 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-31 11:11:29 +00:00
orbiter	1022fbeb65	many YaCyNews fixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@461 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-31 01:54:46 +00:00
orbiter	13abd8b6e7	added news-creation at crawl start ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@460 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-30 11:57:19 +00:00
rramthun	f555b9d5f2	Translation, spelling... ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@459 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-30 11:11:32 +00:00
orbiter	849b194149	fixed news receipt and added processing buttons on News page ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@458 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-30 07:15:39 +00:00
orbiter	84b74d40f3	yacyNews bugfix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@457 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-29 15:29:06 +00:00
orbiter	60117a2073	integrated YaCyNews basis ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@455 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-29 14:10:19 +00:00
orbiter	b8e294f149	corrected wrong default peer-names ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@454 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-29 08:48:36 +00:00
orbiter	cdbbfd50fb	fixed bad remote crawl behavior ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@453 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-29 06:50:36 +00:00
orbiter	f32d8bdfa8	fixed DHT cache memory assignment ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@452 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-28 18:22:02 +00:00
orbiter	f663f26cfd	catch of another IOException ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@451 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-28 17:03:13 +00:00
orbiter	36707586c7	filtering of jsessionid ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@447 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-27 23:20:17 +00:00
rramthun	6f2f54a312	Translation, spelling... ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@444 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-27 20:29:35 +00:00
allo	0a68aa6999	translate the last file, too ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@443 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-27 19:03:52 +00:00
orbiter	81e564edb8	faster crawl profile list cleanup ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@442 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-27 14:16:47 +00:00
orbiter	85877413a0	tried to fix principal bug .. not succeeded ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@440 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-27 13:38:46 +00:00
orbiter	ad90f0ad13	activated RWI distribution to DHT for senior peers (default redundancy 3), necessary now for network growth ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@438 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-27 12:51:00 +00:00
orbiter	b9d18d40cb	configuration of proxy idle time in performance menue ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@436 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-26 15:17:29 +00:00
orbiter	3470a72d48	fixed div by zero, set default delays, fixed release number format and display ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@435 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-26 11:47:50 +00:00
rramthun	bf7d5d1310	Usage of logging-class ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@432 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-25 14:46:36 +00:00
orbiter	af67c633d5	doc-changes and more strict brute-force handling ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@431 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-25 09:56:54 +00:00
rramthun	fe62a38896	minor fixes to the translation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@429 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-24 15:32:27 +00:00
orbiter	be1f324fca	performance setting for remote indexing configuration and latest changes for 0.39 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@424 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-22 13:56:19 +00:00
rramthun	69afae514d	Updated translations... ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@422 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-21 15:42:06 +00:00
orbiter	c64970fa47	re-implemented proxy-busy-check and fixed some other things ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@421 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-21 11:17:04 +00:00
allo	98d22a73ef	"File: foo.html" ... and "File:bar.html" support git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@420 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-20 21:23:21 +00:00
orbiter	86d778f7bc	default-button in profile menue ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@419 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-20 17:08:58 +00:00
orbiter	b73557ed2d	better assortment monitoring and enhanced profile menue ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@416 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-20 13:03:41 +00:00
orbiter	1f36bf4dae	enhanced assortment capacity; added extended WORDS migration ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@412 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-20 00:39:06 +00:00
allo	e6c381a2e2	Translationfile Division for different files ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@411 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-19 21:19:12 +00:00
rramthun	0f11399d16	Some corrections... ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@409 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-19 16:07:13 +00:00
orbiter	9f505af7aa	preparations for bulk remote crawls ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@408 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-19 00:26:31 +00:00
orbiter	0f663bcebf	added global ppm computation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@407 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-18 15:22:14 +00:00
orbiter	9c72b4cdec	replaced index dump stack by an dump array and limited url number in assortment ram (prevents too much RAM occupation) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@406 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-18 13:32:44 +00:00
orbiter	51962d55bf	added 'PPM', page-per-minute statistics ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@405 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-18 00:44:51 +00:00
orbiter	159f795f65	bugfix (null pointer exception in assortments) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@404 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-17 22:25:50 +00:00
orbiter	1d2155675b	changed assortment memory cache flush ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@403 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-17 21:22:18 +00:00
orbiter	19dbed7cc8	code clean-up ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@401 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-12 15:09:35 +00:00
orbiter	00f63ea00d	fail-save patch for pattern matching ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@400 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-12 00:31:35 +00:00
orbiter	0a6be961ea	added pattern organization ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@399 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-12 00:21:46 +00:00
orbiter	40036ba69c	fixed dht transmission; added url-blacklist blocking also for remote search ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@398 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-12 00:07:09 +00:00
orbiter	311e627363	blocking of blacklisted urls in indexReceive and small changes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@397 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-11 15:36:10 +00:00
orbiter	2f0d7ea8d3	removed htcache stati (superfluous now) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@396 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-09 00:33:34 +00:00
orbiter	277048501e	bugfix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@395 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-08 16:24:07 +00:00
orbiter	8b89c46afe	fixed problem with cache write ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@394 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-08 16:06:35 +00:00
orbiter	455ae9f55f	fixed htcache-store problem and due-time for remote crawls ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@393 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-08 15:17:50 +00:00
theli	55d10b864c	*) further improvements in shutdown behaviour ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@392 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-07 22:03:52 +00:00
theli	96386d6fc6	*) further improvements in shutdown behaviour ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@391 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-07 21:44:31 +00:00
theli	0b95c9c434	*) Bugfix for Thread.getID() usagage + PeerPing-Shutdown Deadlock ... See: - http://www.yacy-forum.de/viewtopic.php?p=4937 - http://www.yacy-forum.de/viewtopic.php?p=4939 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@390 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-07 21:00:11 +00:00
theli	13eeaa08f3	*) httpc.java: ... - Now it's possible to interrupt pending httpc-actions on server shutdown - this is possible because of a newly introduced registration mechanism for open sockets *) yacyCore.java - blocking peerPing threads can now be interrupted on server shutdown *) serverCore.java - restructuring shutdown code *) error.html - port number is now set correctly if port forwarding was enabled git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@389 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-07 13:58:54 +00:00
theli	f57b60cd60	*) Correcting Problems with htmlFilterContentScraper.java ... Tag name comparison was case sensitive, therefore e.g. <A href="test.txt>test</A> was not parsed correctly. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@387 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-07 13:32:49 +00:00
orbiter	b79070b471	fixed proxy/scraper ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@385 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-07 13:25:41 +00:00
orbiter	419f8fb398	fixed bugs/missing code regarding new crawl stack ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@384 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-07 01:38:49 +00:00
orbiter	112c5d3332	the new file-based indexing queue ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@382 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-06 14:50:01 +00:00
orbiter	858cd94299	replaced indexing ram-queue by file-based stack-queue ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@381 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-06 14:48:41 +00:00
allo	a31029c5de	== as separator ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@374 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-04 17:40:44 +00:00
allo	9f0f45bcae	Warning: this is untested. ... I will need this for recursive Translation, and check it while extending the Translator. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@373 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-04 15:53:45 +00:00
theli	57c30f1d78	*) bugfix for usage of httpc without gzip content encoding ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@369 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-04 11:25:25 +00:00
theli	0e2c33ee55	*) Network.html/Network.java: ... - Adding function to manually force peer ping to remote yacy peer See:Network.html?page=4 - for debugging purpose only! *) serverAbstractThread.java: - Adding posibility to notify a server thread via a synchronization object - this is needed e.g. by the port forwarding feature to send a notification to the peerPing thread to redo peer-ping with the new ip/port Settings_p.html *) Port Forwarding Feature (it should work now) - adding a serverThread which is responsible to detect broken port forwarding connections and to do reconnect if needed - serverCore.java: moving port forwarding initialization into a separate function - adding positility to configure the ssh port - moving configuration section on the gui into a separate fieldset - hello.java: only trying to do a second connect to the clientIp address during peer handshake if either remote port forwarding is not enabled locally or the clientIP is not equal to any local ip *) httpdFileHandler.java: - printout a more verbose errormessage *) httpc.java - allowing to deactivate content encoding from outside *) plasmaCrawlWorker.java - the crawler worker now tries to refetch the content of a website without gzip content encoding if a gzip error occured git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@368 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-04 11:09:48 +00:00
orbiter	5159a090b0	fixed parser bug with lowercase force (appeared in: http://spellbound.sourceforge.net/) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@367 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-03 23:33:25 +00:00
orbiter	7f7cbc5019	fixed bug with snippets ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@365 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-03 13:37:20 +00:00
orbiter	3607159a9a	fixed connection of out-dated peers ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@364 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-03 13:08:49 +00:00
orbiter	fbef7fed81	adopted latestVersion to float handling ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@363 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-03 12:40:36 +00:00
orbiter	eb74fa0c82	fixed a bug with snippet-length ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@359 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-07-01 23:35:36 +00:00
orbiter	ec8a5ad060	fixed base implementation (verified with www.burningboard.net/archive/index.html) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@356 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-30 23:49:32 +00:00
orbiter	1d3cfb380a	experimental implementation of base parsing in html parser ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@355 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-30 23:28:35 +00:00
orbiter	86f2aa8478	fixed seed-load date bug (evaluating server date for age computation) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@354 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-30 23:19:08 +00:00
orbiter	664bceced5	removed debug-lines ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@351 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-30 18:56:01 +00:00
orbiter	75ebdbc852	enhanced snippet-generation (case where snippet is too long) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@350 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-30 18:54:00 +00:00
allo	bef3aaec38	better Translationsystem. ... You only need to escape Chars, which have special meanings in regexps. some you have to escape: ()[]{} git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@348 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-30 15:28:40 +00:00
orbiter	8a4f297324	fixed/enhanced snippet error-handling; suppression of results where no snippet exists ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@347 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-30 00:01:53 +00:00
orbiter	712fe9ef18	bugfixed utf-8 decoding and parser ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@346 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-29 22:55:37 +00:00
allo	82d78fdab7	new Implementation and basic bbCode(Ok, opnly one Command ...) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@343 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-29 21:01:12 +00:00
allo	a60f5efcd6	rename ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@342 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-29 20:59:56 +00:00
theli	6e97f70549	*) httpd.java: improved errorhandling ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@333 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-29 10:05:38 +00:00
theli	9d8c66fb5e	*) adding possibility to forward received yacy-messages (htroot/yacy/message.java) ... via a command-line email program (e.g. sendmail) to a configured email address - the configuration dialog is reachable via Settings_p.html#messageForwarding git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@332 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-29 09:50:48 +00:00
theli	08e4334c1d	*) Status.java: showing amount of time since last upload of seed-file ... *) hello.java: adding additional output for principal-downgrade bug *) httpd.java, httpdFileHandler.java, httpdProxyHandler.java: improved errorhandling *) yacyCore.java: trying to fix principal-downgrade bug *) yacySeed.java: adding some constants git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@329 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-28 11:27:31 +00:00
theli	eee6322aaf	*) Adding redirection support to plasmaCrawlWorker.java ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@328 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-28 08:07:41 +00:00
theli	cd279907c0	*) Adding redirection support to plasmaCrawlWorker.java ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@327 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-28 08:01:26 +00:00
theli	6697d5e52e	*) correcting fkt. mediaExtContains ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@326 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-28 06:44:31 +00:00
low012	a333715ffd	This changes eliminate a way to cripple Message pages on other peers by sending special messages with HTML tags. (See forum for details.) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@325 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-27 19:52:40 +00:00
orbiter	abba8fe61b	fixed utf-8 decoding in htmlFilterAbstractScraper and removed httpd timing ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@323 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-26 22:40:50 +00:00
orbiter	3addf58046	enhanced snippet-loading with threads ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@322 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-24 07:41:07 +00:00
orbiter	4afcf10158	added kelondroHashtable (not finished yet) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@321 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-23 14:41:59 +00:00
orbiter	56d28a16f0	bugfixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@320 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-23 14:40:39 +00:00
orbiter	d6c85228a6	enhanced snippet computation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@319 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-23 12:12:12 +00:00
theli	d53b2393e5	*) autoconfig.java: ip address was not reported correctly when port-forwardin is on ... *) hello.java: reportedip my be empty at peer startup *) httpc.java: adding method to determine if the connection was already closed or is broken *) httpdProxyHandler.java: trying to do a better errorhandling *) server/serverCore.java - setting myseed ip-address and port correctly if port-forwarding is on - doing a more failsafe close and adding some debugging output *) yacyClient.java: adding some logging statements to allow a better detection of "degraded to senior"-bug *) yacyCore.java: restructuring publishMySeed (@Orbiter: pleas take a look) - to avoid buzy waiting - to allow a gracefull shutdown on server shutdown - new seed count was not calculated correctly in the previous version *) yacySeedDB.java: host ip and port was not initialized correctly if port-forwarding was activated git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@318 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-23 11:00:26 +00:00
theli	fafda068f9	*) allowing crawler to process resources with statuscode 203 ... - this is needed if yacy is behind a second proxy git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@316 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-23 10:00:31 +00:00
theli	aae9a433a6	*) correcting usage of supportedFileExt-List ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@315 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-23 07:43:59 +00:00
orbiter	1e7f062350	many bugfixes, memory leak fixes, performance enhancements; new kelondroHashtable; activated snippets ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@313 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-23 02:07:45 +00:00
orbiter	68dc2b0c6b	added kelondroArray, the basis for upcoming kelondroHash and some bug fixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@311 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-21 01:17:25 +00:00
orbiter	5728cdf8b5	bugfix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@308 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-20 16:53:22 +00:00
orbiter	a19541e563	code-enhancements after analysis with AppPerfect ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@307 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-20 16:36:31 +00:00
theli	0e48177ad8	*) Bugfix of NullPointerException when sending Error Respond ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@305 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-20 15:57:03 +00:00
theli	bf78e0a6a4	*) Bugfix of Socket closed Exception ... See: http://www.yacy-forum.de/viewtopic.php?p=4437 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@304 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-20 13:33:23 +00:00
orbiter	85075269a6	extended fail-safe memory-managament. prevents too much allocation, too often GC and should help for the 100%CPU-bug ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@303 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-20 00:46:23 +00:00
orbiter	e3c92818db	avoiding OutOfMemoryError routines ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@302 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-19 13:37:17 +00:00
orbiter	3e8ee5a46d	enhanced caching in kelondroRecords and added better synchronization/finalizer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@301 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-19 05:27:42 +00:00
orbiter	3be98f194d	tried to find the socket bug ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@300 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-18 01:48:11 +00:00
theli	dff937a9a3	*) Adding some logging statements to detect problems with seed upload functionality ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@297 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-06-17 08:38:22 +00:00