Commit Graph

878 Commits

Author SHA1 Message Date
borg-0300
6d1de8abfd finals; cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@756 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-20 15:43:31 +00:00
borg-0300
e748ba3f6e super(), finals;
other; cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@755 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-20 15:36:22 +00:00
orbiter
af9021e956 fixed bug with news caching
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@754 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-20 11:30:03 +00:00
orbiter
14bc880fa4 fixed bug with crashed profile database
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@753 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-20 11:20:29 +00:00
orbiter
71a31f0902 integrated and extended new memory performance menu; found and fixed bug in DHT caching
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@752 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-20 10:54:20 +00:00
orbiter
fb52a82008 added new performance page for memory settings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@751 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-20 10:10:34 +00:00
low012
0f1bbff459 *) Tiny little job of cleaning up. (Was man nicht im Kopf hat, hat man in den Fingern...)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@750 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-19 20:42:53 +00:00
low012
4dbc871524 *) Trying to get rid of possibility of exploits in IndexCreate* through HTML and JavaSkript in peernames, URLs, <title>-tags etc. (see http://www.yacy-forum.de/viewtopic.php?t=1181) I hope I got them all and did not overdo it.
*) Just a tiny bit of cleanig up in News.java. (I messed it up myself some time ago.)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@749 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-19 20:36:29 +00:00
rramthun
9dfbd93c7b Updated german language file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@748 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-19 15:44:17 +00:00
orbiter
e6b30911c3 small changes to caching
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@747 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-19 15:13:12 +00:00
borg-0300
effbf35f57 finals;
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@746 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-18 23:07:29 +00:00
borg-0300
11e175630b StringBuffers, finals;
cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@745 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-18 15:23:01 +00:00
borg-0300
22ffde70dd more Properties
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@744 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-18 15:18:51 +00:00
borg-0300
905e9d274e more Properties
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@743 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-18 15:17:00 +00:00
borg-0300
d082837c87 added Properties
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@742 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-18 10:14:43 +00:00
borg-0300
42cd2cea65 added final constants, so that other class can reach it;
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@741 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-18 09:45:20 +00:00
orbiter
900ab97422 change of memory-allocation blocking value for GC prevention
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@740 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-17 16:15:56 +00:00
borg-0300
5543ea08ad sorted directory/file list;
dont list responseHeader.db;
StringBuffers, finals;
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@739 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-16 20:28:07 +00:00
orbiter
0ffca99886 added priority-organization to kelondroRecord cache. This should virtually double the cache capacity.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@738 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-16 12:20:59 +00:00
orbiter
2d22626386 automatic switch-off of cache control in kelondroRecords in case that cache is big enough (so that no cache-aging needs to be controled)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@737 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-16 07:50:15 +00:00
borg-0300
d06aa558f5 back to 731
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@736 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-15 23:47:55 +00:00
orbiter
50a9500035 fixed 100% CPU bug with news queue deletion
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@735 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-15 22:51:41 +00:00
borg-0300
f50d45678e better values for BIG directory's
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@734 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-15 22:41:24 +00:00
borg-0300
650764ce62 sorted directory/file list;
dont list responseHeader.db;
StringBuffers, finals;
cleaned;


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@733 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-15 22:24:46 +00:00
orbiter
cddd9aaa33 fixed SERIOUS bug with kelondroStack; affected all stack processing since 729
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@732 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-15 22:17:51 +00:00
orbiter
51aa6d0b33 fix for performance-problem on CacheAdmiin_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@731 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-15 21:46:15 +00:00
orbiter
416c126815 fix for a profile = null problem and new monitor in crawl queue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@730 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-15 21:39:37 +00:00
orbiter
19547f1821 changed node manipulation methods in kelondro core to reduce object allocation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@729 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-15 20:45:51 +00:00
rramthun
0d319fff41 german stopwords.
We should try to use language dependent wordfiles as fast as possible, because they will prevent the indices from getting big with useless (very common) words, which have no function, while the stopwords used at the moment filter too much.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@728 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-15 16:30:16 +00:00
rramthun
c256ab0532 updated german language file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@726 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-15 13:56:03 +00:00
orbiter
debb207a74 removed file sync
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@725 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-14 14:25:46 +00:00
orbiter
2148c0cf49 replaced kelondro storage core; much less objects in kelondro cache now; less IO from DB
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@724 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-14 10:10:49 +00:00
theli
dff96601fe *) Bugfix for transferURL:
URL list index was not incremented properly.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@723 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-14 07:20:14 +00:00
theli
beefddf0e8 *) Adding option which allows to do a Index-Transfer without deletion of index
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@722 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-14 07:14:24 +00:00
rramthun
4036ee812a Updated german language file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@721 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-13 16:29:59 +00:00
borg-0300
16c371a385 finals;
StringBuffer;
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@720 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-13 11:56:50 +00:00
theli
40925f4fb7 *) Improving complete index transfer performance by automatically increasing size of transfered word chunk
for fast connections (much similar to normal dht behavior) 
   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@719 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-13 10:29:04 +00:00
theli
91ab4d044b *) Adding automatic retry functionality to complete index transfer function
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@718 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-13 08:32:24 +00:00
theli
a62677f761 *) Adding additional logging output for complete index transfer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@717 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-13 06:44:38 +00:00
theli
7638b4181b *)Undoing peername sorting
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@716 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-13 05:46:55 +00:00
borg-0300
61d3b23ada replace created with contributed
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@715 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-12 22:20:37 +00:00
borg-0300
e0aadfe76e sorted config list (Config_p.html);
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@714 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-12 21:55:22 +00:00
rramthun
10e7d6f02b Bugfix for http://www.yacy-forum.de/viewtopic.php?t=1053
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@713 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-12 15:33:51 +00:00
theli
b991d2e7dd *) Additional logging message for complete index transfer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@712 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-12 12:02:45 +00:00
theli
3c00c5f6c7 *) Complete Index Transfer
See: http://www.yacy-forum.de/viewtopic.php?p=9622

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@711 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-12 11:39:32 +00:00
theli
f783061414 *) Changing redirection code from 307 to 302
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@710 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-12 11:38:46 +00:00
theli
85958e5064 *) IndexControl_p.java: sorting peernames properly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@709 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-12 10:49:35 +00:00
theli
a6a8af0f04 *) httpdFileHandler templateCache can now be disabled
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@708 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-12 10:47:27 +00:00
theli
2cb084d426 *) Complete Index Transfer
See: http://www.yacy-forum.de/viewtopic.php?p=9622

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@707 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-12 10:37:16 +00:00
borg-0300
595ec6faf1 svn keyword test
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@706 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-09-11 21:03:35 +00:00