Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
734 Commits 1 Branch 20 Tags 836 MiB
2f732e32a2
Commit Graph

734 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
orbiter
2f732e32a2 enhancements to memory menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@762 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 12:21:01 +00:00
borg-0300
150bd33591 finals; 
cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@761 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 10:48:46 +00:00
orbiter
e17df64b54 removed IS_ADMIN - feature. This was covered by plasmaSwitchborad.adminAuthenticated 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@760 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 09:22:01 +00:00
orbiter
b5337a122c some more information about available memory in PerformaceMemory menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@759 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 00:12:37 +00:00
orbiter
96a5b6e8fb removed yacy peer types from serverSwitch 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@758 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 23:15:33 +00:00
theli
b990dc1ad1 *) Replacing jsch 0.1.19 lib with newer version 0.1.21 
*) Replacing PDFBox 0.7.1 lib with newer version 0.7.2
*) Refactoring of classes httpd/httpc/httpHeaders to
   make many methods for httpHeader/Requestline parsing
   reusable for new icap implementation
*) adding chunked input stream support
   - needed by new icap implementation
   - needed by future httpc HTTP/1.1 support 
*) httpd.java
   - moving all connection property contants to class httpHeader
   - moving readHeader function to class httpHeader
   - moving parseQuery function to class httpHeader
   - moving handleTransparentProxy function to class httpHeader
*) httpHeader.java
   - adding new fuction to parse the http response line
   - adding new function to converte http headers to a string that
     can be send to the client
   - adding a function that generates a proper url using all parsed
     connection properties
*) ICAP Support
   - yacy now supports handling of icap response modification requests
   - this feature can be used by other icap enabled proxies to contact 
     yacy as icap server, and to handover the downloaded content to yacy.logging
     for indexing
   - functionality was successfully tested with squid 2.5Stable 10 + icap patch
   - further icap services e.g. URL filtering based on yacy's blacklists are possible
*) plasmaSwitchboard.java
   - htcache entries that are still needed for indexing are now properly registered 
     as in use after system restart
   - extended logging: log message now shows parsing and indexing time for each sb. entry
    

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@757 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 21:49:47 +00:00
borg-0300
6d1de8abfd finals; cleaned; 
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@756 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 15:43:31 +00:00
borg-0300
e748ba3f6e super(), finals; 
other; cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@755 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 15:36:22 +00:00
orbiter
af9021e956 fixed bug with news caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@754 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 11:30:03 +00:00
orbiter
14bc880fa4 fixed bug with crashed profile database 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@753 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 11:20:29 +00:00
orbiter
71a31f0902 integrated and extended new memory performance menu; found and fixed bug in DHT caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@752 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 10:54:20 +00:00
orbiter
fb52a82008 added new performance page for memory settings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@751 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 10:10:34 +00:00
low012
0f1bbff459 *) Tiny little job of cleaning up. (Was man nicht im Kopf hat, hat man in den Fingern...) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@750 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-19 20:42:53 +00:00
low012
4dbc871524 *) Trying to get rid of possibility of exploits in IndexCreate* through HTML and JavaSkript in peernames, URLs, <title>-tags etc. (see http://www.yacy-forum.de/viewtopic.php?t=1181) I hope I got them all and did not overdo it. 
*) Just a tiny bit of cleanig up in News.java. (I messed it up myself some time ago.)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@749 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-19 20:36:29 +00:00
rramthun
9dfbd93c7b Updated german language file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@748 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-19 15:44:17 +00:00
orbiter
e6b30911c3 small changes to caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@747 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-19 15:13:12 +00:00
borg-0300
effbf35f57 finals; 
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@746 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-18 23:07:29 +00:00
borg-0300
11e175630b StringBuffers, finals; 
cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@745 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-18 15:23:01 +00:00
borg-0300
22ffde70dd more Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@744 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-18 15:18:51 +00:00
borg-0300
905e9d274e more Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@743 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-18 15:17:00 +00:00
borg-0300
d082837c87 added Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@742 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-18 10:14:43 +00:00
borg-0300
42cd2cea65 added final constants, so that other class can reach it; 
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@741 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-18 09:45:20 +00:00
orbiter
900ab97422 change of memory-allocation blocking value for GC prevention 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@740 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-17 16:15:56 +00:00
borg-0300
5543ea08ad sorted directory/file list; 
dont list responseHeader.db;
StringBuffers, finals;
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@739 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-16 20:28:07 +00:00
orbiter
0ffca99886 added priority-organization to kelondroRecord cache. This should virtually double the cache capacity. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@738 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-16 12:20:59 +00:00
orbiter
2d22626386 automatic switch-off of cache control in kelondroRecords in case that cache is big enough (so that no cache-aging needs to be controled) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@737 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-16 07:50:15 +00:00
borg-0300
d06aa558f5 back to 731 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@736 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 23:47:55 +00:00
orbiter
50a9500035 fixed 100% CPU bug with news queue deletion 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@735 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 22:51:41 +00:00
borg-0300
f50d45678e better values for BIG directory's 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@734 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 22:41:24 +00:00
borg-0300
650764ce62 sorted directory/file list; 
dont list responseHeader.db;
StringBuffers, finals;
cleaned;


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@733 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 22:24:46 +00:00
orbiter
cddd9aaa33 fixed SERIOUS bug with kelondroStack; affected all stack processing since 729 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@732 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 22:17:51 +00:00
orbiter
51aa6d0b33 fix for performance-problem on CacheAdmiin_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@731 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 21:46:15 +00:00
orbiter
416c126815 fix for a profile = null problem and new monitor in crawl queue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@730 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 21:39:37 +00:00
orbiter
19547f1821 changed node manipulation methods in kelondro core to reduce object allocation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@729 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 20:45:51 +00:00
rramthun
0d319fff41 german stopwords. 
We should try to use language dependent wordfiles as fast as possible, because they will prevent the indices from getting big with useless (very common) words, which have no function, while the stopwords used at the moment filter too much.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@728 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 16:30:16 +00:00
rramthun
c256ab0532 updated german language file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@726 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 13:56:03 +00:00
orbiter
debb207a74 removed file sync 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@725 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-14 14:25:46 +00:00
orbiter
2148c0cf49 replaced kelondro storage core; much less objects in kelondro cache now; less IO from DB 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@724 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-14 10:10:49 +00:00
theli
dff96601fe *) Bugfix for transferURL: 
URL list index was not incremented properly.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@723 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-14 07:20:14 +00:00
theli
beefddf0e8 *) Adding option which allows to do a Index-Transfer without deletion of index 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@722 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-14 07:14:24 +00:00
rramthun
4036ee812a Updated german language file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@721 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-13 16:29:59 +00:00
borg-0300
16c371a385 finals; 
StringBuffer;
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@720 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-13 11:56:50 +00:00
theli
40925f4fb7 *) Improving complete index transfer performance by automatically increasing size of transfered word chunk 
for fast connections (much similar to normal dht behavior) 
   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@719 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-13 10:29:04 +00:00
theli
91ab4d044b *) Adding automatic retry functionality to complete index transfer function 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@718 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-13 08:32:24 +00:00
theli
a62677f761 *) Adding additional logging output for complete index transfer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@717 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-13 06:44:38 +00:00
theli
7638b4181b *)Undoing peername sorting 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@716 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-13 05:46:55 +00:00
borg-0300
61d3b23ada replace created with contributed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@715 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-12 22:20:37 +00:00
borg-0300
e0aadfe76e sorted config list (Config_p.html); 
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@714 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-12 21:55:22 +00:00
rramthun
10e7d6f02b Bugfix for http://www.yacy-forum.de/viewtopic.php?t=1053 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@713 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-12 15:33:51 +00:00
theli
b991d2e7dd *) Additional logging message for complete index transfer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@712 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-12 12:02:45 +00:00