Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
778 Commits 1 Branch 20 Tags 836 MiB
ca82d690a9
Commit Graph

778 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
borg-0300
ca82d690a9 changed in SVN 805 one line too much 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@806 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-28 13:58:42 +00:00
borg-0300
4bb1f849a0 Bugfix for http://www.yacy-forum.de/viewtopic.php?t=1233 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@805 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-28 13:49:57 +00:00
orbiter
2c7b490e30 memory-logging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@804 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-28 00:52:54 +00:00
allo
ee347364d9 basic xhtml/css layout 
-to test, replace #[he4ader]# with #[xhtml-header]#, #[footer]# with #[xhtml-footer]# and use the xhtml-style css


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@803 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-27 20:13:34 +00:00
rramthun
717f7678a4 small changes to german translation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@802 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-27 19:02:08 +00:00
orbiter
7fc822a59b changed handling of time-zones 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@801 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-27 16:28:55 +00:00
rramthun
4c2c5ace01 Adding random seedlist to superseed. will upload php source later, when it is finished :-D 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@800 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-27 12:02:49 +00:00
theli
97990299fa *) Changing lib names after migration to newer versions of PDFBox + jsch 
Thanks to Hydrox for the advice

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@799 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-27 07:52:20 +00:00
theli
9b7f37fc37 *) Minor changes 
- more debugging output: storageTime for indexed document is logged now
   - saving memory in plasmaParserDocument.java, plasmaWordIndexEntryContainer.java (not a big deal)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@798 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-27 07:10:24 +00:00
orbiter
3c1d968d29 fix-fix for 792 and small changes in ftpc/download/dir experiments 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@797 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-26 10:36:42 +00:00
theli
b5a8992d29 *) Setting some object fields to final 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@796 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-26 09:39:54 +00:00
theli
5f95a1cf62 *) Bugfix for ProxyErrormsg: Wrong http host header 
See: http://www.yacy-forum.de/viewtopic.php?p=9905#9905

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@795 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-26 08:10:40 +00:00
theli
023be89586 *) Bugfix for "Robots.txt wird immer wieder geladen" 
See: http://www.yacy-forum.de/viewtopic.php?p=10241#10233

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@794 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-26 08:05:59 +00:00
theli
35c6c5ead7 *) Bugfix for "Blacklist und Crawlen" Bug. 
: Crawling continues even if URL is listed in Blacklist
   See: http://www.yacy-forum.de/viewtopic.php?p=10279#10279
   - missing return statement added. Thanks to allo for the
     code review.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@793 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-26 06:51:11 +00:00
orbiter
dc474aa22f various bug-fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@792 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-26 01:10:41 +00:00
orbiter
9e2fc7e5fe load balancing of crawl target domains 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@791 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-25 01:09:21 +00:00
(no author)
1aa79f5bb5 cleaned; 
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@790 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-24 11:58:17 +00:00
orbiter
694226d4b1 typo 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@789 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-24 00:40:52 +00:00
orbiter
3fcc95a82c integrated crawl-profiles db in memory-performance monitor 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@788 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-24 00:33:27 +00:00
orbiter
72ce36baba cleanup in kelondroRecords 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@787 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-24 00:14:01 +00:00
orbiter
0625a4f81b changed test on wget 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@786 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-23 23:35:46 +00:00
theli
fe6a6abc0b *) Adding robots.txt db to Performance Settings for Memory menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@785 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-23 01:31:29 +00:00
orbiter
3274ae725e increased cache size of robots database; however, this should be integrated into new memory control 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@784 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-23 00:37:31 +00:00
orbiter
c6d2f50375 changed order of robots and double-check 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@783 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-23 00:18:08 +00:00
orbiter
68d5ff2ef1 added stringbuffer in condenser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@782 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 23:43:45 +00:00
theli
c42a543bc3 *) Adding peername to logmessage when receiving URLs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@781 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 23:40:03 +00:00
theli
90f02ea455 *) removing metainfo from serverargs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@780 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 23:05:34 +00:00
theli
70a5681a4f *) Bugfix for inactive scp seed uploader 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@779 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 23:04:26 +00:00
orbiter
e380d4e55e cleanup (no functional change) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@778 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 21:51:21 +00:00
allo
4aa04972ac bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@777 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 21:02:08 +00:00
orbiter
de0a58d79c no more sync 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@776 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 20:31:55 +00:00
allo
7991c05b49 homePath instead if RootPath 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@775 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 20:25:56 +00:00
orbiter
495bc8bec6 removed cache-control from low and medium priority caches which reduces memory use and computation overhead 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@774 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 20:01:26 +00:00
allo
5bf7d74114 permanent yacy.logging 
see http://www.yacy-forum.de/viewtopic.php?p=10020


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@773 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 18:54:36 +00:00
theli
1dc94e7753 *) Adding support for gzip content-encoding of http post requests 
used to transferRWIs and transferURLs.
   See: http://www.yacy-forum.de/viewtopic.php?t=1167#10020

*) adding yacyVersion.java containing constants defining yacy versions
   that support a given feature.
   Needed to determine if a remote peer is able to decode gzip 
   content-encoded http post bodies properly.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@772 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 10:30:55 +00:00
orbiter
e6b9b23290 configuration of startup-memory in webinterface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@771 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 01:17:49 +00:00
borg-0300
a1f5027a88 finals; 
cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@770 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 23:18:12 +00:00
orbiter
979a3ee3c0 exceptions for better testing of bug http://www.yacy-forum.de/viewtopic.php?p=9852#9852 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@769 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 22:58:15 +00:00
orbiter
18d9e1a256 fix for http://www.yacy-forum.de/viewtopic.php?p=10026#10026 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@768 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 21:56:39 +00:00
borg-0300
1dd7047af5 finals; 
cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@767 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 21:32:43 +00:00
allo
ba145efb46 check for wget 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@766 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 20:42:57 +00:00
allo
211a72ec6b using wget instead of java for shutdown 
-better performance
-more native


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@765 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 20:08:40 +00:00
orbiter
ef85fce661 change of memory-consumption constants (had been much too low) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@764 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 15:32:49 +00:00
orbiter
07f30931ec various configuration options in memory performance 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@763 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 14:21:45 +00:00
orbiter
2f732e32a2 enhancements to memory menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@762 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 12:21:01 +00:00
borg-0300
150bd33591 finals; 
cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@761 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 10:48:46 +00:00
orbiter
e17df64b54 removed IS_ADMIN - feature. This was covered by plasmaSwitchborad.adminAuthenticated 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@760 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 09:22:01 +00:00
orbiter
b5337a122c some more information about available memory in PerformaceMemory menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@759 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 00:12:37 +00:00
orbiter
96a5b6e8fb removed yacy peer types from serverSwitch 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@758 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 23:15:33 +00:00
theli
b990dc1ad1 *) Replacing jsch 0.1.19 lib with newer version 0.1.21 
*) Replacing PDFBox 0.7.1 lib with newer version 0.7.2
*) Refactoring of classes httpd/httpc/httpHeaders to
   make many methods for httpHeader/Requestline parsing
   reusable for new icap implementation
*) adding chunked input stream support
   - needed by new icap implementation
   - needed by future httpc HTTP/1.1 support 
*) httpd.java
   - moving all connection property contants to class httpHeader
   - moving readHeader function to class httpHeader
   - moving parseQuery function to class httpHeader
   - moving handleTransparentProxy function to class httpHeader
*) httpHeader.java
   - adding new fuction to parse the http response line
   - adding new function to converte http headers to a string that
     can be send to the client
   - adding a function that generates a proper url using all parsed
     connection properties
*) ICAP Support
   - yacy now supports handling of icap response modification requests
   - this feature can be used by other icap enabled proxies to contact 
     yacy as icap server, and to handover the downloaded content to yacy.logging
     for indexing
   - functionality was successfully tested with squid 2.5Stable 10 + icap patch
   - further icap services e.g. URL filtering based on yacy's blacklists are possible
*) plasmaSwitchboard.java
   - htcache entries that are still needed for indexing are now properly registered 
     as in use after system restart
   - extended logging: log message now shows parsing and indexing time for each sb. entry
    

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@757 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 21:49:47 +00:00