Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,356 Commits 1 Branch 20 Tags 836 MiB
1395aae742
Commit Graph

196 Commits

Author SHA1 Message Date
theli
f3ac4dbbb9 *) better handling of server shutdown 
See: e.g. http://www.yacy-forum.de/viewtopic.php?t=2584

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2468 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-09-03 14:59:00 +00:00
orbiter
39b4c26bdc more memory control: 
- catchup of OutOfMemoryError in server threads
- automatic adoption of word cache size after a Short Mem Cycle

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2426 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-19 00:06:39 +00:00
orbiter
eb633c0a4f server threads must now supply a method that can be called in case 
of short memory. This has been realized for the indexing thread.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2421 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-18 02:07:03 +00:00
orbiter
0187c60010 because of a bug in the JRE 1.4.2 there was no memory protection 
see http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4686462
this commit fixes the bug by using a memory-computation patch.
All uses of Runtime.maxMemory had been replaced by serverMemory.max
The bug is not present any more in Java 1.5

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2419 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-18 01:33:54 +00:00
orbiter
314021453f * more logging 
* option in yacy.init to set useCollectionIndex usage

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2374 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-10 21:21:50 +00:00
theli
c09f734d06 *) offer router configuration on ConfigBasic.html 
- checkbox to allow router configuration is shown if
   - a) the UPnP forwarder is installed
   - b) a UPnP enabled router was found
   - c) no other forwarder was configured
   See: http://www.yacy-forum.de/viewtopic.php?p=24264

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2358 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 11:31:18 +00:00
orbiter
d468d665c9 some changes that may help to prevent deadlocks that cause an OutOfMemoryError 
as described in
http://www.yacy-forum.de/viewtopic.php?p=24359

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2353 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 00:19:01 +00:00
orbiter
8b77afd72c some fixes to new container merger 
and some code cleanup

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2336 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-26 22:40:11 +00:00
theli
839806a775 *) serverPortForwardingUpnp.java: code cleanup, license header added 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2332 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-26 15:32:35 +00:00
theli
03230cd887 *) removing old port forwarding classes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2330 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-26 14:42:12 +00:00
theli
6e676224d0 *) adding support for upnp 
A new port forwarding method for upnp was added.
   If this method is enabled, yacy automatically determines an UPnP 
   capable internet gateway and configures the gateway port forwarding
   settings properly. 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2328 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-26 14:26:45 +00:00
orbiter
1ed3e2daef added option to extract domains and/or urls from the eurl database 
when extracting from eurl, the html output format is recommended, since
this format adds also the fail reason to the domain/url.
The complete syntax for domain extraction is now
java -Xmx<megabytes>m -classpath classes yacy -domlist [ -source { lurl | eurl } ] [ -format { text  | zip | gzip | html } ] [ <path to DATA folder> ]


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2322 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-24 08:08:33 +00:00
orbiter
58df8b7bbf a large collection of different changes 
* mainly for the transition to the new indexing database structure
* a bugfix for an endless loop inside kelondroTree iteration
* a bugfix for bulk read inside a kelondroTree iteration; the bug caused that some elements had been iterated twice
* very strong speed enhancement for url/domain extraction

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2320 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-23 22:39:41 +00:00
orbiter
b3f7e62e03 better handling of whitespace 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2311 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-19 23:53:27 +00:00
orbiter
4149939c02 better handling of whitespace for gettext quotation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2310 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-19 23:18:06 +00:00
orbiter
97fa6788a1 added gettext support: 
automatic replacement of string appearances in html files by
gettext quotes.
see also: http://www.yacy-forum.de/viewtopic.php?p=23901#23901

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2309 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-19 22:35:36 +00:00
orbiter
67edd80884 removed tabs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2305 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-19 11:13:14 +00:00
orbiter
3879a0ecd0 replaced java.net.URL usage by use of new class de.anomic.net.URL 
This shall be seen as an experiment to exclude all cases where
there could be a DNS lookup during URL comparisment.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2290 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-13 01:21:53 +00:00
allo
6acb6a4d8f tiny performance optimization 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2285 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-09 15:37:45 +00:00
theli
fe617d7e54 *) adding function to return the protocol type of a ssl connection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2274 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-03 14:16:46 +00:00
orbiter
018b3e0832 added pause option to server threads. 
The pause is started by calling intermission(Long.MAX_VALUE)
and can be stopped by calling intermission(0)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2272 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-03 13:20:14 +00:00
allo
0621106ef3 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2214 6c8d7289-2bf4-0310-a012-ef5d649a1542 2006-06-18 12:15:26 +00:00
orbiter
12af69dd86 cosmetics 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2212 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-18 11:49:31 +00:00
rramthun
bc94a714b2 Better explanation for the auto-dom-filter. 
Some javadoc.
Small change to DetailedSearch.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2146 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-26 12:18:12 +00:00
theli
a520ab2e8c *) adding possibility to use an existing PKCS12 certificate for https 
instead of creating a new one.

   Notes:
   This import is done automatically on startup if the following properties 
   are set in the config file:
     pkcs12ImportFile = 
     pkcs12ImportPwd = 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2139 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-24 07:15:42 +00:00
orbiter
cda087f43b - integrated cache miss storage into object cache 
- removed cache-miss handling from indexURL
todo: new Monitoring in PerformanceMemory_p

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2132 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 16:43:28 +00:00
theli
8b7626f8d1 *) Automatic redirection of browser if user changes port settings in ConfigBasic 
See: http://www.yacy-forum.de/viewtopic.php?t=2415
*) If ssl is available, the browser conntects to yacy via https on yacy startup
   See: http://www.yacy-forum.de/viewtopic.php?p=21649#21649

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2127 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-20 14:05:49 +00:00
theli
cea6e416d9 *) wrong name in header 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2097 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 09:52:22 +00:00
theli
df068cf23c *) adding first version of native SSL support for yacy 
VERY EXPERIMENTAL!
   See: http://www.yacy-forum.de/viewtopic.php?p=18516

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2096 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 09:41:29 +00:00
orbiter
83e0e765ec redesigned some parts of the html scanner & parser 
to better support image tags

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1995 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-04 14:36:01 +00:00
rramthun
42b0b10a95 -Adding Windows Media to types which are not sended compressed 
-Renaming writeandzip to writeandgzip to avoid confusion about type of compression
-Adding new startup message to windows script
-The usual language "enhancements" ;-)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1953 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-23 20:12:23 +00:00
orbiter
128e4ab199 - in serverSystem: maxPathLength is now a variable, not a method 
- upon startup the calculated maximum path length is shown

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1932 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-19 01:33:20 +00:00
orbiter
30e3e3a0fd adopted MAXPATHLENGTH to host system capabilities 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1930 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-19 00:29:27 +00:00
allo
68ec572df0 bugfix for staticIP 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1803 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-03 16:24:21 +00:00
theli
89286478e7 *) removing thread pool eviction for now. Not needed at the moment 
See: http://www.yacy-forum.de/viewtopic.php?p=18290#18290

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1801 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-03 09:09:36 +00:00
allo
3b7e66ab48 staticIP should now work 
(with resolved Conflict)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1785 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-28 12:31:57 +00:00
theli
8558000bd9 *) better handling of port forwarding 
- button is disabled if libx is not installed
   - bugfix for disconnect

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1782 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-28 09:50:56 +00:00
borg-0300
00975359c5 added keywords, properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1715 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-20 22:57:42 +00:00
theli
f95d98142f *) displaying amount of items in the existsIndex caches 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1679 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-17 11:02:01 +00:00
theli
9b941fb773 *) bugfix for usage of yacy with extended port binding (e.g. #eth0:8080, 192.168.0.1:8080, etc.) 
- port was reported incorrectly to other peers


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1678 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-17 10:53:20 +00:00
theli
556d242be0 *) Limited support of content-range requests 
- a simple continue download request should work now

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1663 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-16 09:23:27 +00:00
theli
8fcb25f9f9 *) Setting via header according to rfc 
- can be disabled via settings dialog

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1662 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-16 09:20:57 +00:00
allo
73f18ed5b2 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1627 6c8d7289-2bf4-0310-a012-ef5d649a1542 2006-02-13 14:42:19 +00:00
theli
50d85657b8 *) new import function for IndexImport_p.html 
- can be used to import the crawling queue (noticeUrlDB + stacks)
   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1518 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-02 16:46:58 +00:00
orbiter
ec5d88664a tried too fix serverSwitch synchronization problems 
see also: http://www.yacy-forum.de/viewtopic.php?p=16110#16110

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1499 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-30 23:07:20 +00:00
theli
3d5347bc8e *) changing loglevel for some messages 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1479 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-28 17:40:24 +00:00
theli
0fcd113c42 *) last bugfix part. Seems to work now for the stackCrawler 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1478 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-28 17:25:19 +00:00
theli
bea2b9edee *) further redesign of threadpools to solve too many thread problem 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1473 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-28 16:18:07 +00:00
theli
859c6a88f5 *) testing various thread pool eviction settings to avoid outOfMemory - Thread creation problem 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1467 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-27 16:51:29 +00:00
theli
f5abfe8d57 *) more failsafe threadpools 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1446 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-26 09:37:43 +00:00