Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,379 Commits 1 Branch 20 Tags 836 MiB
dae763d8e3
Commit Graph

1651 Commits

Author SHA1 Message Date
orbiter
d2bb3f442e fixed timing problem causing a division by zero exception 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2287 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-11 23:43:25 +00:00
allo
6acb6a4d8f tiny performance optimization 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2285 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-09 15:37:45 +00:00
allo
2bdf1fc360 totalPPM 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2282 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-08 22:41:48 +00:00
theli
24a02cbeef *) Bugfix for not parsable application/xhtml+xml resources if 
an URL has no extension
   See: http://www.yacy-forum.de/viewtopic.php?p=23687

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2280 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-07 05:36:19 +00:00
orbiter
b0ca5fa784 some correction algorithm for preload time computation during assortment open 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2279 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-05 09:20:59 +00:00
orbiter
e22cbaee97 - extended logging for preload 
- reduced preload-time for IndexImport_p.java

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2278 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-05 09:02:58 +00:00
orbiter
671fd9a5c9 work towards new indexing database structure 
(no effect on current functionality yet)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2277 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-04 14:47:27 +00:00
orbiter
92f4cb4d73 added option to configure the start-up delay time for kelondro database files. 
the start-up delay is used to pre-load the database node cache

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2276 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-03 23:57:33 +00:00
orbiter
ce9dd3e76d some work in the index construction zone (no effect yet) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2275 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-03 15:14:54 +00:00
theli
fe617d7e54 *) adding function to return the protocol type of a ssl connection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2274 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-03 14:16:46 +00:00
orbiter
018b3e0832 added pause option to server threads. 
The pause is started by calling intermission(Long.MAX_VALUE)
and can be stopped by calling intermission(0)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2272 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-03 13:20:14 +00:00
orbiter
e1a52bea22 added a class stub for the new database structure: 
a reverse word index based on a a collection index,
which is an index for a set of array files containing
row collections.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2271 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-02 22:24:13 +00:00
orbiter
3b69b35bf2 added pre-load of node cache entries to kelondroRecords 
this gives the kelondroTree data structure a similar start-up
behaviour like the kelondroFlexTable: the cache is filled with
routing data in such a way that is more performant than
reading node records during normal operation.
The pre-load phase stops automatically after a time-out of 500 milliseconds
of if the cache is full.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2270 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-02 22:20:55 +00:00
orbiter
85d575e928 enhancements to kelondroRow and kelondroColumn 
these are changes towards a better indexURLEntry implementation
which are needed for the new database structures

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2268 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-02 01:26:06 +00:00
orbiter
ab1ed053f5 another small correction 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2267 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-02 00:57:20 +00:00
orbiter
b92561fb67 removed unused code 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2266 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-02 00:44:38 +00:00
orbiter
eadbd56fc5 small adjustment to last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2265 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-02 00:39:23 +00:00
orbiter
e9765ac4e6 introduced bulk read for node iterator in kelondroRecords 
this speeds up the iterator by factor 2

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2264 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-02 00:31:20 +00:00
orbiter
6643da3fbd bugfix for http://www.yacy-forum.de/viewtopic.php?p=23463#23463 
(affected URL DB Cleaner)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2263 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-01 09:51:00 +00:00
orbiter
866d53ed70 fix for DNS block bug 
see http://www.yacy-forum.de/viewtopic.php?p=23458#23458

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2262 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-30 22:39:33 +00:00
orbiter
6af70febef - added kelondroTree index option to kelondroFlexTable 
- automatic generation of index file when index is too large for RAM


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2261 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-30 12:54:19 +00:00
orbiter
dd2865178a major bugfix (searched a whole week for the bug) for 
the kelondroRowBuffer, which has effect mostly to the
kelondroFlexTable but also to all other database functions

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2260 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-30 08:52:39 +00:00
orbiter
f9b9d085c4 just changed testing code 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2259 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-29 23:01:42 +00:00
theli
b594ee9a5a *) Adding possibility to configure if the http proxy should send the 
X-forwarded-for header (requested by TeeSee)
   See: http://www.yacy-forum.de/viewtopic.php?t=2577

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2257 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-29 16:01:03 +00:00
orbiter
ef84fc4956 added IOException to size() and row() 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2256 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-29 07:56:27 +00:00
theli
7646849241 *) implementation of size() for mysql 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2255 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-29 05:36:37 +00:00
orbiter
84dfd76a6a kelondroFlex bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2254 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-28 16:14:47 +00:00
hydrox
53077f5835 *)fixed paths to yacy.logging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2252 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-28 09:04:53 +00:00
hydrox
8ba8e2b7d9 *) added cache for blacklists urlhashs recieved by DHT. DHT does not request URLs listed in this cache. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2251 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-28 08:51:34 +00:00
hermens
53cbcc6d6e Implement emergency break in index receive when the limit of the ramCache is exceeded by more than cacheLimit 
See: http://www.yacy-forum.de/viewtopic.php?p=22911#22911



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2248 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-27 11:14:30 +00:00
orbiter
e40987ecab removed default memory reservation for testing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2247 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-27 09:16:07 +00:00
orbiter
4cc6e6551f bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2245 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-26 09:52:23 +00:00
orbiter
66964dc015 removed high/med/low from kelondroRecords cache control. 
this was done because testing showed that cache-delete operations
slowed down record access most, even more that actual IO operations.
Cache-delete operations appeared when entries were shifted from low-priority
positions to high-priority positions. During a fill of x entries to a database,
x/2 delete situation happen which caused two or more delete operations.
removing the cache control means that these delete operations are not
necessary any more, but it is more difficult to decide which cache elements
shall be removed in case that the cache is full. There is not yet a stable
solution for this case, but the advantage of a faster cache is more important
that the flush problem.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2244 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-25 10:31:38 +00:00
allo
6866bc2758 be quiet! 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2243 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-24 17:40:55 +00:00
borg-0300
4c6083b264 network picture; 
back to old version

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2242 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-24 02:52:24 +00:00
borg-0300
955915385a network picture; 
small changes;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2241 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-23 15:37:59 +00:00
borg-0300
027fa8ab1c network picture; 
bigger; 
more dot steps; 
small other;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2240 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-23 13:53:29 +00:00
orbiter
41c4641612 added some profiling to kelondro caching classes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2239 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-23 12:49:42 +00:00
orbiter
dd560e4b2f finetuning 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2238 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-22 23:11:40 +00:00
orbiter
a5661de880 added debug line 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2237 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-22 15:45:33 +00:00
orbiter
5b1d77cd4b some enhancements to caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2236 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-22 15:42:09 +00:00
hydrox
ad03715b64 *) added fill and read functions with benchmark output every 10000 operations to dbtest.java 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2235 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-22 08:37:48 +00:00
theli
b20496e42b *) make DHT DoS check configurable (requested by KoH) 
- check can be disabled via property indexDistribution.dhtReceiptLimitEnabled
   - upper bound can be configured via indexDistribution.dhtReceiptLimit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2234 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-21 19:28:42 +00:00
orbiter
650c7e9e55 some enhancements to caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2233 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-21 16:05:31 +00:00
hermens
d4645062bc Correct usage of vhost in wget/wput requests: 
- yacyClient: don't use own .yacyh domain in requests, instead use .yacyh domain of target peer for everything but ranking distribution
- natLib: use full hostname instead of just SLD.TLD



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2232 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-21 14:25:27 +00:00
orbiter
bde748f68f - integrated buffer in RowCollectionSet which speeds up the new 
cache by factor 3. (but the new cache was 5 times slower than the
old cache...)
- removed old unused code


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2231 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-21 14:16:34 +00:00
theli
fa9712151a *) dbtest.java: bugfix for mysql test. data was not written correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2230 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-21 13:01:06 +00:00
theli
f55d3d0d79 *) better error message if jdbc driver could not be loaded 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2229 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-21 12:14:04 +00:00
theli
07aa779e6d *) dbtest: adding read and write methods for mysql 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2228 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-21 11:44:38 +00:00
orbiter
d083b15c4b tests/fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2226 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-20 23:47:51 +00:00
orbiter
ce9a98ee25 experiments with buffer for collection class 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2225 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-20 23:18:41 +00:00
orbiter
6aa0f6eb0f better abstraction, less synchronization 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2224 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-20 22:13:17 +00:00
orbiter
1ec07fe351 better structure of the kelondro collection classes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2223 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-20 21:41:12 +00:00
allo
c264cda678 support to parse gettext files and to generate updated files, where only the new strings are empty. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2222 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-20 18:52:17 +00:00
orbiter
761d3bba54 integrated kelondroRowCollection in kelondroCollectionIndex 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2221 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-20 14:46:28 +00:00
orbiter
8f0c1a240a added kelondroRowCollection and kelondroRowSet which 
shall replace kelondroCollection

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2220 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-20 14:17:21 +00:00
theli
ed2cb040d1 *) Bugfix for http connection header validation 
- Connection header was not handled correctly if it contains
     multiple values, e.g. Connection: TE, close 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2219 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-20 05:22:55 +00:00
allo
f95c006dc2 generation of empty gettext files from yacy html-files 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2218 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-19 19:34:00 +00:00
orbiter
4fa3271754 adopted memory calculation to new memory amount used by kelondroCollectionObjectMap 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2215 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-18 12:16:56 +00:00
allo
0621106ef3 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2214 6c8d7289-2bf4-0310-a012-ef5d649a1542 2006-06-18 12:15:26 +00:00
orbiter
11951aed41 replaced node cache Object type in kelondroTree: 
kelondroCollectionObjectMap replaces HashMap.
the kelondroCollectionObjectMap uses only 1/4 of the memory of HashMap,
but is slightly slower than the HashMap.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2213 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-18 12:04:41 +00:00
orbiter
12af69dd86 cosmetics 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2212 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-18 11:49:31 +00:00
orbiter
ea72a7c580 added new objectMap (can replace HashMap and should use less memory, but is slower) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2211 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-18 11:33:26 +00:00
allo
67a8c74be3 Fix for dynamic login with static password. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2210 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-18 08:04:51 +00:00
allo
ef9eb50c3c fix for adminlogin 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2209 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-17 11:15:16 +00:00
allo
6fe2fed87e cookieauth works with static Admin. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2208 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-16 08:04:02 +00:00
theli
45b39ee1be *) solving unpacking problems with to long filename by 
a) renaming the parent folder in the tgz file to yacy
      (can be configured via build properties file)
   b) reconfiguring build file to throw an error if a file
      name is too long 
Please note that currently there is _no_ proplem with too long
class names because of step a.

      

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2207 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-14 15:18:41 +00:00
theli
fb090652df *) use a more compact for plasmaWordIndexAssortmentImporter.java because the long name 
caused problems during untar operation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2206 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-14 14:28:46 +00:00
theli
4ca0857c0c *) Index transfer now considers the pause time send by busy peers during 
index transfer / index distribution
   See: http://www.yacy-forum.de/viewtopic.php?p=22647#22491

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2205 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-14 09:40:42 +00:00
orbiter
e8848a3532 bugfixing for new kelondroFlexTable 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2204 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-13 15:05:11 +00:00
allo
b23703f260 using cookieAuth. 
logout for httpauth seems to be broken :-(

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2202 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-12 16:16:13 +00:00
allo
7f51a43cba disabled ipAuth for _p Pages (and broken Form-Login :-() for security reasons 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2201 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-12 14:18:38 +00:00
allo
bd22634c44 HTML-login, logout fixed. 
TODO: If you login with the form, then logout with the form, and then try to login with httpauth, the first try will fail.
(should logged_out be resettet in ipAuth? but if there is ipAuth before proxyAuth, the logout would be broken. Maybe a combined method can help.)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2200 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-12 13:47:44 +00:00
hermens
3f1ebc097e Limit the size of the DNS cache to 5000 and the age of the entries to one day. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2199 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-12 12:14:11 +00:00
allo
d7a3fdb18b no white pages, when clicking cancel on the password-dialog 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2198 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-12 12:12:21 +00:00
allo
ec36174b7f Form-Login works now. 
For _p Pages is httpauth still needed.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2194 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-11 08:59:02 +00:00
allo
11123416f3 Form-Login function. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2193 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-10 21:03:33 +00:00
allo
bd13bd78ad Bugfix for broken Tags 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2192 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-10 17:41:59 +00:00
orbiter
75ed507d39 some debugging of new kelondroFlexTable class 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2190 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-09 12:52:57 +00:00
theli
f01bd25489 *) Bugfix for OutOfMemory problem during minimizeUrlDB 
See: http://www.yacy-forum.de/viewtopic.php?t=2498
*) out of date import functions removed (can be done via web gui)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2189 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-09 05:38:59 +00:00
orbiter
8a18302e84 some work on the intMap 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2186 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-07 23:00:26 +00:00
orbiter
56084e9edc added a intMap, the new index management structure for kelondroFlexTables 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2185 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-07 22:28:21 +00:00
orbiter
e374add8cb added html tag 'area' to html parser 
see http://www.yacy-forum.de/viewtopic.php?p=22540#22540

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2184 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-07 20:03:44 +00:00
orbiter
eda055e729 - enhanced kelondroCollection speed 
- tested + debugged kelondroCollection
- inserted the new kelondroCollection Object as indexing class for kelondroFlexTable

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2183 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-07 15:40:29 +00:00
orbiter
5d2cd26529 enhanced kelondroCollection performance 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2182 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-06 22:48:31 +00:00
rramthun
5625937d1c Language improvements 
One very minor  HTML fix

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2181 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-06 16:30:32 +00:00
orbiter
577a6e6487 some work on kelondroCollection, no effect on current YaCy functions 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2180 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-06 15:01:01 +00:00
orbiter
2185a5cfb7 prevention of possible ConcurrentModificationException 
This happend at my peer and created a deadlock.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2179 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-05 20:48:48 +00:00
auron_x
71228cfc56 *)added ip to Blog.xml 
*)added possibility to import Blog.xml-files
*)included german translation for new Blog-features

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2178 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-05 18:47:31 +00:00
orbiter
b30645305b some additions to kelondroCollection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2172 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-02 22:59:24 +00:00
orbiter
370c481fa7 bugfixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2171 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-02 22:46:32 +00:00
orbiter
26b6cddf51 synchronized the DNS cache, because the non-synchronized version resulted in deadlocks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2168 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-02 19:09:48 +00:00
orbiter
c36e9fc8d3 full integration of kelondroRow 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2167 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-02 12:45:57 +00:00
orbiter
6e49721762 completed and tested kelondroFlexTable 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2166 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-01 22:13:52 +00:00
orbiter
b68f7dec9d added stub of new table class 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2165 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-01 16:18:27 +00:00
orbiter
b21824ef16 added new array interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2164 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-01 16:02:15 +00:00
orbiter
c75cacda95 added a flex-width-array: this is a table where it is 
possible to add columns to an existing table

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2163 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-01 16:01:24 +00:00
orbiter
4a907a570f 1st step to migrate kelondroTree to usage of kelondroRow instead of byte[][] 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2162 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-31 23:31:46 +00:00
orbiter
572d53506c new kelondroRow objects now replace byte[][] objects in object cache 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2161 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-30 22:39:19 +00:00
orbiter
09f780df27 more bugfixes for the new row/stack handling changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2160 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-30 21:24:01 +00:00
orbiter
89424ff122 multiple bugfixes for new stack/row features 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2159 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-30 20:58:41 +00:00
orbiter
3c3c047d0a integrated kelondroRow into kelondroStack 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2156 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-30 15:28:05 +00:00
orbiter
5bb565944f integration of new kelondroRow into some parts of kelondro, 
especially into the array storage

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2155 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-30 14:36:20 +00:00
orbiter
d580f582dc update to row/column handling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2154 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-29 16:26:24 +00:00
orbiter
eaa6f012f0 refactoring: better naming for classic DB (files in WORDS) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2151 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-28 11:59:16 +00:00
orbiter
5041d330ce refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2150 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-28 11:44:50 +00:00
orbiter
7b3b12888c refactoring: integrated indexContainer abstraction layer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2149 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-28 01:09:31 +00:00
orbiter
cb295fbbdc refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2147 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-26 23:55:30 +00:00
rramthun
bc94a714b2 Better explanation for the auto-dom-filter. 
Some javadoc.
Small change to DetailedSearch.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2146 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-26 12:18:12 +00:00
orbiter
28ff7ec214 added missing file from last refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2145 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-26 09:34:16 +00:00
orbiter
196b8abb30 refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2144 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-26 09:32:50 +00:00
orbiter
24686e50a2 - fixed a caching bug 
- added counter for cache delete to distinguish between flush and delete
- changed some default paramenters for cache size settings

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2143 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-25 11:46:09 +00:00
hermens
b48327904a Don't disconnect peers that report 'busy' during index transfer. 
These peers are already being marked as not accepting remote index transmissions by yacyClient.transferIndex. That should by enough to prevent further transfer attempts until newer seed information is received.



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2142 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-25 00:59:14 +00:00
orbiter
899c1a5df5 integrated cell-, and row-management classes 
this will be used for automatic export features

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2141 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-24 22:45:26 +00:00
orbiter
4d8f8ba384 added cache-performance analysis for node caches 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2140 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-24 09:40:08 +00:00
theli
a520ab2e8c *) adding possibility to use an existing PKCS12 certificate for https 
instead of creating a new one.

   Notes:
   This import is done automatically on startup if the following properties 
   are set in the config file:
     pkcs12ImportFile = 
     pkcs12ImportPwd = 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2139 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-24 07:15:42 +00:00
theli
c5c5c166f0 *) fix for javadoc generation 
See: http://www.yacy-forum.de/viewtopic.php?p=21884

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2138 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-24 04:40:30 +00:00
orbiter
1b4a27cd99 added monitoring for new miss-cache 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2137 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 22:59:39 +00:00
orbiter
bd057b44dd - automatic setting of peer-does-not-accept-remote-crawl 
- increased percentage of object cache to node cache to 30%

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2136 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 22:03:09 +00:00
orbiter
912116c5a7 renew cache update time if a cache-read hit happens 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2135 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 20:17:18 +00:00
orbiter
81e79f2caf fixed new cache behaviour changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2134 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 20:04:48 +00:00
orbiter
545f81b317 bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2133 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 16:48:21 +00:00
orbiter
cda087f43b - integrated cache miss storage into object cache 
- removed cache-miss handling from indexURL
todo: new Monitoring in PerformanceMemory_p

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2132 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 16:43:28 +00:00
orbiter
757ec28430 refactoring: better data capsulation for indexURL 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2131 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 08:59:45 +00:00
theli
61078b3885 *) adding support for delayed shutdown 
- needed by Ismael to receive the Steering page properly on shutdown
   - now the steering page should always be displayed properly in the web browser

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2129 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-22 08:02:35 +00:00
theli
8b7626f8d1 *) Automatic redirection of browser if user changes port settings in ConfigBasic 
See: http://www.yacy-forum.de/viewtopic.php?t=2415
*) If ssl is available, the browser conntects to yacy via https on yacy startup
   See: http://www.yacy-forum.de/viewtopic.php?p=21649#21649

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2127 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-20 14:05:49 +00:00
auron_x
e7199c6c7e *)fixed "Umlaute"-Bug in Blog 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2125 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-20 12:21:01 +00:00
orbiter
af098b815c - fix for blog/wiki error 
- re-enabled new map writing methods
see http://www.yacy-forum.de/viewtopic.php?p=21729#21729

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2124 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-20 12:09:58 +00:00
orbiter
90d569d70f refactoring of index management: 
url storage is part of index management; moved plasmaURL to indexURL

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2122 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 23:50:55 +00:00
orbiter
a930be4ba3 refactoring of index management: 
generalized the index entry

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2121 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 23:19:20 +00:00
orbiter
634543121b added debug message 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2120 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 21:49:12 +00:00
orbiter
74a78ebd78 turned back handling of map-writing into kelondro because of possible bug for testing 
see http://www.yacy-forum.de/viewtopic.php?p=21560#21560
please re-test

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2119 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 21:23:49 +00:00
orbiter
e656a00b74 removed some unused methods 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2118 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 21:17:42 +00:00
auron_x
232ab7902b *)catched Null-Pointer-Exception 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2117 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 15:18:50 +00:00
orbiter
82b2bc6932 patch for index-transfer DoS problem 
see http://www.yacy-forum.de/viewtopic.php?p=21627#21627
note that this function will make the index-transfer functionality void

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2114 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-18 22:24:51 +00:00
hermens
df7e1d9df3 Changes to plasmaURL and subclasses: 
- Improve performance of plasmaURL.exists() by remembering URL-hashes that are not present
- Use a more realistic estimation of memory usage by the existsIndex cache
- Routine cleanup of the existsIndex to limit its memory usage



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2113 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-17 13:08:57 +00:00
orbiter
a474669338 start with refactoring of index management 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2110 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-16 16:11:55 +00:00
orbiter
338047e056 replaced kelondroDyn write methods for properties and maps by faster version 
this affects news, robots?, bookmarks?, blogs, the wiki, seed-db, news etc.
this all should create less IO

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2107 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 22:37:02 +00:00
orbiter
b40f0edbe5 replaced property- and map-reader in AbstractRA by much faster version 
this has very strong effects of to all methods that read maps
from kelondroDyn databases, i.e. news, seeds (bookmarks?)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2106 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 22:13:45 +00:00
orbiter
7f28a1a4cb another fix in kelondroDyn: construction of getDyn chunks was not clean 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2105 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 22:06:44 +00:00
orbiter
bb931c7b83 fix for some improper details in kelondroDyn 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2104 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 21:50:22 +00:00
orbiter
19c6e67003 - added generation of news for blog entries 
- added display of blog banner in Network view
- extended lifetime of blog, wiki and crawl news

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2102 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 20:48:39 +00:00
rramthun
f08e33680c Added Blog-news-symbol as requested. 
I think I will change the character distance a little bit later.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2101 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 15:42:06 +00:00
theli
b4ab183518 *) Bugfix for NullpointerException if the seeds IP could not be resolved 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2099 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 10:50:10 +00:00
theli
f331def5d8 *) Bugfix for distribution. Incorrect behavior if peerCount == selectedCount 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2098 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 10:03:24 +00:00
theli
cea6e416d9 *) wrong name in header 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2097 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 09:52:22 +00:00
theli
df068cf23c *) adding first version of native SSL support for yacy 
VERY EXPERIMENTAL!
   See: http://www.yacy-forum.de/viewtopic.php?p=18516

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2096 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 09:41:29 +00:00
auron_x
55ea4cbfe6 *)reverted patch for memory-display issue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2095 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-14 18:09:28 +00:00
theli
5048b05bc6 *) Index Transfer should only restart at the beginning if the delete 
option is configured. Otherwise we have an endless loop

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2092 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-14 13:27:50 +00:00
auron_x
53d9ab6db7 *)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers 
see http://www.yacy-forum.de/viewtopic.php?t=2370

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2091 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-14 08:42:41 +00:00
theli
ddfe0f0e27 *) don't try to parse referer string if it's null 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2090 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-13 15:45:04 +00:00
theli
bcc950c533 *) Bugfix for Index Transfer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2088 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-13 15:28:57 +00:00
allo
99110e6fd2 Fixed some of the copyright headers. 
Please add yourself, if you contributed to these files, and i forgot you. ;-)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2086 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-12 14:35:56 +00:00
allo
a1ba7fab69 bugfix for proxy users 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2085 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-11 20:26:34 +00:00
orbiter
d4b4812732 extended kelondroDyn with new objectBuffer 
(there was a buffer inside some commits before, which has
 been removed and is now replaced by this new one)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2084 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-11 15:42:46 +00:00
auron_x
586b256627 *)fixed Blog-bug with german Umlaute 
*)corrected wrong html in blog
see http://www.yacy-forum.de/viewtopic.php?t=2330

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2083 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-11 14:03:15 +00:00
allo
9938c252dd better Errorhandling for proxyAccounts 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2082 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-11 13:12:35 +00:00
orbiter
35995cf8c7 some enhancements to caching and kelondroRA-methods 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2081 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 21:36:44 +00:00
orbiter
2e89477f22 undoing last change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2080 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 16:48:49 +00:00
orbiter
a3a4525931 usage of a buffer to prevent too many cache lookups in kelondroMap 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2079 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 16:41:42 +00:00
orbiter
015d044c25 tried to fix some problems with latest changes to httpc 
very experimental!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2078 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 16:01:14 +00:00
orbiter
55c5b41bd0 modified kelondroDyn to work better with new object caches 
(removed own single object cache)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2077 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 13:57:31 +00:00
orbiter
26e3216bcc update to profile fetch behavior 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2076 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 09:37:18 +00:00
orbiter
3e31820c3d - corrections to PerformanceMemory display of object cache 
- configuration of object cache size in kelondroTree initializer

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2075 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 09:08:42 +00:00
orbiter
fd7c17e624 added virtual host support: 
all yacy-to-yacy communication now send the <peer-hexhash>.yacyh
virtual domain inside the http 'Host' property field.
This shall enable running a yacy peer on a virtual host.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2074 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-09 13:11:00 +00:00
orbiter
461548698c configuration of index transfer chunk size 
see http://www.yacy-forum.de/viewtopic.php?p=20951#20951
new properties in yacy.init:
indexDistribution.minChunkSize = 5
indexDistribution.maxChunkSize = 1000
indexDistribution.startChunkSize = 50

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2073 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-09 11:43:10 +00:00
orbiter
29b1b0823c added monitoring of new object cache to performanceMemory page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2072 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-09 10:03:12 +00:00
orbiter
23ced30e83 fixed a bug in new caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2071 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-08 21:29:28 +00:00
low012
35f9418117 Fixed links and images. (http://www.yacy-forum.de/viewtopic.php?p=20908#20908) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2070 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-08 14:23:22 +00:00
orbiter
bab9ee38e7 added very experimental object cache for all kelondroTree 
databases. This cache now takes up 10% of all cache sizes,
90% goes to the node routing cache we had so far.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2069 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-08 13:37:27 +00:00
theli
9104001e7c *) Better error handling for assortment import 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2067 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-08 07:58:22 +00:00
low012
d40ccc5208 *) Partly undoing last commit\n*) Fixed bug that caused attributes of cells in tables not to be recognized as such. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2066 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-07 22:53:17 +00:00
low012
adcad5eae6 *) Fixed a bug that prevented the usage of tables in the wiki. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2065 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-07 18:15:00 +00:00
hermens
51e3bb576f Don't increase dhtTransferIndexCount when the last transferred index was smaller 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2064 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-07 17:44:33 +00:00
low012
152745b145 *) Added some characters and their HTML-codes. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2060 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-06 00:23:29 +00:00
hermens
a0ca4c5fb8 Remove a possible race condition between DHT transfer and deQueue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2059 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-05 13:17:00 +00:00
hermens
0cfba8950f Removing unnecessary and possibly dangerous synchronization of the wordIndex 
when deleting transferred indexes



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2058 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-05 12:48:17 +00:00
orbiter
fe4ad214f1 configuration of time-out for fetching seed-lists during bootstraping 
(weil das beim linuxtag nur auf meinem Notebook nicht funtioniert)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2054 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-03 21:27:30 +00:00
allo
1179c9ffff fix for the bookmark error. 
fixes: http://www.yacy-forum.de/viewtopic.php?t=2274

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2043 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-28 17:50:05 +00:00
orbiter
d6213f8a85 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19482#19482 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2042 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-25 15:35:25 +00:00
orbiter
e9aadb2e11 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19765#19765 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2041 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-25 15:21:17 +00:00
theli
727aac4768 *) Bugfix for Transparent-Proxy-Support <-> Port Forwarding problem 
See: http://www.yacy-forum.de/viewtopic.php?p=20358

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2039 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-25 05:29:20 +00:00
theli
cd4aeffea2 *) Bugfix: httpdFileHandler.java did not handle filenames with encoded chars correctly 
See: http://www.yacy-forum.de/viewtopic.php?t=2265

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2036 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-23 11:01:31 +00:00
theli
a10072b5c0 *) Adding timeout to ftpc.java 
See: http://www.yacy-forum.de/viewtopic.php?t=2268
   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2035 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-23 10:35:46 +00:00
theli
76ea16a6cb *) Removing Keep-Alive header (is also a hopByHop header) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2034 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-22 15:00:35 +00:00
orbiter
b0036249c1 added some attributes to network picture 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2032 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-21 21:21:35 +00:00
hermens
cbcf7418ef Cleanup synchronization in plasmaWordIndex 
-  only synchronize when changing data in more than one database
see: http://www.yacy-forum.de/viewtopic.php?t=2167



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2031 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-20 14:00:47 +00:00
orbiter
60e5aff9fc some enhancements to the remote crawl trigger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2030 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-20 11:53:15 +00:00
orbiter
dbe96e6541 added hand-over of search filter and prefer ranking to yacy protocol 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2029 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-20 10:15:00 +00:00
hydrox
49f3b56526 *) URLCache in minizimeURLDB can be changed now (standart is 4mb) 
*) moved Exception Stackprints to loggingengine

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2028 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-20 08:20:12 +00:00
rramthun
0604203bce Updated and corrected German language file 
Changed Italian language file for an Italian/English interface and not Italian/German

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2024 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-18 11:37:03 +00:00
low012
4639c0ac6d *) cleaned up code 
*) fixed a bug where a line like <pre><pre>text</pre></pre><pre>text</pre> caused an exception
*) fixed a bug where a line like [=[=text=]=][=text=] caused an exception


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2023 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-17 19:37:09 +00:00
orbiter
00a5d435e2 - fixed some bugs with domain filter 
- added new ranking filter "prefermask": urls that match the filter are ranked better


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2022 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-13 23:19:36 +00:00
orbiter
14d6e476c9 tried to solve some problems with new picture viewer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2019 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-10 22:34:47 +00:00
low012
23cdf319be *) cleaning up code 
*) fixed a bug concerning [= =] and <pre></pre> in tables


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2018 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-10 22:04:52 +00:00
orbiter
9324425165 fix for remote crawl reject 
see http://www.yacy-forum.de/viewtopic.php?p=20075#20075

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2017 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-10 21:34:17 +00:00
borg-0300
30e4fc39a5 HTCache extended 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2015 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-08 13:05:04 +00:00
orbiter
d0dd8b14d2 fixed picture tag and presentation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2014 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-07 22:09:59 +00:00
borg-0300
da6a8bafa2 rename currCacheSize -> curCacheSize; 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2010 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-07 13:15:15 +00:00
borg-0300
92110aea32 nullpointer fix for profile(); other minor change; 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2009 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-07 12:43:59 +00:00