Commit Graph

1399 Commits

Author SHA1 Message Date
orbiter
4cc6e6551f bugfix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2245 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-26 09:52:23 +00:00
orbiter
66964dc015 removed high/med/low from kelondroRecords cache control.
this was done because testing showed that cache-delete operations
slowed down record access most, even more that actual IO operations.
Cache-delete operations appeared when entries were shifted from low-priority
positions to high-priority positions. During a fill of x entries to a database,
x/2 delete situation happen which caused two or more delete operations.
removing the cache control means that these delete operations are not
necessary any more, but it is more difficult to decide which cache elements
shall be removed in case that the cache is full. There is not yet a stable
solution for this case, but the advantage of a faster cache is more important
that the flush problem.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2244 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-25 10:31:38 +00:00
allo
6866bc2758 be quiet!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2243 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-24 17:40:55 +00:00
borg-0300
4c6083b264 network picture;
back to old version

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2242 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-24 02:52:24 +00:00
borg-0300
955915385a network picture;
small changes;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2241 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-23 15:37:59 +00:00
borg-0300
027fa8ab1c network picture;
bigger; 
more dot steps; 
small other;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2240 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-23 13:53:29 +00:00
orbiter
41c4641612 added some profiling to kelondro caching classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2239 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-23 12:49:42 +00:00
orbiter
dd560e4b2f finetuning
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2238 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-22 23:11:40 +00:00
orbiter
5b1d77cd4b some enhancements to caching
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2236 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-22 15:42:09 +00:00
theli
b20496e42b *) make DHT DoS check configurable (requested by KoH)
- check can be disabled via property indexDistribution.dhtReceiptLimitEnabled
   - upper bound can be configured via indexDistribution.dhtReceiptLimit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2234 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-21 19:28:42 +00:00
orbiter
650c7e9e55 some enhancements to caching
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2233 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-21 16:05:31 +00:00
hermens
d4645062bc Correct usage of vhost in wget/wput requests:
- yacyClient: don't use own .yacyh domain in requests, instead use .yacyh domain of target peer for everything but ranking distribution
- natLib: use full hostname instead of just SLD.TLD



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2232 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-21 14:25:27 +00:00
orbiter
bde748f68f - integrated buffer in RowCollectionSet which speeds up the new
cache by factor 3. (but the new cache was 5 times slower than the
old cache...)
- removed old unused code


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2231 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-21 14:16:34 +00:00
orbiter
d083b15c4b tests/fixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2226 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-20 23:47:51 +00:00
orbiter
ce9a98ee25 experiments with buffer for collection class
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2225 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-20 23:18:41 +00:00
orbiter
6aa0f6eb0f better abstraction, less synchronization
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2224 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-20 22:13:17 +00:00
orbiter
1ec07fe351 better structure of the kelondro collection classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2223 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-20 21:41:12 +00:00
allo
c264cda678 support to parse gettext files and to generate updated files, where only the new strings are empty.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2222 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-20 18:52:17 +00:00
orbiter
761d3bba54 integrated kelondroRowCollection in kelondroCollectionIndex
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2221 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-20 14:46:28 +00:00
orbiter
8f0c1a240a added kelondroRowCollection and kelondroRowSet which
shall replace kelondroCollection

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2220 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-20 14:17:21 +00:00
theli
ed2cb040d1 *) Bugfix for http connection header validation
- Connection header was not handled correctly if it contains
     multiple values, e.g. Connection: TE, close 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2219 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-20 05:22:55 +00:00
allo
f95c006dc2 generation of empty gettext files from yacy html-files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2218 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-19 19:34:00 +00:00
orbiter
4fa3271754 adopted memory calculation to new memory amount used by kelondroCollectionObjectMap
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2215 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-18 12:16:56 +00:00
allo
0621106ef3 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2214 6c8d7289-2bf4-0310-a012-ef5d649a1542 2006-06-18 12:15:26 +00:00
orbiter
11951aed41 replaced node cache Object type in kelondroTree:
kelondroCollectionObjectMap replaces HashMap.
the kelondroCollectionObjectMap uses only 1/4 of the memory of HashMap,
but is slightly slower than the HashMap.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2213 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-18 12:04:41 +00:00
orbiter
12af69dd86 cosmetics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2212 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-18 11:49:31 +00:00
orbiter
ea72a7c580 added new objectMap (can replace HashMap and should use less memory, but is slower)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2211 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-18 11:33:26 +00:00
allo
67a8c74be3 Fix for dynamic login with static password.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2210 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-18 08:04:51 +00:00
allo
ef9eb50c3c fix for adminlogin
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2209 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-17 11:15:16 +00:00
allo
6fe2fed87e cookieauth works with static Admin.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2208 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-16 08:04:02 +00:00
theli
45b39ee1be *) solving unpacking problems with to long filename by
a) renaming the parent folder in the tgz file to yacy
      (can be configured via build properties file)
   b) reconfiguring build file to throw an error if a file
      name is too long 
Please note that currently there is _no_ proplem with too long
class names because of step a.

      

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2207 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-14 15:18:41 +00:00
theli
fb090652df *) use a more compact for plasmaWordIndexAssortmentImporter.java because the long name
caused problems during untar operation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2206 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-14 14:28:46 +00:00
theli
4ca0857c0c *) Index transfer now considers the pause time send by busy peers during
index transfer / index distribution
   See: http://www.yacy-forum.de/viewtopic.php?p=22647#22491

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2205 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-14 09:40:42 +00:00
orbiter
e8848a3532 bugfixing for new kelondroFlexTable
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2204 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-13 15:05:11 +00:00
allo
b23703f260 using cookieAuth.
logout for httpauth seems to be broken :-(

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2202 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-12 16:16:13 +00:00
allo
7f51a43cba disabled ipAuth for _p Pages (and broken Form-Login :-() for security reasons
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2201 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-12 14:18:38 +00:00
allo
bd22634c44 HTML-login, logout fixed.
TODO: If you login with the form, then logout with the form, and then try to login with httpauth, the first try will fail.
(should logged_out be resettet in ipAuth? but if there is ipAuth before proxyAuth, the logout would be broken. Maybe a combined method can help.)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2200 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-12 13:47:44 +00:00
hermens
3f1ebc097e Limit the size of the DNS cache to 5000 and the age of the entries to one day.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2199 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-12 12:14:11 +00:00
allo
d7a3fdb18b no white pages, when clicking cancel on the password-dialog
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2198 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-12 12:12:21 +00:00
allo
ec36174b7f Form-Login works now.
For _p Pages is httpauth still needed.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2194 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-11 08:59:02 +00:00
allo
11123416f3 Form-Login function.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2193 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-10 21:03:33 +00:00
allo
bd13bd78ad Bugfix for broken Tags
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2192 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-10 17:41:59 +00:00
orbiter
75ed507d39 some debugging of new kelondroFlexTable class
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2190 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-09 12:52:57 +00:00
orbiter
8a18302e84 some work on the intMap
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2186 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-07 23:00:26 +00:00
orbiter
56084e9edc added a intMap, the new index management structure for kelondroFlexTables
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2185 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-07 22:28:21 +00:00
orbiter
e374add8cb added html tag 'area' to html parser
see http://www.yacy-forum.de/viewtopic.php?p=22540#22540

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2184 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-07 20:03:44 +00:00
orbiter
eda055e729 - enhanced kelondroCollection speed
- tested + debugged kelondroCollection
- inserted the new kelondroCollection Object as indexing class for kelondroFlexTable

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2183 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-07 15:40:29 +00:00
orbiter
5d2cd26529 enhanced kelondroCollection performance
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2182 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-06 22:48:31 +00:00
rramthun
5625937d1c Language improvements
One very minor  HTML fix

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2181 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-06 16:30:32 +00:00
orbiter
577a6e6487 some work on kelondroCollection, no effect on current YaCy functions
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2180 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-06-06 15:01:01 +00:00