Commit Graph

2105 Commits

Author SHA1 Message Date
orbiter
b40f0edbe5 replaced property- and map-reader in AbstractRA by much faster version
this has very strong effects of to all methods that read maps
from kelondroDyn databases, i.e. news, seeds (bookmarks?)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2106 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-15 22:13:45 +00:00
orbiter
7f28a1a4cb another fix in kelondroDyn: construction of getDyn chunks was not clean
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2105 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-15 22:06:44 +00:00
orbiter
bb931c7b83 fix for some improper details in kelondroDyn
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2104 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-15 21:50:22 +00:00
orbiter
20958acfd8 - fix for display problem for new blog news banner
- created 'real' ip-based links instead of '.yacy'-links

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2103 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-15 21:45:26 +00:00
orbiter
19c6e67003 - added generation of news for blog entries
- added display of blog banner in Network view
- extended lifetime of blog, wiki and crawl news

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2102 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-15 20:48:39 +00:00
rramthun
f08e33680c Added Blog-news-symbol as requested.
I think I will change the character distance a little bit later.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2101 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-15 15:42:06 +00:00
theli
b4ab183518 *) Bugfix for NullpointerException if the seeds IP could not be resolved
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2099 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-15 10:50:10 +00:00
theli
f331def5d8 *) Bugfix for distribution. Incorrect behavior if peerCount == selectedCount
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2098 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-15 10:03:24 +00:00
theli
cea6e416d9 *) wrong name in header
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2097 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-15 09:52:22 +00:00
theli
df068cf23c *) adding first version of native SSL support for yacy
VERY EXPERIMENTAL!
   See: http://www.yacy-forum.de/viewtopic.php?p=18516

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2096 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-15 09:41:29 +00:00
auron_x
55ea4cbfe6 *)reverted patch for memory-display issue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2095 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-14 18:09:28 +00:00
orbiter
0c2cbc572b reverted a change to idle/busy time default setting.
There was a misunderstanding of the meaning of these values:
this is not the time that the process may take, instead it is the time
that the proces pauses after each loop.
increased the busysleep time pause from 2 seconds to 10 seconds.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2094 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-14 17:59:11 +00:00
orbiter
ba9798dcb7 better fix for
http://www.yacy-forum.de/viewtopic.php?t=2370

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2093 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-14 17:19:43 +00:00
theli
5048b05bc6 *) Index Transfer should only restart at the beginning if the delete
option is configured. Otherwise we have an endless loop

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2092 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-14 13:27:50 +00:00
auron_x
53d9ab6db7 *)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers
see http://www.yacy-forum.de/viewtopic.php?t=2370

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2091 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-14 08:42:41 +00:00
theli
ddfe0f0e27 *) don't try to parse referer string if it's null
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2090 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-13 15:45:04 +00:00
theli
9c5ec2c8db *) fix for broken html on IndexTransfer_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2089 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-13 15:43:00 +00:00
theli
bcc950c533 *) Bugfix for Index Transfer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2088 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-13 15:28:57 +00:00
rramthun
fb064fdbee Many additions/corrections to the German language file
Increased default time for DHT distribution, because many people complained about the high load on their systems, see http://www.yacy-forum.de/viewtopic.php?p=20922#20922

Avoided problems with some browsers and ampersands, see http://www.htmlhelp.com/tools/validator/problems.html#amp

Removed nearly invisible "bug" in menu

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2087 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-12 21:25:46 +00:00
allo
99110e6fd2 Fixed some of the copyright headers.
Please add yourself, if you contributed to these files, and i forgot you. ;-)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2086 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-12 14:35:56 +00:00
allo
a1ba7fab69 bugfix for proxy users
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2085 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-11 20:26:34 +00:00
orbiter
d4b4812732 extended kelondroDyn with new objectBuffer
(there was a buffer inside some commits before, which has
 been removed and is now replaced by this new one)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2084 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-11 15:42:46 +00:00
auron_x
586b256627 *)fixed Blog-bug with german Umlaute
*)corrected wrong html in blog
see http://www.yacy-forum.de/viewtopic.php?t=2330

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2083 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-11 14:03:15 +00:00
allo
9938c252dd better Errorhandling for proxyAccounts
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2082 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-11 13:12:35 +00:00
orbiter
35995cf8c7 some enhancements to caching and kelondroRA-methods
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2081 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-10 21:36:44 +00:00
orbiter
2e89477f22 undoing last change
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2080 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-10 16:48:49 +00:00
orbiter
a3a4525931 usage of a buffer to prevent too many cache lookups in kelondroMap
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2079 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-10 16:41:42 +00:00
orbiter
015d044c25 tried to fix some problems with latest changes to httpc
very experimental!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2078 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-10 16:01:14 +00:00
orbiter
55c5b41bd0 modified kelondroDyn to work better with new object caches
(removed own single object cache)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2077 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-10 13:57:31 +00:00
orbiter
26e3216bcc update to profile fetch behavior
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2076 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-10 09:37:18 +00:00
orbiter
3e31820c3d - corrections to PerformanceMemory display of object cache
- configuration of object cache size in kelondroTree initializer

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2075 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-10 09:08:42 +00:00
orbiter
fd7c17e624 added virtual host support:
all yacy-to-yacy communication now send the <peer-hexhash>.yacyh
virtual domain inside the http 'Host' property field.
This shall enable running a yacy peer on a virtual host.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2074 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-09 13:11:00 +00:00
orbiter
461548698c configuration of index transfer chunk size
see http://www.yacy-forum.de/viewtopic.php?p=20951#20951
new properties in yacy.init:
indexDistribution.minChunkSize = 5
indexDistribution.maxChunkSize = 1000
indexDistribution.startChunkSize = 50

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2073 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-09 11:43:10 +00:00
orbiter
29b1b0823c added monitoring of new object cache to performanceMemory page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2072 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-09 10:03:12 +00:00
orbiter
23ced30e83 fixed a bug in new caching
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2071 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-08 21:29:28 +00:00
low012
35f9418117 Fixed links and images. (http://www.yacy-forum.de/viewtopic.php?p=20908#20908)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2070 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-08 14:23:22 +00:00
orbiter
bab9ee38e7 added very experimental object cache for all kelondroTree
databases. This cache now takes up 10% of all cache sizes,
90% goes to the node routing cache we had so far.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2069 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-08 13:37:27 +00:00
theli
0dfef19559 *) build file now automatically builds the
yacybar xpi file (if the yacybar sources are located in yacy/yacybar)
   and copies the xpi file into the add on directory
*) Bugfix for http://www.yacy-forum.de/viewtopic.php?p=17852


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2068 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-08 11:16:45 +00:00
theli
9104001e7c *) Better error handling for assortment import
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2067 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-08 07:58:22 +00:00
low012
d40ccc5208 *) Partly undoing last commit\n*) Fixed bug that caused attributes of cells in tables not to be recognized as such.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2066 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-07 22:53:17 +00:00
low012
adcad5eae6 *) Fixed a bug that prevented the usage of tables in the wiki.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2065 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-07 18:15:00 +00:00
hermens
51e3bb576f Don't increase dhtTransferIndexCount when the last transferred index was smaller
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2064 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-07 17:44:33 +00:00
orbiter
c67125d8d3 better default values for queue times to prevent (D)DoS-similar situations
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2062 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-06 20:34:09 +00:00
low012
465319caf3 *) HTML-Tags in headlines and author names were not filtered.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2061 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-06 00:47:16 +00:00
low012
152745b145 *) Added some characters and their HTML-codes.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2060 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-06 00:23:29 +00:00
hermens
a0ca4c5fb8 Remove a possible race condition between DHT transfer and deQueue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2059 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-05 13:17:00 +00:00
hermens
0cfba8950f Removing unnecessary and possibly dangerous synchronization of the wordIndex
when deleting transferred indexes



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2058 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-05 12:48:17 +00:00
allo
799c04091d Bugfix for Spam-Bug (Header manipulation)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2057 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-04 16:41:30 +00:00
low012
97c6a70b71 *) Fixed XSS vulnerability. I was able to crawl a PDF that caused the loading of an image in the admin's browser.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2056 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-04 16:07:35 +00:00
orbiter
94e488a7f7 documentation update (talk paper uploaded)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2055 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-03 22:08:18 +00:00