Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,017 Commits 1 Branch 20 Tags 836 MiB
e656a00b74
Commit Graph

1304 Commits

Author SHA1 Message Date
orbiter
e656a00b74 removed some unused methods 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2118 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 21:17:42 +00:00
auron_x
232ab7902b *)catched Null-Pointer-Exception 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2117 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 15:18:50 +00:00
orbiter
82b2bc6932 patch for index-transfer DoS problem 
see http://www.yacy-forum.de/viewtopic.php?p=21627#21627
note that this function will make the index-transfer functionality void

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2114 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-18 22:24:51 +00:00
hermens
df7e1d9df3 Changes to plasmaURL and subclasses: 
- Improve performance of plasmaURL.exists() by remembering URL-hashes that are not present
- Use a more realistic estimation of memory usage by the existsIndex cache
- Routine cleanup of the existsIndex to limit its memory usage



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2113 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-17 13:08:57 +00:00
orbiter
a474669338 start with refactoring of index management 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2110 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-16 16:11:55 +00:00
orbiter
338047e056 replaced kelondroDyn write methods for properties and maps by faster version 
this affects news, robots?, bookmarks?, blogs, the wiki, seed-db, news etc.
this all should create less IO

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2107 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 22:37:02 +00:00
orbiter
b40f0edbe5 replaced property- and map-reader in AbstractRA by much faster version 
this has very strong effects of to all methods that read maps
from kelondroDyn databases, i.e. news, seeds (bookmarks?)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2106 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 22:13:45 +00:00
orbiter
7f28a1a4cb another fix in kelondroDyn: construction of getDyn chunks was not clean 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2105 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 22:06:44 +00:00
orbiter
bb931c7b83 fix for some improper details in kelondroDyn 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2104 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 21:50:22 +00:00
orbiter
19c6e67003 - added generation of news for blog entries 
- added display of blog banner in Network view
- extended lifetime of blog, wiki and crawl news

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2102 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 20:48:39 +00:00
rramthun
f08e33680c Added Blog-news-symbol as requested. 
I think I will change the character distance a little bit later.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2101 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 15:42:06 +00:00
theli
b4ab183518 *) Bugfix for NullpointerException if the seeds IP could not be resolved 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2099 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 10:50:10 +00:00
theli
f331def5d8 *) Bugfix for distribution. Incorrect behavior if peerCount == selectedCount 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2098 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 10:03:24 +00:00
theli
cea6e416d9 *) wrong name in header 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2097 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 09:52:22 +00:00
theli
df068cf23c *) adding first version of native SSL support for yacy 
VERY EXPERIMENTAL!
   See: http://www.yacy-forum.de/viewtopic.php?p=18516

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2096 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 09:41:29 +00:00
auron_x
55ea4cbfe6 *)reverted patch for memory-display issue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2095 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-14 18:09:28 +00:00
theli
5048b05bc6 *) Index Transfer should only restart at the beginning if the delete 
option is configured. Otherwise we have an endless loop

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2092 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-14 13:27:50 +00:00
auron_x
53d9ab6db7 *)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers 
see http://www.yacy-forum.de/viewtopic.php?t=2370

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2091 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-14 08:42:41 +00:00
theli
ddfe0f0e27 *) don't try to parse referer string if it's null 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2090 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-13 15:45:04 +00:00
theli
bcc950c533 *) Bugfix for Index Transfer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2088 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-13 15:28:57 +00:00
allo
99110e6fd2 Fixed some of the copyright headers. 
Please add yourself, if you contributed to these files, and i forgot you. ;-)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2086 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-12 14:35:56 +00:00
allo
a1ba7fab69 bugfix for proxy users 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2085 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-11 20:26:34 +00:00
orbiter
d4b4812732 extended kelondroDyn with new objectBuffer 
(there was a buffer inside some commits before, which has
 been removed and is now replaced by this new one)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2084 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-11 15:42:46 +00:00
auron_x
586b256627 *)fixed Blog-bug with german Umlaute 
*)corrected wrong html in blog
see http://www.yacy-forum.de/viewtopic.php?t=2330

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2083 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-11 14:03:15 +00:00
allo
9938c252dd better Errorhandling for proxyAccounts 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2082 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-11 13:12:35 +00:00
orbiter
35995cf8c7 some enhancements to caching and kelondroRA-methods 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2081 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 21:36:44 +00:00
orbiter
2e89477f22 undoing last change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2080 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 16:48:49 +00:00
orbiter
a3a4525931 usage of a buffer to prevent too many cache lookups in kelondroMap 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2079 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 16:41:42 +00:00
orbiter
015d044c25 tried to fix some problems with latest changes to httpc 
very experimental!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2078 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 16:01:14 +00:00
orbiter
55c5b41bd0 modified kelondroDyn to work better with new object caches 
(removed own single object cache)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2077 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 13:57:31 +00:00
orbiter
26e3216bcc update to profile fetch behavior 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2076 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 09:37:18 +00:00
orbiter
3e31820c3d - corrections to PerformanceMemory display of object cache 
- configuration of object cache size in kelondroTree initializer

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2075 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 09:08:42 +00:00
orbiter
fd7c17e624 added virtual host support: 
all yacy-to-yacy communication now send the <peer-hexhash>.yacyh
virtual domain inside the http 'Host' property field.
This shall enable running a yacy peer on a virtual host.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2074 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-09 13:11:00 +00:00
orbiter
461548698c configuration of index transfer chunk size 
see http://www.yacy-forum.de/viewtopic.php?p=20951#20951
new properties in yacy.init:
indexDistribution.minChunkSize = 5
indexDistribution.maxChunkSize = 1000
indexDistribution.startChunkSize = 50

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2073 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-09 11:43:10 +00:00
orbiter
29b1b0823c added monitoring of new object cache to performanceMemory page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2072 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-09 10:03:12 +00:00
orbiter
23ced30e83 fixed a bug in new caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2071 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-08 21:29:28 +00:00
low012
35f9418117 Fixed links and images. (http://www.yacy-forum.de/viewtopic.php?p=20908#20908) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2070 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-08 14:23:22 +00:00
orbiter
bab9ee38e7 added very experimental object cache for all kelondroTree 
databases. This cache now takes up 10% of all cache sizes,
90% goes to the node routing cache we had so far.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2069 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-08 13:37:27 +00:00
theli
9104001e7c *) Better error handling for assortment import 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2067 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-08 07:58:22 +00:00
low012
d40ccc5208 *) Partly undoing last commit\n*) Fixed bug that caused attributes of cells in tables not to be recognized as such. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2066 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-07 22:53:17 +00:00
low012
adcad5eae6 *) Fixed a bug that prevented the usage of tables in the wiki. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2065 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-07 18:15:00 +00:00
hermens
51e3bb576f Don't increase dhtTransferIndexCount when the last transferred index was smaller 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2064 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-07 17:44:33 +00:00
low012
152745b145 *) Added some characters and their HTML-codes. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2060 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-06 00:23:29 +00:00
hermens
a0ca4c5fb8 Remove a possible race condition between DHT transfer and deQueue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2059 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-05 13:17:00 +00:00
hermens
0cfba8950f Removing unnecessary and possibly dangerous synchronization of the wordIndex 
when deleting transferred indexes



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2058 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-05 12:48:17 +00:00
orbiter
fe4ad214f1 configuration of time-out for fetching seed-lists during bootstraping 
(weil das beim linuxtag nur auf meinem Notebook nicht funtioniert)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2054 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-03 21:27:30 +00:00
allo
1179c9ffff fix for the bookmark error. 
fixes: http://www.yacy-forum.de/viewtopic.php?t=2274

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2043 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-28 17:50:05 +00:00
orbiter
d6213f8a85 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19482#19482 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2042 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-25 15:35:25 +00:00
orbiter
e9aadb2e11 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19765#19765 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2041 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-25 15:21:17 +00:00
theli
727aac4768 *) Bugfix for Transparent-Proxy-Support <-> Port Forwarding problem 
See: http://www.yacy-forum.de/viewtopic.php?p=20358

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2039 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-25 05:29:20 +00:00