Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,967 Commits 1 Branch 20 Tags 836 MiB
1778fb420d
Commit Graph

4967 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
orbiter
1778fb420d - added some performance tweaks to the new BLOB buffer 
- removed the now superfluous HT storage thread
- reduced number of file decompression by shifting the compression moment to the future


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5286 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-19 18:10:42 +00:00
low012
77e41da7d2 *) further propagation of display value (see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1536) 
*) removed another depreciated parameter "time" which led to ugly -UNRESOLVED_PATTERN- in URL

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5285 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-18 19:39:46 +00:00
orbiter
9663e61449 added another class to handle BLOB writings to the new HTCACHE data storage: 
- entries are buffered and written as stream with many entries at once (saves many IO accesses)
- entries are compressed with gzip: increases capacity of cache
- concurrency for stream-writing and compression: all writings to the cache are non-blocking

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5284 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-18 08:57:48 +00:00
low012
ff46ce8520 *) fixed display=2 (see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1536) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5283 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-17 19:57:39 +00:00
orbiter
382226da94 fix for bug introduced in SVN 5281: parameters were switched 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5282 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-17 12:14:57 +00:00
danielr
f2fd043797 refactoring (moved duplicate code into methods) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5281 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-17 10:39:32 +00:00
danielr
c612046e5e r5278 java 1.5 compatible 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5280 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-17 09:59:59 +00:00
f1ori
af71ec93bf ops, forgot to import something 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5279 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-16 22:44:25 +00:00
f1ori
9e65e9141c * always use UTF-8 for encoding hashes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5278 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-16 22:35:27 +00:00
f1ori
03d2b323c2 * remove bad mimetype tag so I see my changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5277 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-16 22:31:38 +00:00
orbiter
826ca79735 refactoring and new architecture to store the files of the web cache: 
- files are not stored any more as individual files
- a new database structure using BLOBHeap files stores many cache entries in common files
- all file-writing procedures had been migrated to generate byte[] objects which are written with the new database methods

this is only an intermediate step to the final architecture, where cached files are written together with their metadata in one single database structure.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5276 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-16 21:24:09 +00:00
low012
2b18a9b2c4 *) removed depreciated parameter "time" which led to ugly -UNRESOLVED_PATTERN- in URL 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5275 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-16 19:31:29 +00:00
danielr
f095137238 - respecting httpdMaxBusySessions (refusing new connections if limit is hit) 
- comments in serverBusyThread converted to JavaDoc
- better debug output for npe-case in diskUsage


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5274 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-16 10:53:32 +00:00
danielr
94e43ece41 unter debian yacy als (fast) letztes starten und erstes beenden 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5271 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-14 21:53:25 +00:00
f1ori
9d69964d3d start daemon in different runlevels on debian and fedora/openSUSE-Systems 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5270 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-14 15:28:24 +00:00
orbiter
8ba33f104e fix for npe 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5269 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-13 21:59:53 +00:00
orbiter
998861acfd - some refactoring in BLOBHeap to enable more gap processing functions 
- better gap merging in BLOBHeap
- shrinking of heap file if gap is at end of file when file is closed

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5268 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-13 21:15:54 +00:00
lotus
9d50bfd0b3 fix for npe: http://forum.yacy-websuche.de/viewtopic.php?p=10562 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5267 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-13 09:09:53 +00:00
orbiter
766cad6e93 enhancement in memory management of BLOB Heap files / merging of deleted entries 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5266 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-12 22:15:01 +00:00
orbiter
7860d5d632 fix for bug in seed list management (cause was bad class overloading, only visual effects!) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5265 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-12 19:51:53 +00:00
lotus
603282bcf4 fix for out of bounds exception 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5264 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-11 07:47:34 +00:00
orbiter
ffed5fc415 fixed problem with lost peers in database 
migrated seedDB from BLOBTree to BLOBHeap

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5263 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-10 14:40:02 +00:00
orbiter
6fb865fbdc - fix of bug in iterator in kelondroBLOBHeap which caused bug in crawl profile listing 
- some refactoring of classes that use kelondroMap (Map instead of HashMap)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5262 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-10 08:39:11 +00:00
orbiter
2d65887723 - fix for bug in new profile handling 
- added a new feature in ymageChart (cannot be seen yet, just wait... will be used in profiling chart)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5261 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-09 22:31:43 +00:00
lotus
4df63626f5 sorry 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5260 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-09 13:51:43 +00:00
lotus
736dd86193 - option enableSimpleConfig can disable hidden tables 
- corrected some Xmx values
- friendlier welcome message format

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5259 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-09 12:48:43 +00:00
orbiter
ff68f394dd fix for problem with balancer and lost crawl profiles: 
if crawl profile ist lost, no robots.txt is loaded any more

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5258 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-08 18:26:36 +00:00
f1ori
d197a62faf * wrong default parameter in initscript 
* should fix http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1500


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5257 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-08 10:54:25 +00:00
danielr
f0c7166a48 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1505 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5256 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-08 09:48:04 +00:00
f1ori
88fdd4c4f2 * remove unix wrappers from installonlinux-target, because they are useless on systemwide installations 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5255 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-05 22:13:09 +00:00
daburna
9286afad4e new development cycle - nun aber wirklich :-P 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5254 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-05 22:08:14 +00:00
f1ori
ed51ccf725 * correct error message 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5253 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-05 21:34:13 +00:00
low012
fe6142a6ab *) ...and even more languages. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5252 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-05 20:20:21 +00:00
apfelmaennchen
3717d2057a YaCy-UI: fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1483 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5251 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-05 18:50:43 +00:00
low012
9f0cc3afdd *) more languages 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5250 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-05 12:28:40 +00:00
low012
e96a3d0472 *) added statistics for a few languages: Czech, Esperanto, Irish, Turkish 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5249 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-05 10:07:22 +00:00
lotus
fb8d9850ea fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1462 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5248 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-05 10:03:02 +00:00
lotus
0d1a2f6183 fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1461 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5247 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-04 12:36:11 +00:00
orbiter
d0bdcdd57c small changes to attributes of DoS attack protection parameters 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5246 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-03 19:44:42 +00:00
orbiter
9ac16f565b - fixed several bugs in database management functions 
- fixed a display bug for the performance graph
- fixed deadlock when initialization of awt happens simultanously
- removed some debugging output

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5245 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-03 18:57:02 +00:00
daburna
1976b89bef new development cycle 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5244 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-03 16:10:40 +00:00
lotus
7fdf65339d system status dropped into next line if seed server was enabled. display needs about 230px, set fixed width again. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5243 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-03 11:42:24 +00:00
lotus
7782a43060 fix if LANGUAGE: was not defined and the end of the query 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5242 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-03 11:36:17 +00:00
apfelmaennchen
2c23e6ad34 YaCy-UI: added some features for Admin Console 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5241 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-03 05:32:31 +00:00
apfelmaennchen
efcae14714 YaCy-UI: 
- added 'Open' button to search result toolbar
- lets you open all selected search results in new window/tab
- added 'any language' filter as default

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5240 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-02 17:38:03 +00:00
orbiter
68115c30ba quick release 0.61 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5239 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-01 22:10:51 +00:00
lotus
902a0d0f38 fieldset of system status was bigger than defined space. IE overlapped some text. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5238 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-01 20:33:32 +00:00
orbiter
820a03f9d6 - removed some warnings 
- used fix in SVN 5233 for ysearch.java and search.java

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5237 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-01 20:20:39 +00:00
lotus
69925a7e91 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1441 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5236 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-01 20:16:50 +00:00
lotus
fe2792e9ce use accept-language header instead of user agent for language detection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5235 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-10-01 17:47:11 +00:00