Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
3,505 Commits 1 Branch 20 Tags 836 MiB
b30e64daab
Commit Graph

2268 Commits

Author SHA1 Message Date
theli
b30e64daab *) passing homepath to serverLog.configureLogging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3738 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-18 13:04:26 +00:00
theli
9a4375b115 *) robots.txt: adding support for crawl-delay 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3737 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-18 13:00:42 +00:00
orbiter
11ac7688d5 reverted a part of last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3736 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-16 17:52:11 +00:00
orbiter
b3f97b5c38 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3735 6c8d7289-2bf4-0310-a012-ef5d649a1542 2007-05-16 17:45:39 +00:00
orbiter
3c5ff7f735 adopted kelondroBytesIntMap to kelondroIntBytesMap 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3734 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-16 15:20:15 +00:00
orbiter
5551ff5306 enhanced index storage data structure kelondroBytesIntMap 
this stores now two index structures, one for data that is aquired during start-up
and one for data that is aquired during run-time. This reduces the grow factor, and should reduce the memory amount in case that a index-reorganisation happens.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3733 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-16 14:36:56 +00:00
orbiter
872eb46cb9 some redesign of the handling of the index for kelondroFlexTable 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3732 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-16 10:48:26 +00:00
karlchenofhell
086239da36 - added servlet: remote crawler queue overview 
- added servlet: crawl profile editor

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3731 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-16 10:11:25 +00:00
karlchenofhell
8ba81e0995 - added some comments (will get more in the near future) 
- added missing <label> to the search field in Network.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3728 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-15 15:48:28 +00:00
allo
65a8a9fc58 fix for nullpointer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3726 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 16:56:13 +00:00
orbiter
b05e2314cf another dht selection fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3725 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 12:52:39 +00:00
karlchenofhell
03c6551b0c - fix for http://www.yacy-forum.de/viewtopic.php?t=3747 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3724 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 12:44:44 +00:00
orbiter
b28e5d0ee9 protection against wrong word hash length 
see http://www.yacy-forum.de/viewtopic.php?p=35657#35657

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3723 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 10:00:23 +00:00
orbiter
e897eb9b4a fix for DHT selection target 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3722 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 08:17:36 +00:00
orbiter
0384b8771b fix for http://www.yacy-forum.de/viewtopic.php?p=35700#35700 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3719 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-13 19:37:16 +00:00
orbiter
578c2ef130 release 0.52 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3715 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 22:12:29 +00:00
orbiter
756a27049b last-minute-feature 'newbie-selection' for workshop purpose: 
for remote search, always select all peers that are less than a day old
(should be removed someday in the future if load is too high, which could mean when pph > 100)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3712 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 19:55:19 +00:00
orbiter
46367afaaa update of memory-protection values 
see http://www.yacy-forum.de/viewtopic.php?p=35539#35539

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3709 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 18:02:48 +00:00
rramthun
ea87fe5d78 *) Updated German translation 
*) Changed "Lost Handle" error to warning (masses of it if deleting crawl-profile)
*) Removed unnecessary code from Windows script 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3708 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 17:48:22 +00:00
orbiter
85035dc319 addition to svn 3699: check send/receive if p2p-mode is activated 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3701 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-10 13:27:38 +00:00
orbiter
26f05d1fd0 avoid division by zero if search is done for no words 
this case is relevant if the bluewords (yacy.blue) are used

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3698 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-09 22:10:12 +00:00
orbiter
2fa8b50e54 reverting svn 3691+3692 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3696 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-09 19:31:40 +00:00
orbiter
139c59ebbd - fixed dht selction problem: the seed tables used a wrong ordering 
- cleaned some code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3693 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-09 17:59:36 +00:00
orbiter
22a0e9f117 more timeout-control 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3692 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-09 14:53:17 +00:00
orbiter
24db55a541 added timeout for httpd-sockets during read 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3691 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-09 14:30:01 +00:00
orbiter
f3fee4d445 fix for http://www.yacy-forum.de/viewtopic.php?p=35322 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3689 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-08 09:19:36 +00:00
orbiter
7f56c8d4aa fixed some seed selection details 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3685 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-07 22:22:35 +00:00
orbiter
e602436fda fixed problem with cluster routing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3684 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-07 20:48:24 +00:00
orbiter
0831034e07 fixed non-termination bug for robinson remote crawl peer selection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3681 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-07 14:37:50 +00:00
orbiter
d6480dc670 fix for long transfer pauses 
see http://www.yacy-forum.de/viewtopic.php?p=35243#35243

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3672 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-06 21:43:20 +00:00
theli
cb43ae11ba *) Bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3668 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-06 12:57:22 +00:00
theli
0b5fc3c28c *) moving date functions to serverDate class 
*) Sitemap-parser
   - logging added
   - parsing of modDate added

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3667 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-06 12:36:49 +00:00
theli
6f46245a51 *) Bookmarks: Ajax icon is displayed while loading title 
*) First version of a sitemap parser added
   - currently only autodetection of sitemap files is supported
*) DB-Import restructured
   - pause/resume should work again now


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3666 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-06 09:52:04 +00:00
orbiter
111ba9e359 - fixed some width problems in new status page 
- fixed deadlock in dns cache
- added termination security for DHT peer selection

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3660 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-05 23:18:00 +00:00
theli
74dd6cac95 *) signal yacy shutdown to updater 
*) some javadoc added

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3658 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-05 16:20:01 +00:00
theli
43748f87fb *) changes required for the uploader 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3655 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-05 15:41:05 +00:00
rramthun
e12e934ade *) Fixed broken compile process. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3650 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-04 21:33:37 +00:00
rramthun
d6811ac243 *) Moving tar.jar from libx to lib 
*) Enhanced interface

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3649 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-04 19:46:23 +00:00
theli
469583ea80 *) new interface class. should be implemented by the updater to allow communication between the updater and yacy 
(not yet functional)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3648 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-04 14:22:10 +00:00
orbiter
191ef16499 fixed wrong ordering that caused bad dht selection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3646 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-04 14:11:50 +00:00
orbiter
7cf8981a98 - added debugging code for wrong DHT target iterator 
- restricted distance constraint from 0.4 to 0.2

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3644 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-03 22:57:55 +00:00
orbiter
dd44a1394f disabled automatic performance setting change 
- during crawl start
- each indexing cycle
- for delay values
- for short memory cycles

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3634 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-02 15:39:27 +00:00
orbiter
b9add5cf37 some bugfixes: 
- dht iterator start point
- wordIndex synchronization
- surftipps url check

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3633 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-02 14:20:43 +00:00
orbiter
06b6e35484 fix for a null pointer exception if clusters are not defined 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3632 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-02 12:26:29 +00:00
orbiter
35c660654d more debugging lines to fix bug for 
http://www.yacy-forum.de/viewtopic.php?p=34935#34935

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3629 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-04-30 23:05:19 +00:00
orbiter
47e90f31b2 fix for deadlock in plasmaWordIndex.addPageIndex 
synchronization for class method not necessary
see also: http://www.yacy-forum.de/viewtopic.php?p=34959#34959

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3628 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-04-30 22:30:09 +00:00
orbiter
81844e85b2 - fixed more cluster routing problems 
- fixed a problem in remote search when balancer caused shift process to wait too long

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3627 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-04-30 00:39:53 +00:00
orbiter
304ed3f4d2 fix for remote crawl requests in clusters 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3626 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-04-29 22:52:07 +00:00
orbiter
1979a167d3 fixed problem with cast 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3625 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-04-29 22:31:44 +00:00
orbiter
e48189c710 enhanced cluster routing 
- cluster definitions can now contain an addition for local ip addresses
- cluster-cluster communication uses the local ip address instead the global address, if one is given

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3624 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-04-29 22:05:34 +00:00