Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
7,177 Commits 1 Branch 20 Tags 836 MiB
af87af0d4c
Commit Graph

7177 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
orbiter
af87af0d4c - removed synchronization in serverSwitch which should improve speed 
- fixed wrong assert in network graph
- enhanced double check method in table class

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7511 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-22 12:56:25 +00:00
orbiter
4bd65532da initialization of libraries concurrently (faster start-up) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7510 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-22 10:57:38 +00:00
orbiter
24909b3006 slightly less restrictive values for DoS 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7509 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-21 15:24:09 +00:00
orbiter
311f57d360 DoS to prevent online snippet fetch: allow read from cache. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7508 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-21 15:11:03 +00:00
orbiter
83a38b16bb added link to svn log 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7507 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-21 12:11:12 +00:00
orbiter
57e6728cb7 - removed usage of /etc/alternatives/www-browser because of problems with lynx, see: 
http://forum.yacy-websuche.de/viewtopic.php?p=21959#p21959
  please look if the browser that is linked with /etc/alternatives/www-browser can be detected and insert call again if
  it can be made sure that this does not call lynx
- replaced severe warnings with just warnings in yacyClient

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7506 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-21 11:53:45 +00:00
orbiter
91eeaf2cff fix in ftp client 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7505 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-21 10:51:15 +00:00
orbiter
09a98a6ae4 - disabled arrow keys in search (pages switch) again -- too disturbing when editing the query line 
- fixed alt text in AccessGrid

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7504 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-21 10:30:58 +00:00
orbiter
e717bf74ba more logging, more care about OOMs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7503 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-21 09:51:05 +00:00
orbiter
d84b4a072e healing for some OOM problems 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7502 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-21 00:38:49 +00:00
orbiter
4aa406fb0f added log output to find bug in url parser for short hosts 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7501 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-21 00:07:00 +00:00
orbiter
82f262f685 - enhanced circle drawing speed 
- beautified 'moving dot' feature (using smaller and correctly positioned dots)
- added moving dots to DHT transfer

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7500 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-21 00:03:11 +00:00
suessthomas
6e93a3eb2f Small correction 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7499 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-19 22:02:44 +00:00
orbiter
29dc416ac6 more animations in graphics. See network and access picture. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7498 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-19 01:56:12 +00:00
orbiter
93b9c4fbc9 added missing file for latest commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7497 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-18 23:25:58 +00:00
orbiter
a80ee9a03d THE GRID is coming to YaCy .. see new animated graphics on http://localhost:8090/AccessGrid_p.html 
showing incoming and outgoing connections in an animated way

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7496 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-18 23:19:35 +00:00
low012
83ae46902b *) removed link to LogStatistics 
*) removed translation of LogStatistics

Once again: If you want this page back, I will put it back in, but it seems to have been non-operational for over one year without anybody complaining about it.

Does anybody know if net.yacy.kelondro.logging.LogalizerHandler still serves any purpose?

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7495 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-18 02:11:19 +00:00
low012
ce012e11aa *) deleted LogStatistics since the page did not work anymore and it seemed to be obsolete, tell me if you miss it and I will add it again 
*) a few minor changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7494 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-18 01:46:07 +00:00
low012
c5051c4020 *) fixed bug which caused entries to not be deleted when deleting by URL on IndexCreateWWWLocalQueue_p.html (I hope this did not break anything else) 
*)  cleaned up code a little bit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7493 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-18 01:25:46 +00:00
orbiter
d58071947a maybe terminateOldSessions is too slow, removed sleep 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7492 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-17 23:36:46 +00:00
orbiter
fb8b046bb4 removed unused properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7491 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-17 22:47:39 +00:00
low012
b0bdf2d9ed *) Oops! 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7490 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-17 20:42:35 +00:00
low012
de065e594f *) make sure that only positive values are accepted as refresh interval on Crawler Monitor page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7489 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-17 20:40:34 +00:00
orbiter
c69a4874b4 fix for non-valid json, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=3179 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7488 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-17 16:47:05 +00:00
orbiter
addbd5b482 moved the main update url - because of the many languages we support now on yacy.net 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7487 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-17 01:22:22 +00:00
orbiter
3e380c51b6 update to browser start with linux 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7486 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-16 14:53:47 +00:00
orbiter
4473cf8c61 replaced utf-8 with UTF-8 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7485 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-16 13:51:30 +00:00
orbiter
6083f2f171 fix for (false) oom 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7484 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-15 14:26:25 +00:00
orbiter
d2eb2fe8d9 added patch from quix0r, see 
http://forum.yacy-websuche.de/viewtopic.php?p=21188#p21188

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7483 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-14 23:16:47 +00:00
orbiter
abb35addb8 added 
accept-charset="UTF-8"
to all forms
this applies patches from http://forum.yacy-websuche.de/viewtopic.php?p=20891#p20891

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7482 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-14 22:57:43 +00:00
orbiter
b35fda43ea more changes to headless mode; now non-headless mode is used when: 
- YaCy runs on Windows
- YaCy is started with the -gui option
in all other cases YaCy runs in headless mode

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7481 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-14 22:17:59 +00:00
orbiter
6c52e31993 new methods to open a browser 
- if YaCy is started with the option -gui, it is not in headless mode. Then the java 1.6 browse method is used if all other methods fail
- in linux, the path /etc/alternatives/www-browser is used if no firefox is installed

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7480 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-14 16:15:14 +00:00
orbiter
5892fff51f introduction of dht-burst modes: this can expand the number of target peers in some cases where a better heuristic is needed. The problematic cases are either when a muti-word search is made (still a hard case for our term-oriented DHT) or when a network operator wants that all robinson peers are asked. We therefore introduced two new network steering values that switch on more peers during the peer selection. Because the number of peers can now be very large, the number of maximum httpc connections was also increased. 
Please see new coments in yacy.network.freeworld.unit for details of the new DHT selection methods.
The number of maximum peers is now not fixed to a specific number but may increase with
- the partition exponent
- the number of redundant peers
- the robinson burst percentage
- the multiword burst percentage
The maximum can then be the number of senior peers (all visible peers).

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7479 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-13 17:37:28 +00:00
orbiter
4588b5a291 - fixed document number limitation for crawls that restrict the number of documents per domain 
- some restructuring of the document counting and logging structures was necessary
- better abstraction of CrawlProfiles
- added deletion of logs to the index deletion option (if the index is deleted using the servlets) which is necessary to reset the domain counters for the page limitation
- more refactoring to get the LibraryProvider more clean
- some refactoring of the Condenser class

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7478 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-12 00:01:40 +00:00
low012
64f32e8f00 *) replaced all IPs in IP filters for proxy with the proper regular expression 
*) some cleanup

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7477 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-11 23:37:13 +00:00
lotus
9f6e3f9793 fix: same number format display before and after get/post 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7476 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-10 09:08:44 +00:00
lotus
4716aa7d3a fix display of statistics link on network.html (caused by menu option) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7475 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-09 21:32:45 +00:00
sixcooler
3e8b72be50 update to httpclient-4.1 - sorry forgot some 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7474 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-08 21:53:20 +00:00
sixcooler
45dcfa3460 update to httpclient-4.1 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7473 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-08 21:46:24 +00:00
f1ori
d38c739b31 * add ant-target deleteData, to simulate fresh yacy installation 
* useful in IDEs like eclipse

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7472 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-08 09:12:48 +00:00
low012
74b22dfa24 *) fixed bug which affected blacklist entries which consisted of domain _and_ path parts 
*) minor cleanup

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7471 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-06 18:07:08 +00:00
low012
4843f04247 *) more input from Moubai 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7470 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-06 16:00:45 +00:00
low012
b9990e722f *) updated French langugage file with input from Moubai (http://yacy-forum.org/viewtopic.php?p=1646) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7469 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-05 11:20:25 +00:00
orbiter
93732d6773 increased number of target peers 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7468 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-04 13:25:28 +00:00
orbiter
70ca7cec8c fix for http://forum.yacy-websuche.de/viewtopic.php?p=21763#p21763 
and another fix for non-working global search when search options are switched off

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7467 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-03 10:43:09 +00:00
orbiter
fe93caac5a added flags and administration options to show advanced search and to show search result attributes (for each search result) 
Administration can be done at ConfigPortal.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7466 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-02 15:54:13 +00:00
f1ori
01cb3bbaec * fix patchCharsetEncoding-test (patchCharsetEncoding now returns null on input null) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7465 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-02 15:28:41 +00:00
orbiter
431f780f41 patch for bad data in url metadata 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7464 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-02 01:19:25 +00:00
orbiter
0dfb1ef7d2 added custom targets for media search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7463 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-02 00:50:06 +00:00
orbiter
5905f912c5 replaced more double types with float 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7462 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-02-02 00:22:00 +00:00