Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
10,481 Commits 1 Branch 20 Tags 836 MiB
a632b0d2a4
Commit Graph

10481 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Michael Peter Christen
a632b0d2a4 added a forced commit to index deletion to enable synchronized index 
updates
 2014-02-27 12:50:40 +01:00
Michael Peter Christen
1d069c5861 make sure that postprocessed documents are overwritten 2014-02-27 12:27:15 +01:00
Michael Peter Christen
9c41527e9c Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-02-27 10:14:07 +01:00
malykhin.dmitry
29a7598991 update russian lang-file and small improve web-interface 2014-02-27 07:43:17 +04:00
Michael Peter Christen
0d2342575e Merge branch 'master' of ssh://gitorious.org/yacy/rc1 2014-02-27 01:29:52 +01:00
Michael Peter Christen
3cc5c0ffdd a concurrency enhancement which was not used because tests showed worse 
indexing speed. I leave the code there since it may be useful in
SolrCloud environments.
 2014-02-27 01:27:06 +01:00
Michael Peter Christen
e644981697 added one more postprocessing low memory check 2014-02-27 00:34:13 +01:00
Michael Peter Christen
1bbc0fe6d2 added a properties file format for the status_p api to support reading 
of that information with the java Properties class (very easy for small
clients)
 2014-02-27 00:32:39 +01:00
Michael Peter Christen
e40511f307 extended the status_p api with disk space information 2014-02-27 00:31:13 +01:00
reger
5e645f4449 Merge origin/master 2014-02-27 00:24:30 +01:00
reger
3b89176b9f use config value htroot in Jetty init (was hardcoded) 
- move htroot exist check from old httpdfilehandler to startup, remove from filehandler and legacy proxyhandler
- use SwitchboardConstant.htroot where appropriate
 2014-02-27 00:23:34 +01:00
Michael Peter Christen
e1bf65c892 added short memory protection during postprocessing 2014-02-26 23:02:56 +01:00
Michael Peter Christen
90b47e83e6 fixed shutdown error when closing solr connectors 2014-02-26 22:47:16 +01:00
Michael Peter Christen
7640834b37 removed double concurrency to put Solr documents into the index. The 
writings to the solr index are also buffered in
ConcurrentUpdateSolrConnector
 2014-02-26 22:21:00 +01:00
sixcooler
99635e15b4 fix for switching 'simulate short memory status' and 'Memory Strategy' 
thx Thomas
 2014-02-26 17:12:53 +01:00
Michael Peter Christen
0f6b72f24b do not use luke requests for remote solr servers if the result is 
different from normal requests. This happens if the remote solr is
actually a solrCloud; in such cases the luke request returns only the
result of the single solr peer, not the whole cloud.
also done: some refactoring.
 2014-02-26 14:30:48 +01:00
reger
18a56446ce reorg URL test classes add isLocal test with some IPv6 examples 
- putting in default location and clean old package names
- add some valid RFC IPv6 sample urls (which don't pass the isLocal test)
 2014-02-26 02:01:40 +01:00
orbiter
f1a395ed46 Merge branch 'master' of ssh://gitorious.org/yacy/rc1 2014-02-25 16:46:25 +01:00
orbiter
95ea6ebb18 Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-02-25 16:45:55 +01:00
malykhin.dmitry
c89412af69 edit russian locale 2014-02-25 19:35:11 +04:00
Michael Peter Christen
c57026e242 recover from OOM 2014-02-25 15:23:45 +01:00
Michael Peter Christen
907db8b7a6 fix for bad query shortcut hack 2014-02-25 15:19:04 +01:00
Michael Peter Christen
a2b66fe2eb Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-02-25 14:37:39 +01:00
Michael Peter Christen
9f6be762a6 - better logging for postprocessing 
- fixed collection bug in postprocessing
 2014-02-25 14:37:30 +01:00
Michael Peter Christen
de8f7994ab as crawling has a low-cpu demand, we want it to run even if the CPU load 
is VERY high. This applies also if the CPU load is high because of
in-cache crawling; in that case we want to experience a high-CPU load as
much as possible
 2014-02-25 14:17:33 +01:00
Michael Peter Christen
d8e79731df fixed wrong used memory display 2014-02-25 13:38:39 +01:00
orbiter
da5d4128bf prevent npe 2014-02-25 03:26:20 +01:00
orbiter
a878c7982c prevent npe 2014-02-25 03:19:41 +01:00
orbiter
e4eb87d924 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-02-25 02:16:37 +01:00
orbiter
ced1a96f9c fixed error cache 2014-02-25 02:16:22 +01:00
reger
3ba81bd08a Merge origin/master 2014-02-25 00:24:10 +01:00
reger
4d896383db fix: use timeout = proxy.ClientTimeout in ProxyHandler 
(was 10sec fix) see http://bugs.yacy.net/view.php?id=236
 2014-02-25 00:23:06 +01:00
Michael Benz
072d4aa0c0 Updated German translation and Blacklist_p.html 2014-02-24 23:59:29 +01:00
orbiter
163cbceca5 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-02-24 23:43:03 +01:00
orbiter
cfb647db6e - introduced a miss cache in ConcurrentUpdateSolrConnector 
- better usage of cache
- bugfix for postprocessing
 2014-02-24 23:42:50 +01:00
reger
2c8c51ce4b make use of new -config cmd-line parameter in reconfgureYACY.sh 
to asure pwd encoding is compatible with DIGEST auth. in future.
 2014-02-24 23:19:17 +01:00
orbiter
a87d8e4a8e changed caching of ConcurrentUpdateSolrConnector: it caches now also the 
url along with the load date. While this takes much more memory, it
eliminates database lookups for getURL() requests, which happen equally
often. This speeds up remote solr configurations.
 2014-02-24 22:59:58 +01:00
orbiter
f6e441dd77 refactoring 2014-02-24 21:01:56 +01:00
orbiter
76c53faeb2 removed unused code (HostStat) 2014-02-24 20:51:43 +01:00
orbiter
d3a88eaecb introducing ConcurrentUpdateSolrServer for remote solr servers. 
Scaling of write buffers and update queue size is made according to
assigned memory.
 2014-02-24 20:26:02 +01:00
orbiter
c3f6c06f2c removed host increment on stored documents from crawler (that was wrong) 2014-02-24 20:02:15 +01:00
Michael Peter Christen
f97428fe5d Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-02-24 14:30:57 +01:00
malykhin.dmitry
746aa32ad5 edit russian locale 2014-02-24 16:50:28 +04:00
reger
809e976578 remove unused java imports form yacy.java 2014-02-24 05:19:40 +01:00
reger
a9b06f8719 add a -config command line parameter e.g. -config "port=9090" "port.ssl=8043" 
- useful for remote installation to set any config file property
- multipe parameter can be set at once, on Windows enclose parameter in doublequotes
- special handling   "adminAccount=adminuser:adminpwd"  sets adminusername and md5 encoded admin-pwd

- adjusted windows startbatch to allow command line parameter handling
- remove not needed classpath calculation from startYACY_debug.bat
 2014-02-24 05:16:31 +01:00
Michael Benz
edc8e1c4de Finished translation of changed CrawlStartExpert_p.html 2014-02-24 04:38:28 +01:00
reger
0923b09216 fix: allow 4 character admin user name 
(was min 5 char)
 2014-02-24 00:01:11 +01:00
Michael Peter Christen
7253ca4607 Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-02-22 09:51:02 +01:00
malykhin.dmitry
f8f0f6363d edit russian locale 2014-02-22 07:42:05 +04:00
Michael Peter Christen
a86c2fe77d fixed usage of media flag when started by automated process 2014-02-22 01:44:08 +01:00