Commit Graph

10563 Commits

Author SHA1 Message Date
Michael Peter Christen
bcd9dd9e1d enhanced concurrent loading by using a fixed set of concurrent loader
processes in favor of throwaway-processes. The control mechanism does
less often report a 'queue full' message to the busy loop which then
does not perform a long busy waiting; instead all requests are queued
and new loader processes are started if necessary up to a given limit
(as set before)
2014-03-03 22:13:40 +01:00
orbiter
d8f7f47eff Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-03-03 21:39:49 +01:00
malykhin.dmitry
aec3ab1315 Update russian translation 2014-03-03 07:16:53 +04:00
Michael Benz
c7ea0f123b Added German translation for Config Search and Ranking RWI and Solr 2014-03-02 23:47:51 +01:00
orbiter
051328271c bugfix-bugfix 2014-03-02 21:13:38 +01:00
orbiter
eedcbcd906 bugfix to proxy handler: recognize the own yacyh-host 2014-03-02 12:10:19 +01:00
orbiter
d68e5ad0c4 NPE fix for Thread name (just commited yesterday, sorry) 2014-03-02 11:20:48 +01:00
orbiter
a2e1f104f6 Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-03-02 11:18:28 +01:00
reger
6878c90f99 fix: IPv6 INTRANET_PATTERNS for local ip (see http://bugs.yacy.net/view.php?id=378)
requiring following ":" for fc and fd prefix and made pattern match case insesitive
- add some more ipv6 test cases to MultiProtocolURLTest.java
2014-03-02 06:13:21 +01:00
reger
61e51d47a5 fix: unused / incorrect default username parameter
(removed setting)
2014-03-01 23:50:35 +01:00
malykhin.dmitry
fed354c0e2 Update russian translation 2014-03-01 20:28:36 +04:00
Michael Benz
9dc0aa2b01 German translation for Augmented Browser, Parser, Content Control and Vocabulary 2014-03-01 13:37:17 +01:00
Michael Benz
a87aef83b4 Improved Image Collage and WatchWebStructure page display with CSS changes 2014-03-01 11:32:14 +01:00
Michael Benz
0813f5f82e Added German translation for AccessGrid_p.html, CrawlCheck_p.html, RegexTest.html and env/templates/submenuTargetAnalysis.template 2014-03-01 11:31:23 +01:00
reger
a2e5ea2026 status panel link to set max mem
+url proxy same error text as in transparent
2014-03-01 00:56:45 +01:00
malykhin.dmitry
e9877028c6 update russian translation 2014-03-01 00:03:23 +04:00
Michael Peter Christen
6ed9c0164e attaching names to all Threads to get a better view in profiling tools
like VisualVM
2014-02-28 15:02:01 +01:00
Michael Peter Christen
fdaeac374a - enhanced postprocessing speed and memory footprint (by using HashMaps
instead of TreeMaps)
- enhanced memory footprint of database indexes (by introduction of
optimize calls)
- optimize calls shrink the amount of used memory for index sets if they
are not changed afterwards any more
2014-02-28 14:01:09 +01:00
Michael Peter Christen
1245cfeb43 small change to crawler monitor to fit in larger translations 2014-02-28 13:58:05 +01:00
reger
ba49ff81ed little more verbose proxy 403 error message 2014-02-28 03:14:07 +01:00
Michael Peter Christen
d325cb8912 fixes and enhancements for postprocessing 2014-02-28 02:51:14 +01:00
Michael Peter Christen
7c1b968378 another fix for the shutdown exceptions 2014-02-28 01:53:32 +01:00
orbiter
133d41386c (again) full redesign of ConcurrentUpdateSolrConnector to remove
out-of-order transactions regarding add and delete operations. Now all
operations (add and delete) are executed concurrently in-order.
2014-02-28 00:19:30 +01:00
orbiter
1960aafd6c better height for statistic windows 2014-02-28 00:17:50 +01:00
orbiter
b0e3e2100d better width for Progress table 2014-02-28 00:11:20 +01:00
orbiter
d2f7ce27a7 fix for switch back to localhost (why did this not work? it worked all
the time)
2014-02-27 23:30:56 +01:00
reger
c8d437b69a clean up test sources
rename to current package names and move to default location
2014-02-27 22:48:17 +01:00
sixcooler
d346520ed6 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-02-27 18:35:24 +01:00
sixcooler
9afd7db043 bump to httpclient-4.3.3 2014-02-27 18:33:45 +01:00
Michael Benz
65170474a1 Updated German translation with translated submenu include env/templates/submenuComputation.template 2014-02-27 18:28:40 +01:00
Michael Peter Christen
003e9a4041 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-02-27 12:51:05 +01:00
Michael Peter Christen
a632b0d2a4 added a forced commit to index deletion to enable synchronized index
updates
2014-02-27 12:50:40 +01:00
Michael Peter Christen
1d069c5861 make sure that postprocessed documents are overwritten 2014-02-27 12:27:15 +01:00
Michael Peter Christen
9c41527e9c Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-02-27 10:14:07 +01:00
malykhin.dmitry
29a7598991 update russian lang-file and small improve web-interface 2014-02-27 07:43:17 +04:00
reger
ee732bdc03 fix: de translation of menu link 2014-02-27 02:14:46 +01:00
Michael Peter Christen
0d2342575e Merge branch 'master' of ssh://gitorious.org/yacy/rc1 2014-02-27 01:29:52 +01:00
Michael Peter Christen
3cc5c0ffdd a concurrency enhancement which was not used because tests showed worse
indexing speed. I leave the code there since it may be useful in
SolrCloud environments.
2014-02-27 01:27:06 +01:00
Michael Peter Christen
e644981697 added one more postprocessing low memory check 2014-02-27 00:34:13 +01:00
Michael Peter Christen
1bbc0fe6d2 added a properties file format for the status_p api to support reading
of that information with the java Properties class (very easy for small
clients)
2014-02-27 00:32:39 +01:00
Michael Peter Christen
e40511f307 extended the status_p api with disk space information 2014-02-27 00:31:13 +01:00
reger
5e645f4449 Merge origin/master 2014-02-27 00:24:30 +01:00
reger
3b89176b9f use config value htroot in Jetty init (was hardcoded)
- move htroot exist check from old httpdfilehandler to startup, remove from filehandler and legacy proxyhandler
- use SwitchboardConstant.htroot where appropriate
2014-02-27 00:23:34 +01:00
Michael Peter Christen
e1bf65c892 added short memory protection during postprocessing 2014-02-26 23:02:56 +01:00
Michael Peter Christen
90b47e83e6 fixed shutdown error when closing solr connectors 2014-02-26 22:47:16 +01:00
Michael Peter Christen
7640834b37 removed double concurrency to put Solr documents into the index. The
writings to the solr index are also buffered in
ConcurrentUpdateSolrConnector
2014-02-26 22:21:00 +01:00
sixcooler
99635e15b4 fix for switching 'simulate short memory status' and 'Memory Strategy'
thx Thomas
2014-02-26 17:12:53 +01:00
Michael Peter Christen
0f6b72f24b do not use luke requests for remote solr servers if the result is
different from normal requests. This happens if the remote solr is
actually a solrCloud; in such cases the luke request returns only the
result of the single solr peer, not the whole cloud.
also done: some refactoring.
2014-02-26 14:30:48 +01:00
reger
18a56446ce reorg URL test classes add isLocal test with some IPv6 examples
- putting in default location and clean old package names
- add some valid RFC IPv6 sample urls (which don't pass the isLocal test)
2014-02-26 02:01:40 +01:00
orbiter
f1a395ed46 Merge branch 'master' of ssh://gitorious.org/yacy/rc1 2014-02-25 16:46:25 +01:00