Michael Peter Christen
fdaeac374a
- enhanced postprocessing speed and memory footprint (by using HashMaps
...
instead of TreeMaps)
- enhanced memory footprint of database indexes (by introduction of
optimize calls)
- optimize calls shrink the amount of used memory for index sets if they
are not changed afterwards any more
2014-02-28 14:01:09 +01:00
Michael Peter Christen
1245cfeb43
small change to crawler monitor to fit in larger translations
2014-02-28 13:58:05 +01:00
reger
ba49ff81ed
little more verbose proxy 403 error message
2014-02-28 03:14:07 +01:00
Michael Peter Christen
d325cb8912
fixes and enhancements for postprocessing
2014-02-28 02:51:14 +01:00
Michael Peter Christen
7c1b968378
another fix for the shutdown exceptions
2014-02-28 01:53:32 +01:00
orbiter
133d41386c
(again) full redesign of ConcurrentUpdateSolrConnector to remove
...
out-of-order transactions regarding add and delete operations. Now all
operations (add and delete) are executed concurrently in-order.
2014-02-28 00:19:30 +01:00
orbiter
1960aafd6c
better height for statistic windows
2014-02-28 00:17:50 +01:00
orbiter
b0e3e2100d
better width for Progress table
2014-02-28 00:11:20 +01:00
orbiter
d2f7ce27a7
fix for switch back to localhost (why did this not work? it worked all
...
the time)
2014-02-27 23:30:56 +01:00
reger
c8d437b69a
clean up test sources
...
rename to current package names and move to default location
2014-02-27 22:48:17 +01:00
sixcooler
d346520ed6
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-27 18:35:24 +01:00
sixcooler
9afd7db043
bump to httpclient-4.3.3
2014-02-27 18:33:45 +01:00
Michael Benz
65170474a1
Updated German translation with translated submenu include env/templates/submenuComputation.template
2014-02-27 18:28:40 +01:00
Michael Peter Christen
003e9a4041
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-27 12:51:05 +01:00
Michael Peter Christen
a632b0d2a4
added a forced commit to index deletion to enable synchronized index
...
updates
2014-02-27 12:50:40 +01:00
Michael Peter Christen
1d069c5861
make sure that postprocessed documents are overwritten
2014-02-27 12:27:15 +01:00
Michael Peter Christen
9c41527e9c
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
2014-02-27 10:14:07 +01:00
malykhin.dmitry
29a7598991
update russian lang-file and small improve web-interface
2014-02-27 07:43:17 +04:00
reger
ee732bdc03
fix: de translation of menu link
2014-02-27 02:14:46 +01:00
Michael Peter Christen
0d2342575e
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
2014-02-27 01:29:52 +01:00
Michael Peter Christen
3cc5c0ffdd
a concurrency enhancement which was not used because tests showed worse
...
indexing speed. I leave the code there since it may be useful in
SolrCloud environments.
2014-02-27 01:27:06 +01:00
Michael Peter Christen
e644981697
added one more postprocessing low memory check
2014-02-27 00:34:13 +01:00
Michael Peter Christen
1bbc0fe6d2
added a properties file format for the status_p api to support reading
...
of that information with the java Properties class (very easy for small
clients)
2014-02-27 00:32:39 +01:00
Michael Peter Christen
e40511f307
extended the status_p api with disk space information
2014-02-27 00:31:13 +01:00
reger
5e645f4449
Merge origin/master
2014-02-27 00:24:30 +01:00
reger
3b89176b9f
use config value htroot in Jetty init (was hardcoded)
...
- move htroot exist check from old httpdfilehandler to startup, remove from filehandler and legacy proxyhandler
- use SwitchboardConstant.htroot where appropriate
2014-02-27 00:23:34 +01:00
Michael Peter Christen
e1bf65c892
added short memory protection during postprocessing
2014-02-26 23:02:56 +01:00
Michael Peter Christen
90b47e83e6
fixed shutdown error when closing solr connectors
2014-02-26 22:47:16 +01:00
Michael Peter Christen
7640834b37
removed double concurrency to put Solr documents into the index. The
...
writings to the solr index are also buffered in
ConcurrentUpdateSolrConnector
2014-02-26 22:21:00 +01:00
sixcooler
99635e15b4
fix for switching 'simulate short memory status' and 'Memory Strategy'
...
thx Thomas
2014-02-26 17:12:53 +01:00
Michael Peter Christen
0f6b72f24b
do not use luke requests for remote solr servers if the result is
...
different from normal requests. This happens if the remote solr is
actually a solrCloud; in such cases the luke request returns only the
result of the single solr peer, not the whole cloud.
also done: some refactoring.
2014-02-26 14:30:48 +01:00
reger
18a56446ce
reorg URL test classes add isLocal test with some IPv6 examples
...
- putting in default location and clean old package names
- add some valid RFC IPv6 sample urls (which don't pass the isLocal test)
2014-02-26 02:01:40 +01:00
orbiter
f1a395ed46
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
2014-02-25 16:46:25 +01:00
orbiter
95ea6ebb18
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
2014-02-25 16:45:55 +01:00
malykhin.dmitry
c89412af69
edit russian locale
2014-02-25 19:35:11 +04:00
Michael Peter Christen
c57026e242
recover from OOM
2014-02-25 15:23:45 +01:00
Michael Peter Christen
907db8b7a6
fix for bad query shortcut hack
2014-02-25 15:19:04 +01:00
Michael Peter Christen
a2b66fe2eb
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-25 14:37:39 +01:00
Michael Peter Christen
9f6be762a6
- better logging for postprocessing
...
- fixed collection bug in postprocessing
2014-02-25 14:37:30 +01:00
Michael Peter Christen
de8f7994ab
as crawling has a low-cpu demand, we want it to run even if the CPU load
...
is VERY high. This applies also if the CPU load is high because of
in-cache crawling; in that case we want to experience a high-CPU load as
much as possible
2014-02-25 14:17:33 +01:00
Michael Peter Christen
d8e79731df
fixed wrong used memory display
2014-02-25 13:38:39 +01:00
orbiter
da5d4128bf
prevent npe
2014-02-25 03:26:20 +01:00
orbiter
a878c7982c
prevent npe
2014-02-25 03:19:41 +01:00
orbiter
e4eb87d924
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-25 02:16:37 +01:00
orbiter
ced1a96f9c
fixed error cache
2014-02-25 02:16:22 +01:00
reger
3ba81bd08a
Merge origin/master
2014-02-25 00:24:10 +01:00
reger
4d896383db
fix: use timeout = proxy.ClientTimeout in ProxyHandler
...
(was 10sec fix) see http://bugs.yacy.net/view.php?id=236
2014-02-25 00:23:06 +01:00
Michael Benz
072d4aa0c0
Updated German translation and Blacklist_p.html
2014-02-24 23:59:29 +01:00
orbiter
163cbceca5
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-24 23:43:03 +01:00
orbiter
cfb647db6e
- introduced a miss cache in ConcurrentUpdateSolrConnector
...
- better usage of cache
- bugfix for postprocessing
2014-02-24 23:42:50 +01:00
