orbiter
1960aafd6c
better height for statistic windows
2014-02-28 00:17:50 +01:00
orbiter
b0e3e2100d
better width for Progress table
2014-02-28 00:11:20 +01:00
orbiter
d2f7ce27a7
fix for switch back to localhost (why did this not work? it worked all
...
the time)
2014-02-27 23:30:56 +01:00
reger
c8d437b69a
clean up test sources
...
rename to current package names and move to default location
2014-02-27 22:48:17 +01:00
sixcooler
d346520ed6
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-27 18:35:24 +01:00
sixcooler
9afd7db043
bump to httpclient-4.3.3
2014-02-27 18:33:45 +01:00
Michael Benz
65170474a1
Updated German translation with translated submenu include env/templates/submenuComputation.template
2014-02-27 18:28:40 +01:00
Michael Peter Christen
003e9a4041
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-27 12:51:05 +01:00
Michael Peter Christen
a632b0d2a4
added a forced commit to index deletion to enable synchronized index
...
updates
2014-02-27 12:50:40 +01:00
Michael Peter Christen
1d069c5861
make sure that postprocessed documents are overwritten
2014-02-27 12:27:15 +01:00
Michael Peter Christen
9c41527e9c
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
2014-02-27 10:14:07 +01:00
malykhin.dmitry
29a7598991
update russian lang-file and small improve web-interface
2014-02-27 07:43:17 +04:00
reger
ee732bdc03
fix: de translation of menu link
2014-02-27 02:14:46 +01:00
Michael Peter Christen
0d2342575e
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
2014-02-27 01:29:52 +01:00
Michael Peter Christen
3cc5c0ffdd
a concurrency enhancement which was not used because tests showed worse
...
indexing speed. I leave the code there since it may be useful in
SolrCloud environments.
2014-02-27 01:27:06 +01:00
Michael Peter Christen
e644981697
added one more postprocessing low memory check
2014-02-27 00:34:13 +01:00
Michael Peter Christen
1bbc0fe6d2
added a properties file format for the status_p api to support reading
...
of that information with the java Properties class (very easy for small
clients)
2014-02-27 00:32:39 +01:00
Michael Peter Christen
e40511f307
extended the status_p api with disk space information
2014-02-27 00:31:13 +01:00
reger
5e645f4449
Merge origin/master
2014-02-27 00:24:30 +01:00
reger
3b89176b9f
use config value htroot in Jetty init (was hardcoded)
...
- move htroot exist check from old httpdfilehandler to startup, remove from filehandler and legacy proxyhandler
- use SwitchboardConstant.htroot where appropriate
2014-02-27 00:23:34 +01:00
Michael Peter Christen
e1bf65c892
added short memory protection during postprocessing
2014-02-26 23:02:56 +01:00
Michael Peter Christen
90b47e83e6
fixed shutdown error when closing solr connectors
2014-02-26 22:47:16 +01:00
Michael Peter Christen
7640834b37
removed double concurrency to put Solr documents into the index. The
...
writings to the solr index are also buffered in
ConcurrentUpdateSolrConnector
2014-02-26 22:21:00 +01:00
sixcooler
99635e15b4
fix for switching 'simulate short memory status' and 'Memory Strategy'
...
thx Thomas
2014-02-26 17:12:53 +01:00
Michael Peter Christen
0f6b72f24b
do not use luke requests for remote solr servers if the result is
...
different from normal requests. This happens if the remote solr is
actually a solrCloud; in such cases the luke request returns only the
result of the single solr peer, not the whole cloud.
also done: some refactoring.
2014-02-26 14:30:48 +01:00
reger
18a56446ce
reorg URL test classes add isLocal test with some IPv6 examples
...
- putting in default location and clean old package names
- add some valid RFC IPv6 sample urls (which don't pass the isLocal test)
2014-02-26 02:01:40 +01:00
orbiter
f1a395ed46
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
2014-02-25 16:46:25 +01:00
orbiter
95ea6ebb18
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
2014-02-25 16:45:55 +01:00
malykhin.dmitry
c89412af69
edit russian locale
2014-02-25 19:35:11 +04:00
Michael Peter Christen
c57026e242
recover from OOM
2014-02-25 15:23:45 +01:00
Michael Peter Christen
907db8b7a6
fix for bad query shortcut hack
2014-02-25 15:19:04 +01:00
Michael Peter Christen
a2b66fe2eb
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-25 14:37:39 +01:00
Michael Peter Christen
9f6be762a6
- better logging for postprocessing
...
- fixed collection bug in postprocessing
2014-02-25 14:37:30 +01:00
Michael Peter Christen
de8f7994ab
as crawling has a low-cpu demand, we want it to run even if the CPU load
...
is VERY high. This applies also if the CPU load is high because of
in-cache crawling; in that case we want to experience a high-CPU load as
much as possible
2014-02-25 14:17:33 +01:00
Michael Peter Christen
d8e79731df
fixed wrong used memory display
2014-02-25 13:38:39 +01:00
orbiter
da5d4128bf
prevent npe
2014-02-25 03:26:20 +01:00
orbiter
a878c7982c
prevent npe
2014-02-25 03:19:41 +01:00
orbiter
e4eb87d924
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-25 02:16:37 +01:00
orbiter
ced1a96f9c
fixed error cache
2014-02-25 02:16:22 +01:00
reger
3ba81bd08a
Merge origin/master
2014-02-25 00:24:10 +01:00
reger
4d896383db
fix: use timeout = proxy.ClientTimeout in ProxyHandler
...
(was 10sec fix) see http://bugs.yacy.net/view.php?id=236
2014-02-25 00:23:06 +01:00
Michael Benz
072d4aa0c0
Updated German translation and Blacklist_p.html
2014-02-24 23:59:29 +01:00
orbiter
163cbceca5
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-24 23:43:03 +01:00
orbiter
cfb647db6e
- introduced a miss cache in ConcurrentUpdateSolrConnector
...
- better usage of cache
- bugfix for postprocessing
2014-02-24 23:42:50 +01:00
reger
2c8c51ce4b
make use of new -config cmd-line parameter in reconfgureYACY.sh
...
to asure pwd encoding is compatible with DIGEST auth. in future.
2014-02-24 23:19:17 +01:00
orbiter
a87d8e4a8e
changed caching of ConcurrentUpdateSolrConnector: it caches now also the
...
url along with the load date. While this takes much more memory, it
eliminates database lookups for getURL() requests, which happen equally
often. This speeds up remote solr configurations.
2014-02-24 22:59:58 +01:00
orbiter
f6e441dd77
refactoring
2014-02-24 21:01:56 +01:00
orbiter
76c53faeb2
removed unused code (HostStat)
2014-02-24 20:51:43 +01:00
orbiter
d3a88eaecb
introducing ConcurrentUpdateSolrServer for remote solr servers.
...
Scaling of write buffers and update queue size is made according to
assigned memory.
2014-02-24 20:26:02 +01:00
orbiter
c3f6c06f2c
removed host increment on stored documents from crawler (that was wrong)
2014-02-24 20:02:15 +01:00
