orbiter
95ea6ebb18
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
2014-02-25 16:45:55 +01:00
malykhin.dmitry
c89412af69
edit russian locale
2014-02-25 19:35:11 +04:00
Michael Peter Christen
c57026e242
recover from OOM
2014-02-25 15:23:45 +01:00
Michael Peter Christen
907db8b7a6
fix for bad query shortcut hack
2014-02-25 15:19:04 +01:00
Michael Peter Christen
a2b66fe2eb
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-25 14:37:39 +01:00
Michael Peter Christen
9f6be762a6
- better logging for postprocessing
...
- fixed collection bug in postprocessing
2014-02-25 14:37:30 +01:00
Michael Peter Christen
de8f7994ab
as crawling has a low-cpu demand, we want it to run even if the CPU load
...
is VERY high. This applies also if the CPU load is high because of
in-cache crawling; in that case we want to experience a high-CPU load as
much as possible
2014-02-25 14:17:33 +01:00
Michael Peter Christen
d8e79731df
fixed wrong used memory display
2014-02-25 13:38:39 +01:00
orbiter
da5d4128bf
prevent npe
2014-02-25 03:26:20 +01:00
orbiter
a878c7982c
prevent npe
2014-02-25 03:19:41 +01:00
orbiter
e4eb87d924
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-25 02:16:37 +01:00
orbiter
ced1a96f9c
fixed error cache
2014-02-25 02:16:22 +01:00
reger
3ba81bd08a
Merge origin/master
2014-02-25 00:24:10 +01:00
reger
4d896383db
fix: use timeout = proxy.ClientTimeout in ProxyHandler
...
(was 10sec fix) see http://bugs.yacy.net/view.php?id=236
2014-02-25 00:23:06 +01:00
Michael Benz
072d4aa0c0
Updated German translation and Blacklist_p.html
2014-02-24 23:59:29 +01:00
orbiter
163cbceca5
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2014-02-24 23:43:03 +01:00
orbiter
cfb647db6e
- introduced a miss cache in ConcurrentUpdateSolrConnector
...
- better usage of cache
- bugfix for postprocessing
2014-02-24 23:42:50 +01:00
reger
2c8c51ce4b
make use of new -config cmd-line parameter in reconfgureYACY.sh
...
to asure pwd encoding is compatible with DIGEST auth. in future.
2014-02-24 23:19:17 +01:00
orbiter
a87d8e4a8e
changed caching of ConcurrentUpdateSolrConnector: it caches now also the
...
url along with the load date. While this takes much more memory, it
eliminates database lookups for getURL() requests, which happen equally
often. This speeds up remote solr configurations.
2014-02-24 22:59:58 +01:00
orbiter
f6e441dd77
refactoring
2014-02-24 21:01:56 +01:00
orbiter
76c53faeb2
removed unused code (HostStat)
2014-02-24 20:51:43 +01:00
orbiter
d3a88eaecb
introducing ConcurrentUpdateSolrServer for remote solr servers.
...
Scaling of write buffers and update queue size is made according to
assigned memory.
2014-02-24 20:26:02 +01:00
orbiter
c3f6c06f2c
removed host increment on stored documents from crawler (that was wrong)
2014-02-24 20:02:15 +01:00
Michael Peter Christen
f97428fe5d
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
2014-02-24 14:30:57 +01:00
malykhin.dmitry
746aa32ad5
edit russian locale
2014-02-24 16:50:28 +04:00
reger
809e976578
remove unused java imports form yacy.java
2014-02-24 05:19:40 +01:00
reger
a9b06f8719
add a -config command line parameter e.g. -config "port=9090" "port.ssl=8043"
...
- useful for remote installation to set any config file property
- multipe parameter can be set at once, on Windows enclose parameter in doublequotes
- special handling "adminAccount=adminuser:adminpwd" sets adminusername and md5 encoded admin-pwd
- adjusted windows startbatch to allow command line parameter handling
- remove not needed classpath calculation from startYACY_debug.bat
2014-02-24 05:16:31 +01:00
Michael Benz
edc8e1c4de
Finished translation of changed CrawlStartExpert_p.html
2014-02-24 04:38:28 +01:00
reger
0923b09216
fix: allow 4 character admin user name
...
(was min 5 char)
2014-02-24 00:01:11 +01:00
Michael Peter Christen
7253ca4607
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
2014-02-22 09:51:02 +01:00
malykhin.dmitry
f8f0f6363d
edit russian locale
2014-02-22 07:42:05 +04:00
Michael Peter Christen
a86c2fe77d
fixed usage of media flag when started by automated process
2014-02-22 01:44:08 +01:00
Michael Peter Christen
254a7ac66c
fixed cleaning of index
2014-02-22 01:35:01 +01:00
Michael Peter Christen
28a7b42e6b
removed warning "sun.misc.BASE64Encoder is internal proprietary API and
...
may be removed in a future release"
2014-02-22 00:52:49 +01:00
Michael Peter Christen
046f5a03cb
one more SolrIndexSearcher bugfix
2014-02-21 23:48:56 +01:00
sixcooler
78c01b3eff
fix for 'AlreadyClosedException: this IndexReader is closed'
2014-02-21 17:28:32 +01:00
Michael Benz
f11314aae7
Improved German de.lng translation and fixed adresses -> addresses in \htroot\CrawlStartScanner_p.html
2014-02-20 08:47:32 +01:00
Michael Peter Christen
f0eec6d0f3
Merge branch 'master' of git://gitorious.org/~copro/yacy/copros-rc1
2014-02-20 00:50:48 +01:00
Michael Peter Christen
1b5e3d523a
better control over close-state of remote solr connections
2014-02-20 00:39:19 +01:00
Michael Benz
6278af4993
Edit German de locale and improved translation
2014-02-20 00:32:20 +01:00
Michael Peter Christen
1a364572a5
fix for
...
"org.apache.solr.core.SolrCore Too many close [count:-1] on
org.apache.solr.core.SolrCore@51af7c57"
-error
2014-02-20 00:03:35 +01:00
Michael Peter Christen
69391e5d9e
changed strategy to test existence of documents in Solr: using the
...
update time. The reason for that is a better caching for the crawler
double-check, which needs the update time for crawler steering.
2014-02-19 04:03:45 +01:00
Michael Peter Christen
790f103f32
delete fail-docs during postprocessing to prevent that they will appear
...
again and stay in postprocessing forever.
2014-02-18 01:38:56 +01:00
Michael Peter Christen
745d6d1c64
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
2014-02-17 23:59:48 +01:00
malykhin.dmitry
ec598991a4
edit russian locale
2014-02-18 02:01:34 +04:00
reger
a02e33dcb6
add edit-link to PK field of table admin
2014-02-16 02:26:11 +01:00
r
c69630c522
edit russian locale
...
edit russian locale
2014-02-15 07:29:49 +04:00
Anatoliy Evladov
66639cb703
Fixed my error
2014-02-14 14:12:25 +04:00
Anatoliy Evladov
baaea6dedc
Edit ru locales
2014-02-14 14:09:25 +04:00
Michael Peter Christen
ff656ce860
explicit call to optimize to add a expungeDeleted flag
2014-02-12 01:01:23 +01:00
