Commit Graph

10583 Commits

Author SHA1 Message Date
sixcooler
0b2101c59c Speed up the ProxyHandler:
simplified cache-storing and make it concurrent in order to free the
clientconnection asap
let other prozesses wait on proxy-access like it was bevore
2014-03-07 17:47:09 +01:00
Michael Peter Christen
8cf4d04ae0 fix for facets in search rss result: some facets had been missing, all
had missing url properties
2014-03-07 01:21:38 +01:00
reger
516f8c2489 fix: to allow unix scripts (bin/*.sh) to allways submit http admin apicalls
using auth via config hash (legacy requirement)
2014-03-07 00:16:57 +01:00
Michael Peter Christen
ea3aa30593 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-03-06 03:33:33 +01:00
reger
dd5bf0b71b cleanup old reference to HTTPDemon.setAlternativeResolver
optimize .yacyh check in AbstractRemoteHandler
2014-03-06 03:08:04 +01:00
Michael Peter Christen
51800007c4 - added concurrency to postprocessing of webgraph document
- bundeled separate webgraph postprocesing steps into one
2014-03-06 01:43:48 +01:00
Michael Peter Christen
5f4a6892c1 enhanced RowSet re-sort limit for small sets 2014-03-05 23:28:19 +01:00
orbiter
3c92c439ac Merge branch 'master' of ssh://gitorious.org/yacy/rc1 2014-03-05 17:46:50 +01:00
orbiter
5b3585da47 Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-03-05 17:46:27 +01:00
malykhin.dmitry
b1db14b21f Update russian translation 2014-03-05 18:58:15 +04:00
malykhin.dmitry
c97c9ac692 Update russian translation 2014-03-05 18:53:23 +04:00
reger
351c2be68d fix: make sure adminAccount changes made via ConfigAccounts_p are effective immediately
force to remove current credentials from knownuser cache
2014-03-05 02:59:27 +01:00
orbiter
7c2dc3915f Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-03-04 19:51:34 +01:00
malykhin.dmitry
b964f36d90 Update russian translation 2014-03-04 21:37:00 +04:00
orbiter
f77afa9d1d add index on _val fields, this affects especially title length
an index on fields make search facets on that field possible
2014-03-04 11:24:04 +01:00
malykhin.dmitry
c0c177e2bc Update russian translation 2014-03-04 07:19:35 +04:00
reger
5c9dcc269d improve OAI-PMH import identifier recognition
- find best fittng identifier (url) by checking all given dc:identifier in record (many entries proviede several identifiers)
  as identifier is currently a multivalued field use "getParams" in preference of splitting the 1st string by ";" 
- add resolve DOI:... identifier via http://dx.doi.org/
2014-03-04 03:08:37 +01:00
Michael Peter Christen
0e7d249a69 fixed another shutdown problem (only occurs if webgraph core is enabled) 2014-03-04 01:36:38 +01:00
Michael Peter Christen
e485fbd0ce - let crawl loader jobs die after 10 seconds without new jobs
- corrected shutdown order t prevent a deadlock during shutdown
2014-03-04 00:33:13 +01:00
Michael Benz
0792a4369c Added Index Deletion and Reindex Monitor to German translation 2014-03-03 22:45:17 +01:00
Michael Peter Christen
bcd9dd9e1d enhanced concurrent loading by using a fixed set of concurrent loader
processes in favor of throwaway-processes. The control mechanism does
less often report a 'queue full' message to the busy loop which then
does not perform a long busy waiting; instead all requests are queued
and new loader processes are started if necessary up to a given limit
(as set before)
2014-03-03 22:13:40 +01:00
orbiter
d8f7f47eff Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-03-03 21:39:49 +01:00
malykhin.dmitry
aec3ab1315 Update russian translation 2014-03-03 07:16:53 +04:00
Michael Benz
c7ea0f123b Added German translation for Config Search and Ranking RWI and Solr 2014-03-02 23:47:51 +01:00
orbiter
051328271c bugfix-bugfix 2014-03-02 21:13:38 +01:00
orbiter
eedcbcd906 bugfix to proxy handler: recognize the own yacyh-host 2014-03-02 12:10:19 +01:00
orbiter
d68e5ad0c4 NPE fix for Thread name (just commited yesterday, sorry) 2014-03-02 11:20:48 +01:00
orbiter
a2e1f104f6 Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1 2014-03-02 11:18:28 +01:00
reger
6878c90f99 fix: IPv6 INTRANET_PATTERNS for local ip (see http://bugs.yacy.net/view.php?id=378)
requiring following ":" for fc and fd prefix and made pattern match case insesitive
- add some more ipv6 test cases to MultiProtocolURLTest.java
2014-03-02 06:13:21 +01:00
reger
61e51d47a5 fix: unused / incorrect default username parameter
(removed setting)
2014-03-01 23:50:35 +01:00
malykhin.dmitry
fed354c0e2 Update russian translation 2014-03-01 20:28:36 +04:00
Michael Benz
9dc0aa2b01 German translation for Augmented Browser, Parser, Content Control and Vocabulary 2014-03-01 13:37:17 +01:00
Michael Benz
a87aef83b4 Improved Image Collage and WatchWebStructure page display with CSS changes 2014-03-01 11:32:14 +01:00
Michael Benz
0813f5f82e Added German translation for AccessGrid_p.html, CrawlCheck_p.html, RegexTest.html and env/templates/submenuTargetAnalysis.template 2014-03-01 11:31:23 +01:00
reger
a2e5ea2026 status panel link to set max mem
+url proxy same error text as in transparent
2014-03-01 00:56:45 +01:00
malykhin.dmitry
e9877028c6 update russian translation 2014-03-01 00:03:23 +04:00
Michael Peter Christen
6ed9c0164e attaching names to all Threads to get a better view in profiling tools
like VisualVM
2014-02-28 15:02:01 +01:00
Michael Peter Christen
fdaeac374a - enhanced postprocessing speed and memory footprint (by using HashMaps
instead of TreeMaps)
- enhanced memory footprint of database indexes (by introduction of
optimize calls)
- optimize calls shrink the amount of used memory for index sets if they
are not changed afterwards any more
2014-02-28 14:01:09 +01:00
Michael Peter Christen
1245cfeb43 small change to crawler monitor to fit in larger translations 2014-02-28 13:58:05 +01:00
reger
ba49ff81ed little more verbose proxy 403 error message 2014-02-28 03:14:07 +01:00
Michael Peter Christen
d325cb8912 fixes and enhancements for postprocessing 2014-02-28 02:51:14 +01:00
Michael Peter Christen
7c1b968378 another fix for the shutdown exceptions 2014-02-28 01:53:32 +01:00
orbiter
133d41386c (again) full redesign of ConcurrentUpdateSolrConnector to remove
out-of-order transactions regarding add and delete operations. Now all
operations (add and delete) are executed concurrently in-order.
2014-02-28 00:19:30 +01:00
orbiter
1960aafd6c better height for statistic windows 2014-02-28 00:17:50 +01:00
orbiter
b0e3e2100d better width for Progress table 2014-02-28 00:11:20 +01:00
orbiter
d2f7ce27a7 fix for switch back to localhost (why did this not work? it worked all
the time)
2014-02-27 23:30:56 +01:00
reger
c8d437b69a clean up test sources
rename to current package names and move to default location
2014-02-27 22:48:17 +01:00
sixcooler
d346520ed6 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-02-27 18:35:24 +01:00
sixcooler
9afd7db043 bump to httpclient-4.3.3 2014-02-27 18:33:45 +01:00
Michael Benz
65170474a1 Updated German translation with translated submenu include env/templates/submenuComputation.template 2014-02-27 18:28:40 +01:00