Commit Graph

13699 Commits

Author SHA1 Message Date
luccioman
6831bdffb5 Fixed minor technical issues on Chinese updated translations 2018-07-17 07:08:30 +02:00
luccioman
e03c464f16
Merge pull request #186 from tangdou1/patch-1
Update zh.lng
2018-07-17 07:03:07 +02:00
tangdou1
0ebb27e5da
Update zh.lng 2018-07-16 20:18:02 +08:00
tangdou1
9c6a99f7ca
Update zh.lng 2018-07-16 19:53:20 +08:00
tangdou1
68b5b48335
Update zh.lng 2018-07-16 18:04:37 +08:00
luccioman
bdafb14336 Removed redundant synchronization lock on network switch function
Was useless as done in an already synchronized block, and the lock
object was assigned a new value in that same block, and nowhere else a
lock is requested on that same object.
2018-07-16 09:20:23 +02:00
luccioman
d5f44ea216 Removed unnecessary synchronization lock from serverSwitch constructor
Lock was useless here as it was set on an object instance attribute
while the object itself is not yet constructed and no other threads can
access it.
2018-07-16 09:13:50 +02:00
tangdou1
f19570a797
Update zh.lng 2018-07-14 21:36:03 +08:00
tangdou1
edb431cf8a
Update zh.lng 2018-07-14 17:18:43 +08:00
luccioman
dcee2ee6a6 Use standard Java annotation syntax instead of custom Javadoc tag
For better support by building tools.
As reported by @KnustJohn_twitter , the custom
[@phase](https://maven.apache.org/plugin-tools/maven-plugin-tools-java/index.html)
Javadoc tag made NetBeans fail on Javadoc generation for the
GitRevmavenTask class.
Using instead standard Java 5
[annotations](https://maven.apache.org/plugin-tools/maven-plugin-plugin/examples/using-annotations.html#POM_configuration)
this is no more an issue.
2018-07-13 07:25:58 +02:00
luccioman
e1bc035496 Ignore Eclipse projects config files derived from maven pom.xml 2018-07-13 07:12:57 +02:00
luccioman
dcad393fe5 Fixed exceeding max size of failreason_s Solr field on large link list
When using the 'From Link-List of URL' as a crawl start, with lists in
the order of one or more thousands of links, the failreason_s Solr field
maximum size (32kb) was exceeded by the string representation of the URL
must-match filter when a crawl URL was rejected because not matching.
2018-07-11 08:13:29 +02:00
luccioman
f467601561 Properly lock solrInstances for reboot and restoration of embedded Solr
Putting a synchronization lock directly on the solrInstances property
was ineffective as it is assigned a new (unlocked) instance in these
operations.
2018-07-08 08:57:59 +02:00
luccioman
9630f81306 Fixed small unnecessary lines of code 2018-07-08 08:15:26 +02:00
luccioman
26aa5f7a0f Suppress compilation warning on unit testing intentional failure 2018-07-08 08:14:07 +02:00
luccioman
876bcd2f54 Fixed useless comparison between int parameter and Long.MAX_VALUE 2018-07-08 08:11:01 +02:00
luccioman
534f09e92b Added and updated hint messages about remote crawler status
To help identify why remote crawl results may not be received.
2018-07-06 11:30:30 +02:00
luccioman
c726154a59 Fixed removal of URLs from the delegatedURL remote crawl stack
URLs were removed from the stack using their hash as a bytes array,
whereas the hash is stored in the stack as String instance.
2018-07-05 09:36:36 +02:00
luccioman
2bdd71de60 Added server side columns sorting on the Process Scheduler table
For easier usage of large tables in the Table_API_p.html page.
2018-07-04 10:28:32 +02:00
luccioman
bb51555830 Removed remaining unsafe accesses to SimpleDateFormat instances.
SimpleDateFormat must not be used by concurrent threads without
synchronization for parsing or formating dates as it is not thread-safe
(internally holds a calendar instance that is not synchronized).

Prefer now DateTimeFormatter when possible as it is thread-safe without
concurrent access performance bottleneck (does not internally use
synchronization locks).
2018-07-02 10:00:40 +02:00
reger
6b7883900c update bootstrap hosts 2018-07-02 00:00:04 +02:00
luccioman
39f7f5b074 Updated the JRE URL from 8u131 to 8u171 for the MS Windows installer 2018-06-30 14:27:37 +02:00
luccioman
f895745e1c Removed more unsafe concurrent accesses to SimpleDateFormat instances.
SimpleDateFormat must not be used by concurrent threads without
synchronization for parsing or formating dates as it is not thread-safe
(internally holds a calendar instance that is not synchronized).

Prefer now DateTimeFormatter when possible as it is thread-safe without
concurrent access performance bottleneck (does not internally use
synchronization locks).
2018-06-29 15:49:55 +02:00
luccioman
5c6c61809a Fixed JavaScript sorting of tables with cells containing an input field 2018-06-29 13:01:05 +02:00
luccioman
3885fd64a0 Fixed Table_API_p.html current table page loss on row editing.
Reset only to the first table page when the search query is modified
2018-06-28 15:34:53 +02:00
luccioman
e97580dfc7 Fixed unsafe conccurent access to generic SimpleDateFormat instances
SimpleDateFormat must not be used by concurrent threads without
synchronization for parsing or formating dates as it is not thread-safe
(internally holds a calendar instance that is not synchronized).

Prefer now DateTimeFormatter when possible as it is thread-safe without
concurrent access performance bottleneck (does not internally use
synchronization locks).
2018-06-28 14:59:23 +02:00
luccioman
38a3a5e5ad Fixed a NullPointerException case in the suggest api 2018-06-22 10:49:01 +02:00
luccioman
8811700e2e Upgraded Jetty dependency from 9.4.9 to 9.4.11 2018-06-20 09:33:26 +02:00
luccioman
d53c33e4ef Fixed potential infinite loop case (does not occur in current code base) 2018-06-20 07:51:59 +02:00
luccioman
a15ac8e0ca Made CrawlProfile loading tolerant to malformed json string attribute 2018-06-19 12:53:17 +02:00
luccioman
a715bb7876 Fixed rendering of solr mustNoMatch value on CrawlProfileEditor_p.xml 2018-06-19 12:50:28 +02:00
luccioman
0b302c5004 Do not block whole server startup on persisted crawl profile load error 2018-06-19 12:48:17 +02:00
luccioman
b159564c72 Properly render json string attributes in the crawl profile html editor 2018-06-19 12:46:50 +02:00
luccioman
4d9aa4ed1e Fixed default crawl profile solr mustnotmatch query from previous commit 2018-06-19 11:58:47 +02:00
luccioman
cced94298a Added a new crawler document filter type using Solr syntax
This makes possbile to set up much more advanced document crawl filters,
by filtering on one or more document indexed fields before inserting in
the index.
2018-06-19 10:12:20 +02:00
luccioman
2c155ece77 Fixed JUnit test after removal of unused Transformer 2018-06-19 07:07:18 +02:00
Michael Christen
e0dc632020 removed transformer
it was not used any more
2018-06-19 00:42:23 +02:00
luccioman
495ca57f61 Additional minor fix in Italian translation 2018-06-12 14:29:18 +02:00
luccioman
eb94986f95 Added Italian in available web interface languages list 2018-06-12 14:19:22 +02:00
luccioman
378fe3f079 Fixed various minor mistakes in italian translation 2018-06-12 14:18:29 +02:00
luccioman
6df1e543f3
Merge pull request #183 from SebastianoPistore/master
Added Italian translation.
2018-06-12 14:15:29 +02:00
luccioman
9bc7b6c39d Allow edtion of scheduled next execution dates for finer control
Can be useful more especially when scheduling many API calls over a long
period of time to precisely adjust each scheduled date/time.
2018-06-11 11:38:58 +02:00
Sebastiano Pistore
ecccc44865 Added Italian translation. 2018-06-10 15:11:50 +02:00
luccioman
40e8c7b89b Use the heavy ConcurrentUpdateSolrClient only when necessary
Prefer the lightweight HttpSolrClient when no updates are performed on
the remote Solr instance, as recommended by Solr documentation itself.
2018-06-08 11:18:29 +02:00
luccioman
bd4cfeda3f Add a max acceptable limit to the size of Solr responses on p2p search
Following activation of gzip compression on responses, to ensure
uncompressed content can fit on available memory.
2018-06-08 10:33:23 +02:00
luccioman
de4ea95687 Consistently allow gzip compression of remote Solr responses
Was already enabled when requesting remote Solr with https or with
authentication (as an external Solr index)
2018-06-07 15:20:37 +02:00
luccioman
cea8187161 Reuse expired connections evictors threads provided by apache and solr 2018-06-06 14:24:05 +02:00
luccioman
b5dc1f376f Made outgoing pools max total connections user configurable
For a finer control over the maximum simultaneously active outgoing
connections.
2018-06-06 09:36:50 +02:00
luccioman
387d646c0e Added gzip compression of responses returned to user-agents accepting it
Enabled as default, but can be disabled using the "Server Access
Settings" admin page.
2018-06-05 13:35:39 +02:00
luccioman
a7a4ba3287 Apply remote solr configured timeout on getting connection from pool 2018-06-02 17:38:14 +02:00