Commit Graph

13566 Commits

Author SHA1 Message Date
luccioman
9e5846a26e Small fix on svg parser error message 2018-02-28 12:23:52 +01:00
luccioman
11611dbdcf Reuse existing File copy function to handle audio parser tmp files 2018-02-28 11:58:32 +01:00
luccioman
f77f8f40f9 Factored audio parser tag processing 2018-02-28 08:19:13 +01:00
luccioman
9a7a353d0e Removed some unnecessary intermediate list creation on array copy. 2018-02-28 07:49:40 +01:00
luccioman
fb6457f5bc Fixed NPE case when on audio resource parsed with null tag 2018-02-28 07:31:32 +01:00
luccioman
c3ff50c17a Updated the list of audio file formats supported by the audioTagParser
Follows upgrade to Jaudiotagger dependency to version 2.2.5.
2018-02-27 18:04:12 +01:00
luccioman
5753ce0ac5 Upgraded Jaudiotagger dependency from 2.0.3 to 2.2.5 2018-02-26 09:17:26 +01:00
reger
aaa0ec6613 upd to commons-compress-1.16.1 2018-02-23 19:17:09 +01:00
luccioman
07e8628853 Added HTML5 embedded audio for results playing on supporting browsers
Restricted to authenticated or localhost users only to prevent
redistribution license issues.
2018-02-23 11:41:50 +01:00
luccioman
1b90479a76 Added missing vocabulary navigator increment on results from RWI 2018-02-23 11:36:03 +01:00
luccioman
46c9da6428 Allow creation of vocabularies from remote CSV file URLs. 2018-02-21 08:41:13 +01:00
luccioman
17c7a85f18 Make StreamResponse usable in Java try-with-resources statements 2018-02-21 08:38:35 +01:00
luccioman
348d07a999 Enforced controls on vocabulary editing operations. 2018-02-20 12:22:54 +01:00
luccioman
2532db2ce6 Vocabulary editor : use accessible labels and CSS for elements position 2018-02-20 11:22:34 +01:00
luccioman
ac14437316 Vocabulary_p.html : richer semantics for HTML tables
Also replaced deprecated attributes
2018-02-19 15:15:02 +01:00
luccioman
b67742336e Provide user interface messages on vocabulary creation read/write errors 2018-02-19 11:48:40 +01:00
luccioman
ea57763294 Mark vocabulary name field as required using html instead of JavaScript 2018-02-19 09:35:44 +01:00
luccioman
39ec8cba37 Fixed Vocabulary_p.html HTML validation errors.
Validated with Validated with Nu Html Checker 17.11.1.
2018-02-19 08:54:42 +01:00
luccioman
7c644090ff Fixed CrawlStartExpert.html HTML validation errors
Validated with Nu Html Checker 17.11.1
2018-02-16 11:35:15 +01:00
luccioman
519fc9a600 Issue #156 : new option to clean up (or not) search cache on crawl start
Prevent also unnecessary search event cache clean-up on each access to
the crawl monitor page (Crawler_p.html).
2018-02-16 10:19:41 +01:00
luccioman
eeb5fbb160 Upgraded maven JUnit test dependency from 4.11 to 4.12 2018-02-16 08:51:26 +01:00
luccioman
3e8dd90211 Use https rather than http in links and queries to openstreetmap.org 2018-02-15 19:14:07 +01:00
luccioman
8d7099a081 Handle escaped line breaks and separators in vocabulary import from CSV 2018-02-15 07:29:17 +01:00
luccioman
09f93fed0e Added a line start field for vocabulary import from CSV file
As a convenience to ignore eventual CSV header lines
2018-02-14 10:31:09 +01:00
luccioman
d28d612069 Added option to choose field delimiter in vocabulary import from CSV 2018-02-14 09:29:04 +01:00
luccioman
3a973dbb23 Removed unused import 2018-02-14 09:27:17 +01:00
luccioman
95f1954c78 Adjusted last blacklist entry example for a more accurate description
As discussed in issue #160 , blacklist entries can indeed currently not
be "complete" regular expressions, but must be structured as a domain
part, a separator character ('/'), and a path part.
2018-02-14 07:51:07 +01:00
luccioman
e9527cd0e5 Reuse the same Pattern instance when matching multiple key/values 2018-02-14 07:14:25 +01:00
luccioman
dbf4c1cd76 Improved blacklist entries editing operations :
- Fixes issue #160 : handle properly syntax exceptions with a user
friendly message
- Fixes loss of information on multiple blacklist entries editions
- Fixes loss of entries when moving entries from one list to another
2018-02-13 18:24:26 +01:00
reger
5df72c1c65 Remove now obsolete html for language-nav and ISO639 jar reference 2018-02-12 01:16:14 +01:00
reger
87077b8fb6 Adjust and move Language Navigator to be member of the navigatior plugin
list.
2018-02-12 00:16:34 +01:00
reger
73c6ce7ae5 upd to httpclient-4.5.5 2018-02-10 20:01:35 +01:00
luccioman
eb20589e29 Fixed issue #158 : completed div CSS class ignore in crawl 2018-02-10 11:56:28 +01:00
luccioman
fa65fb1a03 Fixed loss of search modifiers on bookmark, recommand or delete result 2018-02-08 14:31:26 +01:00
luccioman
0cdee4e26a Fixed loss of "meanCount" search param when using facets or page buttons
Then on new search queries, no suggestions at all could be displayed.
2018-02-08 08:07:30 +01:00
luccioman
117a859879 Do not clear all search modifiers when unselecting one modifier.
Previously, when clicking a selected facet in the search results page to
unselect it, all other eventually selected modifiers/facets were also
removed.
2018-02-07 15:54:46 +01:00
luccioman
33593c22e9 Fixed loss of other modifiers on keywords/tags search navigation links 2018-02-06 17:17:13 +01:00
luccioman
a9dc0874c0 Remove old query terms from search results suggestions links.
Especially when old terms were misspelled, suggestions links then
provided most of the time empty results.
2018-02-06 15:14:14 +01:00
luccioman
c71b545235 Enable results suggestions (Did you Mean) even when RWI is not enabled.
RWI is no more necessary for suggestions processing since commit
c40ba51ca6.
Revealed by a question about spell check from ouahpiti on YaCy forum
(http://forum.yacy-websuche.de/viewtopic.php?f=23&t=6084 ).
2018-02-06 12:33:44 +01:00
luccioman
9412881230 Added basic support for autotagging microdata annotated item types.
With the appropriate vocabulary settings in Vocabulary_p.html page, this
can produce Vocabulary search facets displaying item types referenced in
html documents by microdata annotation.
Tested notably, but not limited to, vocabulary classes/types defined by
Schema.org and Dublin Core.
2018-02-06 10:25:38 +01:00
luccioman
5a14d34a7d Refactoring : documented and extracted autotagging processing functions. 2018-02-02 10:27:36 +01:00
luccioman
58b9834729 Added HTML microdata typed items parsing capability.
This adds the possibility for the HTML parser to gather typed items URLs
annotated in HTML tags with itemscope and itemtype attributes (see
microdata specification https://www.w3.org/TR/microdata/ ), notably
Types from the schema.org vocabulary, but also Types/Classes from any
other vocabulary, such as the common ones listed in the RDFa core
context ( https://www.w3.org/2011/rdfa-context/rdfa-1.1.html ).
2018-02-02 09:31:40 +01:00
luccioman
80fb1026d0 Create recrawl requests with the relevant crawl profile.
Recrawl default profile was previously effectively used for crawl
stacker acceptance check, but request entries were indeed still created
with the "snippetGlobalText" profile.
2018-01-30 21:00:18 +01:00
luccioman
539925a275 Added an utility to generate/update XLIFF master file from lng files. 2018-01-29 18:34:47 +01:00
luccioman
41a6b052d9 Updated master and French translation for the IndexReIndexMonitor_p page 2018-01-29 16:51:00 +01:00
luccioman
fa6d030b0b Moved dbtest to the test source folder. 2018-01-29 14:03:01 +01:00
luccioman
6cd3847d0a Fixed NullPointerException case on Table init with relative file path.
Can occur for example when running dbtest with relative test table file
name (wihout explicit parent folder).
2018-01-29 14:00:43 +01:00
luccioman
28883d8a71 Shutdown daemon threads at the end of dbtest 2018-01-29 13:56:37 +01:00
luccioman
929e0d6eae Replaced improper ByteBuffer.equals() implementation by Arrays.equals()
Renamed also ByteBuffer.equals() to startsWith() as this is the
appropriate function implementation semantics.
2018-01-29 13:38:25 +01:00
luccioman
098ee63911 Added a manual performance test for the HostBalancer.
Consequently to the report in mantis 776
(http://mantis.tokeek.de/view.php?id=776).

Running the perfs test with different control parameters seems to reveal
that the YaCy's RowHandleMap used in the balancer depthCache is finally
more efficient than for example the ConcurrentHashMap from JDK 8.
2018-01-28 12:41:56 +01:00