Commit Graph

5920 Commits

Author SHA1 Message Date
luccioman
88d0ed676c Render http status instead of null responses on snapshot api errors 2018-10-19 10:12:10 +02:00
luccioman
92e10d7d1c Added a crawl start hint message on availability or not of wkhtmltopdf
As this tool is required to produce pdf snapshots
2018-10-16 08:02:43 +02:00
luccioman
8852c97cee Added basic styling for cleaner rendering of missing image snapshots
For the output of the Solr snapshots writer
2018-10-15 18:19:57 +02:00
luccioman
746e0e788d Render a relevant HTTP status code on snapshot image rendering error
Instead of a null response body which is not very helpful.
2018-10-14 10:30:30 +02:00
luccioman
753bda1409 Fixed remaining blacklist entries improper decoding of '+' character
In the blacklist cleaner and import/export administration pages.
2018-10-08 16:50:02 +02:00
luccioman
61c337f29a Decode blacklist entries for easier edition of non ascii chars
Not using the JDK URLDecoder.decode() function, as it strips '+'
characters when they occur after '?' (both characters having regular
expression semantics when used in blacklist path patterns)
2018-10-04 09:33:58 +02:00
luccioman
ed93221fa1 Improved normalization of blacklist path patterns having non ascii chars
Normalize blacklist path patterns using percent-encoding, at pattern
edition in web interface and at loading from configuration files.

Fixes issue #237
2018-10-02 14:36:13 +02:00
luccioman
d23578efc3
Merge pull request #240 from ivanhercaz/fixEnglishBookmarksPage
Fix English Bookmarks.html
2018-10-02 07:27:47 +02:00
ivanhercaz
1dafc85d33 typo fix in Bookmarks.html 2018-09-30 01:00:43 +01:00
luccioman
3d14fb51c5 Removed now unused Java import in addition to modification from PR #239 2018-09-26 08:47:13 +02:00
otter
8820d8d7c7 replace current date by FailDate 2018-09-25 20:43:58 +02:00
luccioman
c409ec089c Hide password values from visible HTML in the Advanced Config page
Fixes issue #228
2018-09-21 09:59:32 +02:00
luccioman
75b9cd53cc Use accessible labels in the Server Access Settings page 2018-09-19 09:32:59 +02:00
luccioman
4ed055bcdf Enforced access controls to System settings pages 2018-09-19 09:18:36 +02:00
luccioman
de6820d257 Updated html input field type for seed upload with file method
- To meet current browsers security rules, which prevent selecting a
full file path with an html input field of type 'file'
 - As it does not make sense to select a local file path when a the
administered YaCy server is remote (not on the same computer as the
browser)
2018-09-17 08:07:27 +02:00
luccioman
10548229af Fixed rendering of the YMarks.html page
Also to clarify which pages still depends on old JQuery and JQuery UI
dependencies.
2018-09-12 07:29:25 +02:00
luccioman
bdd6ec3fff Fetch result pages one by one when scrolling in portal search widget
To prevent unnecessary load and items retrival errors on backend
2018-08-28 15:49:30 +02:00
luccioman
b46dc4fc94 Fixed portal search widget results favicon url 2018-08-28 15:00:18 +02:00
luccioman
fa96637a84 Configured local peer as default portal search widget backend
Rather than relying on a peer eventually deployed on search.yacy.net
2018-08-28 14:59:25 +02:00
luccioman
44efb2f868 Removed implicit global JavaScript variables from portal search widget 2018-08-28 14:40:57 +02:00
luccioman
79643c40bf Limit search API calls rate when typing in the search portal widget 2018-08-28 11:39:16 +02:00
luccioman
39dd29a484 Replaced RWI ranking JQuery sliders with standard HTML range inputs
Considering that the sliders usage on that page is very basic, using
standard HTML5 inputs of type "range" has here the following advantages
:
 - better keyboard accessibility
 - remove not very necessary additional jquery dependencies

Today browsers suport for range inputs is good, and even on old
unsupporting browsers such as IE < 10 they nicely fall back to text
inputs.
2018-08-28 08:34:23 +02:00
luccioman
1b866c6076 Added possibility to hide or show image results with rendering errors
When searching images, thumbnails that could not be rendered (because of
a load error such as HTTP 404, networking issue or an internal error on
the rendering servlet) are now hidden as default. But can be revealed
with a button if desired.

Fix for issue #217
2018-08-24 09:13:12 +02:00
luccioman
5b60b4225f Fixed encoding of '+' character on search pages links
As revealed by issue #216
2018-08-20 18:44:04 +02:00
luccioman
b726b2b532 Removed unnecessary '+' character URL decoding from search query
Manually replacing '+' character or "%20" by a space character in the
search query parameter was necessary in YaCy a long time ago to properly
decode application/x-www-form-urlencoded format (commit
9842fab6e4 in 2010).
Since the introduction of Jetty as the embedded HTTP server (commit
4b77733e59 in 2013), this is no more
necessary as Jetty internals already do this for us in
org.eclipse.jetty.util.UrlEncoded.decodeUtf8To().

So we can remove now this duplicated decoding as it prevents a proper
use of the '+' character in search requests, as reported in issue #216.
2018-08-20 08:10:39 +02:00
luccioman
0efc6c89ef Fixed rendering of crawl queues page for URLs with raw IPV6 addresses 2018-08-13 14:36:22 +02:00
luccioman
0e976e9030 Added a link to MediaWiki dumps summary in import page for convenience 2018-08-08 08:11:02 +02:00
luccioman
ecd4535eb6 Prevent entering empty OpenSearch URLs in ConfigHeuristics_p.html
In order to early prevent adding invalid configuration entries to the
heuristicopensearch.conf file, as revealed the issue #209.
2018-08-06 12:07:47 +02:00
luccioman
1ca9cb6bd9 Fixed a NullPointerException case, reported in issue #209 2018-08-06 12:04:44 +02:00
luccioman
8a29551c54 Upgraded the OpenGeoDB dump URL
The status of the library in the DictionaryLoader_p.html page now also
advertises the user that an upgrade can be applied when an older dump is
already loaded.

Upgrade applied as suggested by Niklas Andrus @fapth_gitlab on Gitter
chat.
2018-08-03 18:39:41 +02:00
luccioman
bf4f320b16 Optionally render the response header when using the Solr html writer
With params rendered as html input fields for conveniently modifying
params values and refreshing results.
2018-07-23 18:36:57 +02:00
luccioman
88e6ce23c9 Consistently render empty facets and facets having only entries at zero 2018-07-17 07:36:39 +02:00
luccioman
534f09e92b Added and updated hint messages about remote crawler status
To help identify why remote crawl results may not be received.
2018-07-06 11:30:30 +02:00
luccioman
c726154a59 Fixed removal of URLs from the delegatedURL remote crawl stack
URLs were removed from the stack using their hash as a bytes array,
whereas the hash is stored in the stack as String instance.
2018-07-05 09:36:36 +02:00
luccioman
2bdd71de60 Added server side columns sorting on the Process Scheduler table
For easier usage of large tables in the Table_API_p.html page.
2018-07-04 10:28:32 +02:00
luccioman
f895745e1c Removed more unsafe concurrent accesses to SimpleDateFormat instances.
SimpleDateFormat must not be used by concurrent threads without
synchronization for parsing or formating dates as it is not thread-safe
(internally holds a calendar instance that is not synchronized).

Prefer now DateTimeFormatter when possible as it is thread-safe without
concurrent access performance bottleneck (does not internally use
synchronization locks).
2018-06-29 15:49:55 +02:00
luccioman
5c6c61809a Fixed JavaScript sorting of tables with cells containing an input field 2018-06-29 13:01:05 +02:00
luccioman
3885fd64a0 Fixed Table_API_p.html current table page loss on row editing.
Reset only to the first table page when the search query is modified
2018-06-28 15:34:53 +02:00
luccioman
e97580dfc7 Fixed unsafe conccurent access to generic SimpleDateFormat instances
SimpleDateFormat must not be used by concurrent threads without
synchronization for parsing or formating dates as it is not thread-safe
(internally holds a calendar instance that is not synchronized).

Prefer now DateTimeFormatter when possible as it is thread-safe without
concurrent access performance bottleneck (does not internally use
synchronization locks).
2018-06-28 14:59:23 +02:00
luccioman
38a3a5e5ad Fixed a NullPointerException case in the suggest api 2018-06-22 10:49:01 +02:00
luccioman
b159564c72 Properly render json string attributes in the crawl profile html editor 2018-06-19 12:46:50 +02:00
luccioman
cced94298a Added a new crawler document filter type using Solr syntax
This makes possbile to set up much more advanced document crawl filters,
by filtering on one or more document indexed fields before inserting in
the index.
2018-06-19 10:12:20 +02:00
Michael Christen
e0dc632020 removed transformer
it was not used any more
2018-06-19 00:42:23 +02:00
luccioman
eb94986f95 Added Italian in available web interface languages list 2018-06-12 14:19:22 +02:00
luccioman
9bc7b6c39d Allow edtion of scheduled next execution dates for finer control
Can be useful more especially when scheduling many API calls over a long
period of time to precisely adjust each scheduled date/time.
2018-06-11 11:38:58 +02:00
luccioman
b5dc1f376f Made outgoing pools max total connections user configurable
For a finer control over the maximum simultaneously active outgoing
connections.
2018-06-06 09:36:50 +02:00
luccioman
387d646c0e Added gzip compression of responses returned to user-agents accepting it
Enabled as default, but can be disabled using the "Server Access
Settings" admin page.
2018-06-05 13:35:39 +02:00
luccioman
a1990202ab Fixed unresolve-pattern case on old html title 2018-06-02 14:54:05 +02:00
luccioman
35826a3091 Added a search page customization setting to display or not favicons
If not interested in displaying this on your search results and notably
on a peer with limited resources this can help saving some CPU and
outgoing network connections.
2018-05-25 11:13:43 +02:00
luccioman
79bd9f623a Updated YaCy home page embedded links from http to https scheme 2018-05-22 17:46:12 +02:00