Commit Graph

5788 Commits

Author SHA1 Message Date
luccioman
17e004599d Started implementing optional https preference for protocol operations
Introduced through the new configurable setting
network.unit.protocol.https.preferred, defaulting to false for now.

Let choose to prefer using https when available on remote peers to
perform YaCy protocol operations including notably hello or transferRWI.

Not yet implemented for every YaCy protocol operations.
2017-12-15 11:28:46 +01:00
ScRe13
bb3d3fe074 fixed default loading default settings; load was populated with wrong value 2017-12-12 23:25:56 +01:00
reger
20bba135fe Show hide or show public surftip button depending on current config status,
to show the button to switch the status (hiding button of current status)
2017-12-10 01:25:20 +01:00
Michael Peter Christen
b907819cb4 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2017-12-09 22:29:54 +01:00
Michael Peter Christen
25573bd5ab added a crawl filter based on <div> tag class names
When a crawl is started, a new field to exclude content from scraping is
available. The field can be identified with the class name of div tags.
All text contained in such a div tag where the configured class name(s)
match are not indexed, while the remaining page is indexed.
2017-12-09 22:29:35 +01:00
luccioman
640fed2a9c Removed Java 1.8 no more necessary version checking (fixes issue #147)
Java 1.8 is by the way now a prerequisite to run from latest sources.
2017-12-08 15:26:46 +01:00
luccioman
d95b288f19 Removed use of deprecated Jetty IPAccessHandler for client filtering.
Upgraded to InetAccessHandler.
Added InetPathAccessHandler extension to InetAccessHandler to maintain
path patterns capability previously available in IPAccessHandler but
lost in InetAccessHandler.

Filtering on IPv6 addresses is now supported.

Support for deprecated pattern formats such as "192.168." and
"192.168.1.1/path" has been removed, but startup automated migration
should convert such patterns eventually present in serverClient.
2017-12-08 15:12:08 +01:00
Michael Peter Christen
607b39b427 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git
Conflicts:
	htroot/yacysearchitem.java
2017-12-07 15:25:41 +01:00
Michael Peter Christen
4355de0f3c (more!) evaluation of XRealIP from nginx reverse proxy 2017-12-07 15:16:11 +01:00
luccioman
f9cba827c0 Made "tld:" modifier case insensitive and IDN complient.
Thus allowing typing internationalized top-level domains with non ASCII
characters as tld: modifier.
2017-12-04 19:13:16 +01:00
luccioman
c5c3cc1274 Use HTTP Post operation for resetting memory monitoring state.
Fixes issue #145

Also added textual hint on the button, and display it only when it makes
sense, that is to say when the memory state is 'exhausted'.
2017-12-04 08:48:37 +01:00
luccioman
cb10daba92 Renamed Chinese & Greek lng files using ISO639-1 codes.
Previously named with their ISO 3166-1 country code : this way, when
setting language to "Browser" in ConfigBasic.html, it didn't work
properly when browser preferred language was Chinese or Greek as their
respective language codes are "zh" and "el" (not "cn" and "gr" which are
their country codes)
2017-11-04 11:06:05 +01:00
luccioman
4b61edff32 Added a help link to ISO 639-1 language codes list ref 2017-11-03 10:34:36 +01:00
luccioman
a994d439af Added description of spatial restrictions in search options 2017-11-02 08:57:00 +01:00
luccioman
8a48f80909 Added language HTML attribute to the search home page. 2017-10-31 08:19:04 +01:00
luccioman
5ff76fdcb9 Fixed spelling 2017-10-31 07:52:30 +01:00
luccioman
2c3f0ff9e8 Updated search page keyboard shortcuts descriptions. 2017-10-31 07:44:37 +01:00
luccioman
af825e9ffc Use accessible labels for search home page radio buttons. 2017-10-30 08:07:59 +01:00
luccioman
8e732d437c Enable HTTP Digest authentication for non admin users.
Also ensure authentication is not lost by Digest timeout when navigating
between index.html and search results page.

This way, running searches with extended features on a remote peer or a
password protected peer works with a regular user (with "Extended
search" rights). 
When authenticating on the search page with a user without "Extended
search" rights, it appears as authenticated, but has just its usual
access to the public search features.
2017-10-26 07:51:18 +02:00
luccioman
5161451a35 Stay authenticated when going to the search start page.
Otherwise, when authenticated as admin and navigating from search
results or admin pages to the search start page (/index.html), if
nothing is done on that page within HTTP Digest Auth timeout (about
2mn), then search is performed without authentication and so without
extended search features.
2017-10-24 09:54:54 +02:00
luccioman
d0bed78d02 Use the same top nav bar on index.html and search results.
Thus eventually including the same optional login link/status in the
search start page than in the results page, for the same convenient
login without the need to use the Administration section.
2017-10-24 09:34:03 +02:00
luccioman
f678394ce5 Fixed loss of index page form values on 'more options' link click.
Restores the behavior introduced eleven years ago (see commit
479861a3cf) and lost by mistake 3 years
ago (see commit 617dd9c97b), when the
click handler started referencing a missing HTML id.
2017-10-23 18:28:11 +02:00
luccioman
af198b990b Added an optional login link/status to the search public top nav bar.
Thus allowing a more convenient way (wihout the need to go to the admin
section) to login when searching on your remote or password protected
peer and benefit from extended search features such as Heuristics,
Bookmarking or JavasScript resorting.

Can be disabled using the ConfigSearchPage_p.html.
2017-10-21 10:57:36 +02:00
luccioman
1de86cf1bf Fixed JPEG snapshot resizing when running on OpenJDK.
Resizing JPEG snapshot images through /api/snapshot.jpg failed when
running on OpenJDK, but rendered successfully with a Oracle JDK.
Details in mantis 772 ( http://mantis.tokeek.de/view.php?id=772 ).

Removing any alpha component (useless in snapshot images) from the
rendered resized image solves the issue.
2017-10-19 09:27:52 +02:00
luccioman
a17a418e78 Fixed NullPointerException cases on snapshot images parsing. 2017-10-18 08:31:18 +02:00
luccioman
285f0d6a39 Consistently encode snapshot image with format requested on the API.
Previously, calling /api/snapshot.png rendered JPEG encoded images.
2017-10-18 07:53:07 +02:00
luccioman
4da15db998 Fixed search result Snapshots link.
Previously rendered as a broken URL containing the absolute file path of
a snapshot on the search server.

Now rendered as a valid URL linking to the /api/snapshot API to provide
available snapshot content. Snapshot format is selected among the
available ones in the following order of preference  : JPG/PNG, PDF, and
XML.
2017-10-17 09:41:58 +02:00
luccioman
fe75f326d8 Fixed ProfilingGraph calculation integer overflows and added test class.
Complementary to fix proposed in PR #128 by @otteresk.
2017-10-16 09:18:12 +02:00
luccioman
8303e15419 Reduced number of search navigators refresh requests in JS resort mode
The SearchEvent listen to changes on each of its navigators, and the
information about their overall state is sent with each fetched search
item (as a "data-nav-generation" attribute). Then the browser can
regularly fetch a fresh version of yacysearchtrailer.html only if
necessary (when that nav-generation value change).
2017-10-12 07:16:19 +02:00
luccioman
2ac78e2cca Addedd missing parameters to yacysearchtrailer call on JS resort mode 2017-10-11 07:13:28 +02:00
luccioman
dbff7b14fc Add a configurable limit to tags initially displayed in search results
When the limit is reached, a button allow expanding/collapsing remaining
tags.

When this feature is activated without a limit to the number of
displayed tags, when encountering search results with a very large
number of keywords, the results page can become almost unusable (very
long vertical scrollbar)
2017-10-09 14:13:46 +02:00
reger
f8c7d0265e Adjust tags css style in ConfigSearchPage to equal search page 2017-10-07 06:13:22 +02:00
luccioman
fcea6def72 Added textual hints to language radio buttons labels
As an help and accessible alternative to visual styling marking  whether
a language is available in browser preferred lang mode.
2017-10-02 10:05:57 +02:00
luccioman
27ab733685 Ensure private search features are not lost on Digest auth timeout
This is a fix for mantis 766 ( http://mantis.tokeek.de/view.php?id=766 )

Since the upgrade to Digest authentication, access to protected search
features was indeed disabled once the Digest nonce timed out.

After Digest auth timeout the browser no more sent authentication
information and as the search results page is not private, protected
features were simply be hidden without asking browser again for
authentication.

Adding a supplementary parameter when accessing the search results as
authenticated fixes this.
2017-09-29 19:18:12 +02:00
reger
dd82f85953 Add links to the optional keyword tags of search result
If swichted on link (click) to the tag adds the keyword to the search query.
If a keyword navigator is active the selected keyword adds or replaces 
a query keyword: modifier (currently replace was choosen as multiple 
keywords are not fully supported yet)
2017-09-28 00:46:49 +02:00
luccioman
fc28c58731 Added missing accessible labels to ConfigSearchPage_p.html 2017-09-26 14:58:30 +02:00
luccioman
8294374c10 Fixed ConfigSearchPage_p HTML validation errors.
Validated with Nu Html Checker 17.9.0
2017-09-26 07:59:44 +02:00
luccioman
57a33aefb0 Removed unnecessary max counts init on empty search navigators. 2017-09-25 15:21:17 +02:00
luccioman
b1e7bd0dd6 Restrict Search Result Layout modification to HTTP POST only. 2017-09-25 14:54:35 +02:00
luccioman
ef8aea7f8d Made the dates navigator max elements number user configurable.
Also used object properties on QueryParams instances, rather than using
mutable class (static) properties.
2017-09-25 09:19:08 +02:00
luccioman
0b0980b364 Improved accessibility of histograms widgets.
Added keyboard navigation support and missing WAI-ARIA attributes.

Tested with NVDA 2017.3 screenreader on recent major browsers.
2017-09-22 11:00:46 +02:00
luccioman
62c7cd9a77 Upgraded JavaScript lib raphael.js from 2.1.3 to 2.2.7 2017-09-20 07:59:20 +02:00
luccioman
cbbc7b43d3 Refresh paginations buttons instead of fully rendering each time.
This prevent the already displayed pagination buttons to be unresponsive
when clicking on them while the rendering JS function is running.
2017-09-18 17:36:07 +02:00
luccioman
18412dca21 Handle JS refreshing of belatedly added search navigators 2017-09-16 10:13:09 +02:00
luccioman
9049a926a5 Restrict JS results resorting to authenticated users.
Until a more efficient DOM refresh model needing less XHR requests per
search is implemented.
2017-09-16 09:26:08 +02:00
luccioman
4ab961fa46 Added HTML ids to search navigators for a more reliable JS refreshing. 2017-09-15 14:23:49 +02:00
luccioman
ad61a3afed Results JS resort : properly handle results with same ranking value. 2017-09-15 12:16:24 +02:00
luccioman
57a1007772 Added new graphical setting for browser JS/On demand results resorting. 2017-09-15 11:12:23 +02:00
luccioman
d00a35576c Apply JS resort only when currently relevant : p2p text search 2017-09-15 09:51:34 +02:00
luccioman
4e3c928d31 Do not animate unnecessarily when changing page on JS sorted results. 2017-09-14 09:36:55 +02:00