Commit Graph

13946 Commits

Author SHA1 Message Date
luccioman
2feec354a5 Added an icon matching Snapcraft packaging icon size requirements 2018-09-10 22:14:34 +02:00
luccioman
a3361d5ee8 Renamed Snap with a name detected as available on the Snap store 2018-08-31 10:14:27 +02:00
luccioman
9b1c87033b Fixed logs folder checking and creation
Previously, if YaCy log folder was for example at
`/home/user/yacy/DATA/LOG`, because of improper truncation of log path,
an unnecessary directory creation was atempted at `/home/us`.
2018-08-31 08:34:28 +02:00
luccioman
3f9abec3c5 Added a first version of Snapcraft configuration file for Snap packaging 2018-08-30 18:21:14 +02:00
luccioman
c29588dd6a Made possible to provide an absolute data root path for start script
Previously, only a path relative to the user home folder could be
provided
2018-08-30 18:16:22 +02:00
luccioman
bdd6ec3fff Fetch result pages one by one when scrolling in portal search widget
To prevent unnecessary load and items retrival errors on backend
2018-08-28 15:49:30 +02:00
luccioman
b46dc4fc94 Fixed portal search widget results favicon url 2018-08-28 15:00:18 +02:00
luccioman
fa96637a84 Configured local peer as default portal search widget backend
Rather than relying on a peer eventually deployed on search.yacy.net
2018-08-28 14:59:25 +02:00
luccioman
44efb2f868 Removed implicit global JavaScript variables from portal search widget 2018-08-28 14:40:57 +02:00
luccioman
79643c40bf Limit search API calls rate when typing in the search portal widget 2018-08-28 11:39:16 +02:00
luccioman
39dd29a484 Replaced RWI ranking JQuery sliders with standard HTML range inputs
Considering that the sliders usage on that page is very basic, using
standard HTML5 inputs of type "range" has here the following advantages
:
 - better keyboard accessibility
 - remove not very necessary additional jquery dependencies

Today browsers suport for range inputs is good, and even on old
unsupporting browsers such as IE < 10 they nicely fall back to text
inputs.
2018-08-28 08:34:23 +02:00
luccioman
a8078c22e4
Merge pull request #220 from pnhofmann/master
Improve Dockerfile
2018-08-25 10:43:38 +02:00
luccioman
1b866c6076 Added possibility to hide or show image results with rendering errors
When searching images, thumbnails that could not be rendered (because of
a load error such as HTTP 404, networking issue or an internal error on
the rendering servlet) are now hidden as default. But can be revealed
with a button if desired.

Fix for issue #217
2018-08-24 09:13:12 +02:00
Philipp Hofmann
04c9584326 Docker: merge RUN instructions for less layer (-3) 2018-08-23 13:33:31 +02:00
luccioman
d03c098b54 Removed deprecated warning comments about imports and Debian installer
Deprecated by commit be5d3a1066 , as
classpath is now defined in yacycore.jar Manifest file.
2018-08-22 22:35:00 +02:00
luccioman
5b60b4225f Fixed encoding of '+' character on search pages links
As revealed by issue #216
2018-08-20 18:44:04 +02:00
Philipp Hofmann
3121825fba Remove executable (x) permission of 2 files
* docker/Dockerfile.alpine
* docker/Readme.md
2018-08-20 16:46:03 +02:00
Philipp Hofmann
42734175c8 Dockerfile: Improve package cache update
* Alpine-Image: If --no-cache is used, apk update is not necessary
* Debian-Image: Remove /var/lib/apt/lists to reduce image size
2018-08-20 16:45:38 +02:00
Philipp Hofmann
3f2a2f7577 Dockerfile: Remove bad whitespaces 2018-08-20 14:43:05 +02:00
luccioman
b726b2b532 Removed unnecessary '+' character URL decoding from search query
Manually replacing '+' character or "%20" by a space character in the
search query parameter was necessary in YaCy a long time ago to properly
decode application/x-www-form-urlencoded format (commit
9842fab6e4 in 2010).
Since the introduction of Jetty as the embedded HTTP server (commit
4b77733e59 in 2013), this is no more
necessary as Jetty internals already do this for us in
org.eclipse.jetty.util.UrlEncoded.decodeUtf8To().

So we can remove now this duplicated decoding as it prevents a proper
use of the '+' character in search requests, as reported in issue #216.
2018-08-20 08:10:39 +02:00
luccioman
baa7154486 Upgraded Apache PDFBox dependency from 2.0.9 to 2.0.11
Release notes at
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310760&version=12343466
and https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310760&version=12342889
2018-08-18 12:39:58 +02:00
luccioman
54fbe166ba Updated pdf cache clear steps consistently with current pdfbox version
- Removed calls to no more existing clearResources functions (on PDFont
class and its children) since upgrade to pdfbox 2.n.n
- Removed hacky usage of protected internal ClassLoader function. This
removes the warnings displayed when running with JDK9 or JDK10 :

     [java] WARNING: Illegal reflective access by
net.yacy.document.parser.pdfParser$ResourceCleaner (file:<path>) to
method java.lang.ClassLoader.findLoadedClass(java.lang.String)
     [java] WARNING: Please consider reporting this to the maintainers
of net.yacy.document.parser.pdfParser$ResourceCleaner
     [java] WARNING: Use --illegal-access=warn to enable warnings of
further illegal reflective access operations
     [java] WARNING: All illegal access operations will be denied in a
future release

Crawling thousands of pdf documents from various sources after
modifications applied, revealed no new memory leak related to pdfbox
(measurements done with JVisualVM).
2018-08-16 18:23:42 +02:00
Erik Dominikus
f04580ecfd Add contributor guidelines; closes #214 2018-08-15 23:23:30 +07:00
luccioman
685122363d Added a parser for XZ compressed archives.
As suggested by LA_FORGE on mantis 781
(http://mantis.tokeek.de/view.php?id=781)
2018-08-15 10:07:39 +02:00
luccioman
8ce9c066bf Updated the JRE URL from 8u171 to 8u181 for the MS Windows installer 2018-08-14 08:41:23 +02:00
luccioman
0efc6c89ef Fixed rendering of crawl queues page for URLs with raw IPV6 addresses 2018-08-13 14:36:22 +02:00
luccioman
4ee14ff3c5 Fixed NullPointerException case on malformed crawl queue folder name 2018-08-13 14:35:26 +02:00
luccioman
21ad9435ec Fixed crawl queue folder naming for IPv6 hosts on MS Windows filesystems
As reported by @vikulin in issue #187, crawling websites using a raw
IPv6 address as host name in their URL failed when running on Microsoft
Windows platforms (FAT32 or NTFS filesystems) when YaCy crawler created
the crawl queue folder, as the ':' character which is part of an IPV6
address is forbidden on these filesystems.
2018-08-11 10:02:26 +02:00
luccioman
0e976e9030 Added a link to MediaWiki dumps summary in import page for convenience 2018-08-08 08:11:02 +02:00
luccioman
1a91e87b05 Upgraded commons-compress dependency from version 1.16.1 to 1.17 2018-08-08 08:06:24 +02:00
luccioman
f2c479fe88 Cleaned up unused old jar files not removed on previous Solr upgrade 2018-08-08 08:04:33 +02:00
luccioman
ecd4535eb6 Prevent entering empty OpenSearch URLs in ConfigHeuristics_p.html
In order to early prevent adding invalid configuration entries to the
heuristicopensearch.conf file, as revealed the issue #209.
2018-08-06 12:07:47 +02:00
luccioman
1ca9cb6bd9 Fixed a NullPointerException case, reported in issue #209 2018-08-06 12:04:44 +02:00
luccioman
8a29551c54 Upgraded the OpenGeoDB dump URL
The status of the library in the DictionaryLoader_p.html page now also
advertises the user that an upgrade can be applied when an older dump is
already loaded.

Upgrade applied as suggested by Niklas Andrus @fapth_gitlab on Gitter
chat.
2018-08-03 18:39:41 +02:00
luccioman
373edf9eac Adjusted yjson Solr writer to support responses from an external Solr
Worked previously only with responses from YaCy embedded Solr, now able
to render the response when YaCy is configured to use an external Solr
index.
2018-07-31 16:22:21 +02:00
luccioman
87bd17b1cf Simplified a little bit the RSS OpenSearch Solr writer 2018-07-31 16:02:50 +02:00
luccioman
dc49ca9c27 Fixed a NPE case on the Solr OpenSearch response writer
Occurred when omitHeader parameter is set to true
2018-07-29 16:30:37 +02:00
luccioman
f4267ed247 Made Solr OpenSearch RSS writer compatible with external Solr index
Worked previously only with responses from YaCy embedded Solr, now able
to render the response when YaCy is configured to use an external Solr
index.
2018-07-28 11:03:31 +02:00
luccioman
2bbf070f57 Upgraded icu4j dependency from 61.1 to 62.1 2018-07-26 09:39:54 +02:00
luccioman
ede8ae6697 Fixed few technical mistakes in updated Chinese translation from PR #188 2018-07-26 08:27:21 +02:00
luccioman
1e09a0284b
Merge pull request #188 from tangdou1/patch-3
small update in zh.lng
2018-07-26 08:22:13 +02:00
luccioman
b1410f593a Fixed stylesheet relative URLs rendering in Solr html writer
Relative URLs to CSS stylesheets were not properly rendered when using
the Solr html response writer and the "/solr/collection1/select" entry
point instead of "/solr/select".
2018-07-25 08:03:25 +02:00
luccioman
89c59814da Improved rendering of the Solr api relative url in the html writer
In order to have a consistent relative url when using either
/solr/select or /solr/collection1/select entry point.
2018-07-24 10:13:55 +02:00
luccioman
bf4f320b16 Optionally render the response header when using the Solr html writer
With params rendered as html input fields for conveniently modifying
params values and refreshing results.
2018-07-23 18:36:57 +02:00
luccioman
313204ae2c Override qf and df Solr params with defaults only when they are not set 2018-07-23 13:50:24 +02:00
tangdou1
0ff2ca8f01
small update in zh.lng 2018-07-23 17:04:54 +08:00
luccioman
88e6ce23c9 Consistently render empty facets and facets having only entries at zero 2018-07-17 07:36:39 +02:00
luccioman
6831bdffb5 Fixed minor technical issues on Chinese updated translations 2018-07-17 07:08:30 +02:00
luccioman
e03c464f16
Merge pull request #186 from tangdou1/patch-1
Update zh.lng
2018-07-17 07:03:07 +02:00
tangdou1
0ebb27e5da
Update zh.lng 2018-07-16 20:18:02 +08:00