Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
14,156 Commits 1 Branch 20 Tags 836 MiB
2e177661c9
Commit Graph

14156 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Michael Peter Christen
3befaaf4f1 reformatting pom.xml to make it easier to update it with recent library versions 2021-03-08 00:41:41 +01:00
Michael Christen
dffe9e1c23
Merge pull request #402 from SebastianoPistore/junitUpdate 
Workaround for CVE-2020-15250
 2021-03-06 13:45:11 +01:00
Michael Peter Christen
7c86826db3 new version for solr 8 
ATTENTION: old indexes from solr 6 CANNOT be migrated to solr 8
DO NOT use this version if you still have a solr 6 index.
 2021-03-06 13:37:06 +01:00
Michael Peter Christen
ed9789214e fixed seed initialization problem 2021-03-06 13:35:46 +01:00
Michael Peter Christen
f4f3808d43 added missing new dependencies for migration to Solr 8 
after pulling https://github.com/yacy/yacy_search_server/pull/403
 2021-03-06 13:35:32 +01:00
Michael Christen
ffe8786d69
Merge pull request #403 from alsutton/address_security_issues 
Update dependencies to address vulnerabilities.
 2021-03-06 12:58:56 +01:00
Al Sutton
f4dd6e6d41 Update Lucene to 8.8.1 2021-03-04 17:44:01 +00:00
Al Sutton
721dd3e1ba Update Guava to match version pulled through from solr dependencies 2021-03-04 17:32:07 +00:00
Al Sutton
b5203de923 Update ant build solr dependency to 8.8.1 2021-03-04 16:48:10 +00:00
Al Sutton
8ade8b8775 Remove forced clear to match new behaviour in 2da71c2a40 2021-03-04 16:37:56 +00:00
Al Sutton
09695fc6d3 Update exceptions to match updated API 2021-03-04 16:34:02 +00:00
Al Sutton
69014a701e Update API Usage 2021-03-04 16:14:56 +00:00
Al Sutton
9ba0fa1beb Update dependencies to address vulnerabilities. 
JUnit 4.13.1 addresses a vulnerability in 4.13 -
https://github.com/junit-team/junit4/blob/HEAD/doc/ReleaseNotes4.13.1.md

Solr has a number of vulnerabilities which should be patched, the
main one being something that affects all versions under 8.4.0;

CVE-2019-17558 - Remote code execution in Solr 5.0.0 - 8.3.1
https://nvd.nist.gov/vuln/detail/CVE-2019-17558

To address this I've updated the dependency to be the latest version
(8.8.1).
 2021-03-04 13:41:43 +00:00
Sebastiano Pistore
78bd82f8ef Workaround for CVE-2020-15250 2021-02-22 20:53:24 +01:00
Michael Peter Christen
b46513f4a1 added stub of rc3assembly style 
a little bit late but whatever
 2021-02-09 20:30:10 +01:00
Michael Peter Christen
3da7628117 use environment variables to overwrite configuration variables 
you can i.e. do:
export YACY_PORT=8092 && ./startYACY.sh
Just append "YACY_" to uppercase version of environment variables and
replace all "." with "_".
 2021-02-09 20:26:49 +01:00
Michael Peter Christen
13a2e6dc6e Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2021-01-25 11:49:32 +01:00
Michael Peter Christen
0ae8ccf657 Make it possible to set an empty password disabling the authentication 
protocol completely
If you set now an empty password, then the http server will not ask to
authentify. This is required for environment where we attach an outside
authentification service like keycloak or similar using authentication
in an ingress proxy.
This change is part of the approach to run YaCy inside of a kubernetes
cluster where we do not want individual authentication of peers and want
to apply a ingress authentication.
 2021-01-25 11:49:21 +01:00
Michael Peter Christen
96592a10cf added option to set yacy configuration values using environment 
variables
To use that feature, set an environment variable with prefix "yacy." and
suffix identical to the yacy configuration attribute name.
Additionaly we implemented a way to set a peer name using the setting
"network.unit.agent". This can therefore now be used to set a peer name
with the java call parameter
-Dyacy.network.unit.agent=anonymous
The purpose for this feature is the ability to set peer names in
mass-deployed kubernetes clusters to the same name to prevent that we
are flooding peer name statistics with auto-deployment-generated names.
 2021-01-24 22:50:37 +01:00
Michael Peter Christen
198826c362 added network scanner process to discover all YaCy peers in the intranet 
this will be used to wire YaCy peers in a kubernetes cluster
 2021-01-23 15:14:49 +01:00
Michael Peter Christen
d9602e8325 Implemented a new syntax in the template engine to simplify json APIs 
Added also an example for one of the existing APIs. The problem is the
comma separator between objects which must not be there for the last
entry in a sequence. The new syntax adds the separator symbol
automatically.
 2021-01-18 00:01:08 +01:00
Michael Peter Christen
5a7f12a9c1 allow network scans for non-standard http/https ports 2021-01-11 00:28:24 +01:00
Michael Peter Christen
022fb15670 fix for https://github.com/yacy/yacy_search_server/issues/385 2021-01-06 22:12:17 +01:00
Michael Peter Christen
17672fcbb4 adding hint how to shrink the disk size after an index deletion. 
implements https://github.com/yacy/yacy_search_server/issues/360
 2021-01-06 22:02:00 +01:00
sgaebel
b8d264f7ec fixes logging 2021-01-04 20:53:40 +01:00
Michael Peter Christen
13e42c2dd2 aded dockerfiles for 32 and 64 bit ARM/Raspberry Pi 2020-12-31 00:02:23 +01:00
Michael Peter Christen
062111a003 improved dockerfiles 
They do not use git pull to get the latest YaCy code.
Instead they copy from local file system.
 2020-12-29 21:01:35 +01:00
Michael Peter Christen
4c920d05b5 removed superfluous lines 2020-12-29 20:19:58 +01:00
Michael Peter Christen
48dd87e1e1 added a dockerignore file 2020-12-29 20:19:45 +01:00
Michael Peter Christen
ca10f0afca fixed optional default PW 2020-12-29 20:19:07 +01:00
Michael Peter Christen
907f121d0c do not overwrite PW with random PW 2020-12-29 20:18:25 +01:00
Michael Peter Christen
3e6a1e0a49 fixed surrogate process counter 2020-12-28 18:26:22 +01:00
Michael Peter Christen
88590db91e Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2020-12-28 17:05:14 +01:00
Michael Peter Christen
d3526c52af fixed a problem in warc importer: do not fail if single WARC entries are 
faulty
 2020-12-28 17:05:06 +01:00
Michael Peter Christen
256fa3d985 new limitation documentation 
just replaced two by four
 2020-12-22 16:33:12 +01:00
Michael Peter Christen
3078b74e1d Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2020-12-22 00:46:56 +01:00
Michael Peter Christen
01cc32217f fixed apicall call method parameters 
and verification in transaction manager
which did not have and exception for localhost/basic authentication
 2020-12-22 00:46:47 +01:00
Michael Peter Christen
7997836506 fixed lock image 2020-12-20 23:18:50 +01:00
Michael Peter Christen
63f58e4785 enhanced strategy in host browser 
limit number of fresh hosts in round robin hashes
 2020-12-20 23:15:55 +01:00
Michael Peter Christen
9be36800a4 increased redirect depth by one 
this makes sense if one redirect replaces http with https and another
replaces www subdomain by without (and vice versa)
 2020-12-20 19:44:16 +01:00
Michael Peter Christen
d0abb0cedb enabling all crawl profiles in all network modes 
also: increased default internet crawl speed to
4 urls/s/host
 2020-12-19 01:00:51 +01:00
Michael Peter Christen
32ca669bfb panic release for #googledown 2020-12-14 13:20:28 +01:00
Michael Peter Christen
baad56d83d beautified default peer names 2020-12-14 02:08:49 +01:00
Michael Peter Christen
a9befbba5f Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2020-12-14 01:26:34 +01:00
Michael Peter Christen
fed8bd6325 automatically refresh css cache when switching skin 
and setting of default skin to current skin in selector
 2020-12-14 01:26:26 +01:00
Michael Peter Christen
9a5694261a design update 
more space
 2020-12-12 14:17:45 +01:00
Michael Peter Christen
4ec55289a8 using a lock symbol which looks also good in dark designs 2020-12-12 03:02:40 +01:00
Michael Peter Christen
43a9f4f574 updated solr 6.6.6 -> 7.7.3 
dropped GSA support (GSA API is still in YaCy Grid)
The 6.6.6 solr index works without migration also with 7.7.3
 2020-12-12 02:06:43 +01:00
Michael Peter Christen
c0d9a3e9a7 turned HostBrowser into a admin-only page, now called IndexBrowser 
This was required because spiders and bots crawled through this page and
created load on the peer without use for the user or the YaCy network.
 2020-12-11 00:50:52 +01:00
Michael Peter Christen
d359d521a1 fixed warc importer 
The importer tried to import a gziped files as plain warc.
It will now check the file extension and use a unzip automatically
on-the-fly.
 2020-12-10 11:19:25 +01:00