Commit Graph

14187 Commits

Author SHA1 Message Date
Michael Peter Christen
198826c362 added network scanner process to discover all YaCy peers in the intranet
this will be used to wire YaCy peers in a kubernetes cluster
2021-01-23 15:14:49 +01:00
Michael Peter Christen
d9602e8325 Implemented a new syntax in the template engine to simplify json APIs
Added also an example for one of the existing APIs. The problem is the
comma separator between objects which must not be there for the last
entry in a sequence. The new syntax adds the separator symbol
automatically.
2021-01-18 00:01:08 +01:00
Michael Peter Christen
5a7f12a9c1 allow network scans for non-standard http/https ports 2021-01-11 00:28:24 +01:00
Michael Peter Christen
022fb15670 fix for https://github.com/yacy/yacy_search_server/issues/385 2021-01-06 22:12:17 +01:00
Michael Peter Christen
17672fcbb4 adding hint how to shrink the disk size after an index deletion.
implements https://github.com/yacy/yacy_search_server/issues/360
2021-01-06 22:02:00 +01:00
sgaebel
b8d264f7ec fixes logging 2021-01-04 20:53:40 +01:00
Michael Peter Christen
13e42c2dd2 aded dockerfiles for 32 and 64 bit ARM/Raspberry Pi 2020-12-31 00:02:23 +01:00
Michael Peter Christen
062111a003 improved dockerfiles
They do not use git pull to get the latest YaCy code.
Instead they copy from local file system.
2020-12-29 21:01:35 +01:00
Michael Peter Christen
4c920d05b5 removed superfluous lines 2020-12-29 20:19:58 +01:00
Michael Peter Christen
48dd87e1e1 added a dockerignore file 2020-12-29 20:19:45 +01:00
Michael Peter Christen
ca10f0afca fixed optional default PW 2020-12-29 20:19:07 +01:00
Michael Peter Christen
907f121d0c do not overwrite PW with random PW 2020-12-29 20:18:25 +01:00
Michael Peter Christen
3e6a1e0a49 fixed surrogate process counter 2020-12-28 18:26:22 +01:00
Michael Peter Christen
88590db91e Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2020-12-28 17:05:14 +01:00
Michael Peter Christen
d3526c52af fixed a problem in warc importer: do not fail if single WARC entries are
faulty
2020-12-28 17:05:06 +01:00
Michael Peter Christen
256fa3d985 new limitation documentation
just replaced two by four
2020-12-22 16:33:12 +01:00
Michael Peter Christen
3078b74e1d Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2020-12-22 00:46:56 +01:00
Michael Peter Christen
01cc32217f fixed apicall call method parameters
and verification in transaction manager
which did not have and exception for localhost/basic authentication
2020-12-22 00:46:47 +01:00
Michael Peter Christen
7997836506 fixed lock image 2020-12-20 23:18:50 +01:00
Michael Peter Christen
63f58e4785 enhanced strategy in host browser
limit number of fresh hosts in round robin hashes
2020-12-20 23:15:55 +01:00
Michael Peter Christen
9be36800a4 increased redirect depth by one
this makes sense if one redirect replaces http with https and another
replaces www subdomain by without (and vice versa)
2020-12-20 19:44:16 +01:00
Michael Peter Christen
d0abb0cedb enabling all crawl profiles in all network modes
also: increased default internet crawl speed to
4 urls/s/host
2020-12-19 01:00:51 +01:00
Michael Peter Christen
32ca669bfb panic release for #googledown 2020-12-14 13:20:28 +01:00
Michael Peter Christen
baad56d83d beautified default peer names 2020-12-14 02:08:49 +01:00
Michael Peter Christen
a9befbba5f Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2020-12-14 01:26:34 +01:00
Michael Peter Christen
fed8bd6325 automatically refresh css cache when switching skin
and setting of default skin to current skin in selector
2020-12-14 01:26:26 +01:00
Michael Peter Christen
9a5694261a design update
more space
2020-12-12 14:17:45 +01:00
Michael Peter Christen
4ec55289a8 using a lock symbol which looks also good in dark designs 2020-12-12 03:02:40 +01:00
Michael Peter Christen
43a9f4f574 updated solr 6.6.6 -> 7.7.3
dropped GSA support (GSA API is still in YaCy Grid)
The 6.6.6 solr index works without migration also with 7.7.3
2020-12-12 02:06:43 +01:00
Michael Peter Christen
c0d9a3e9a7 turned HostBrowser into a admin-only page, now called IndexBrowser
This was required because spiders and bots crawled through this page and
created load on the peer without use for the user or the YaCy network.
2020-12-11 00:50:52 +01:00
Michael Peter Christen
d359d521a1 fixed warc importer
The importer tried to import a gziped files as plain warc.
It will now check the file extension and use a unzip automatically
on-the-fly.
2020-12-10 11:19:25 +01:00
Michael Peter Christen
39f87f7f28 added a hint to the default settings how to set a default password 2020-12-09 02:42:05 +01:00
Michael Peter Christen
e54ab39958 Going back to basic authentication for console/shell commands
This does not affect security because:
- it is going to localhost only
- only users who have already access to the pw hash can do this
- no clear text pw is transmitted because that is not stored anywhere
The switch to basic is required because these commands are required
in the context of hosting on root servers and docker containers
where a password change must be done. But the password shell command
was not working without password which made the concept unusable.
This deficit made it virtually impossible for root server operators
to use YaCy because they had been unable to set up a proper password.
2020-12-09 02:36:55 +01:00
Michael Peter Christen
6271e9122c javadoc fix 2020-12-09 02:22:47 +01:00
Michael Peter Christen
e0f4e3fd9a enhanced ability to debug the code 2020-12-09 02:22:30 +01:00
Michael Peter Christen
eea2d71851 prevent creation of auth schema factories every time a servlet is called 2020-12-06 01:49:34 +01:00
Michael Peter Christen
fcc9386ed3 enhanced the (already fast!) png exporter 2020-12-03 12:18:07 +01:00
Michael Peter Christen
4e9b425f98 missing fix for latest commit 2020-12-03 00:40:51 +01:00
Michael Peter Christen
3213d9db37 updated jetty from 9.4.17 to 9.4.35
and fixed a bug in ServerSideIncludes that appeared only in that recent
version of jetty
2020-12-03 00:21:15 +01:00
Michael Peter Christen
787fec0658 reduced complexity - removed concurrency in sort 2020-12-02 18:39:45 +01:00
Michael Peter Christen
cef5fde343 adding message to UI to make port change transparent 2020-12-02 18:05:38 +01:00
Michael Peter Christen
52228cb6be added a gc to cleanup process (once every 10 minutes) 2020-12-02 00:13:00 +01:00
Michael Peter Christen
22841ffbf1 creating a threaddump during every cleanup process
to be able to find out what a peer did (not) last time before a crash
2020-12-01 03:00:24 +01:00
Michael Peter Christen
36e616271b do better documentation on how to set a default password 2020-12-01 02:18:08 +01:00
Michael Peter Christen
df2bf9ef28 try to fix maven build error 2020-11-29 14:24:33 +01:00
Michael Peter Christen
264bab6700 trying to fight the UI unavaiability
this path addresses a possible issue with too many open connections to
remote peers
2020-11-29 14:15:34 +01:00
Michael Christen
4921771951
Merge pull request #390 from rpodgorny/patch-1
typo fix
2020-11-26 23:28:33 +01:00
Radek Podgorny
836953bd5b
typo fix 2020-11-26 20:52:46 +01:00
Michael Peter Christen
7947baeb49 removed all remaining deprecation warnings 2020-11-23 00:03:18 +01:00
Michael Peter Christen
c0f6d6e11d removed one deprecation warning for jetty library initializing ssl
server port
2020-11-22 23:27:58 +01:00