Commit Graph

14345 Commits

Author SHA1 Message Date
Michael Peter Christen
9fcd8f1bda added canonical filter
attention: this is on by default!
(it should do the right thing)
2023-01-16 14:50:30 +01:00
Michael Peter Christen
5a52b01c09 front-end integration of tag valency 2023-01-15 20:13:45 +01:00
Michael Peter Christen
7f728bb4b4 crawl profile storage extension for tag valency 2023-01-15 14:11:32 +01:00
Michael Christen
4304e07e6f crawl profile adoption to new tag valency attribute 2023-01-15 01:20:12 +01:00
Michael Peter Christen
5acd98f4da introduction of tag-to-indexing relation TagValency 2023-01-13 17:20:18 +01:00
Michael Christen
95e02e5291
Merge pull request #535 from hezhizhen/typo
fix typo
2022-12-06 21:33:18 +01:00
Michael Peter Christen
ab3ef87abf fixed exec start command where a path contains spaces 2022-12-05 17:30:11 +01:00
Michael Peter Christen
17eec667fb better release number representation 2022-12-05 14:46:58 +01:00
Michael Peter Christen
b1199e97f8 enabling new update location release.yacy.net
with new version numbers
2022-12-05 14:26:17 +01:00
Michael Peter Christen
5d9587fc1d removed deprecated networks 2022-12-05 12:43:47 +01:00
Michael Peter Christen
66169d1aad default build properties to remove barrier developing in IDE
environments
2022-12-05 12:28:36 +01:00
reger24
d6731e3e3a Merge branch 'master' of https://github.com/yacy/yacy_search_server 2022-12-01 01:28:30 +01:00
reger24
bc5d91469e delete gradle wrapper props 2022-12-01 01:28:23 +01:00
Burkhard
1d7ef94641
Delete settings.gradle 2022-12-01 01:26:21 +01:00
Burkhard
57a6b18b94
Delete pom.xml 2022-12-01 01:26:15 +01:00
Burkhard
50a1999a87
Delete gradlew.bat 2022-12-01 01:26:08 +01:00
Burkhard
63fbb154b5
Delete gradlew 2022-12-01 01:25:55 +01:00
Burkhard
bb9ae8207f
Delete build.gradle 2022-12-01 01:25:44 +01:00
reger24
9766f93fe6 revert the gradle build back to ANT (to be able to build J7Zip manually using preferred build tool. 2022-12-01 01:20:43 +01:00
Michael Christen
b0623396cb
Update FUNDING.yml 2022-11-28 15:18:30 +01:00
Zhizhen He
ba087c8c12
fix typo 2022-11-06 00:14:13 +08:00
Michael Peter Christen
309adb814e fixed import of jsonlist imort from searchlab.eu using a direct URL 2022-10-25 00:51:53 +02:00
Michael Peter Christen
5ddc794bb9 code cleanup in http clieant 2022-10-24 23:34:39 +02:00
Michael Peter Christen
62d177bf59 stub for jsonlist index importer web page 2022-10-23 12:22:31 +02:00
Michael Peter Christen
efa0425f00 refactoring: moved jsonlist importer to importer class 2022-10-23 11:35:32 +02:00
Michael Peter Christen
49daa32a88 yacy can now read searchlab export dump files
using the surrogate input process:
- copy the searchlab export file to DATA/SURROGATE/in
- the file is processed automatically and then moved to
DATA/SURROGATE/OUT
2022-10-23 11:01:58 +02:00
Michael Peter Christen
32e6a5f903 for some strange reason there is no javaw in temurin, only java 2022-10-06 00:11:04 +02:00
Michael Peter Christen
6042dd99c6 reduced danger that Tray does not initialize 2022-10-06 00:01:42 +02:00
Michael Christen
61b27217b9 throttle number of DNS requests:
as soon as the number of requests is > 50, there is a forced delay
of (10 * (requests - 50)) milliseconds. That means that once the number
of DNS requests reach 150, there is a one second delay to each request.

This shall prevent that a remote DNS is flooded with request and
possibly gets damaged.
This is also a fix/enhancement for
https://github.com/yacy/yacy_search_server/issues/513
2022-10-05 22:59:09 +02:00
Michael Christen
99174282d8 try to shut down in a bit more ordered way
inspired by https://github.com/yacy/yacy_search_server/issues/518
2022-10-05 22:13:06 +02:00
Michael Christen
1b825df086 possible fix for
https://github.com/yacy/yacy_search_server/issues/496#issuecomment-1268710276
2022-10-05 21:56:12 +02:00
Michael Peter Christen
a0ddc168e2 upgraded a large number of libraries to latest 2022-10-05 17:54:47 +02:00
Michael Peter Christen
f475ecbd0b upgraded jetty to 9.4.41.v20210516 2022-10-05 17:39:53 +02:00
Michael Peter Christen
482f507e65 upgraded solr from 8.8.1 to 8.9.0
should hopefully fix
https://github.com/yacy/yacy_search_server/issues/496
because it includes https://issues.apache.org/jira/browse/SOLR-13034
2022-10-05 17:24:07 +02:00
Michael Peter Christen
d49f937b98 added iso,apk,dmg to extension-deny list
see also https://github.com/yacy/yacy_search_server/issues/510
zip is not on the list because it can be parsed
2022-10-05 16:28:50 +02:00
Michael Peter Christen
761dbdf06d increases log history length to 10000
implements https://github.com/yacy/yacy_search_server/issues/512
2022-10-05 16:09:28 +02:00
Michael Peter Christen
0970a79bbf attempt to fix https://github.com/yacy/yacy_search_server/issues/517 2022-10-05 15:29:59 +02:00
Michael Peter Christen
1893661ee4 removed/suppressed more warnings 2022-10-05 14:38:59 +02:00
Michael Christen
51cf17d252 removed warnings 2022-10-04 22:28:15 +02:00
Michael Christen
867f96a32b removed warnings 2022-10-04 22:05:32 +02:00
Michael Christen
7bf5f6c7ad upgraded jsoup after security warning 2022-10-04 20:13:16 +02:00
Michael Christen
8a06beaf24 removed finalize() methods, deprecated 2022-10-04 20:12:47 +02:00
Michael Peter Christen
3dfd7ba016 fixed dockerfile for latest release changes 2022-10-04 17:57:45 +02:00
Michael Peter Christen
e931b80cf1 new release number schema and CI processes:
all commits will now be automatically published at
https://release.yacy.net/
2022-10-04 16:14:40 +02:00
Michael Peter Christen
0f66c8bc35 fixed windows installer nsi file for latest release file names 2022-10-04 16:05:35 +02:00
Michael Peter Christen
60c9986a0e new release file names with date and git hash
...without reference to 9000ish SVN
2022-10-04 15:31:47 +02:00
Michael Peter Christen
ede9efe50c write git revision number to yacyBuild.properties 2022-10-04 01:50:56 +02:00
Michael Peter Christen
90db21b909 for some reason the compilation fails on linux with "Unicode true" 2022-10-04 00:43:07 +02:00
Michael Peter Christen
79fc19e67e removed ci script for nsis build 2022-10-04 00:01:53 +02:00
Michael Christen
55c181e5a0 add windows build to ci 2022-10-03 18:23:03 +02:00