Commit Graph

20 Commits

Author SHA1 Message Date
Michael Christen
040cd8be6d
Merge pull request #612 from okybaca/sitemap-fix
updated apache libs
2023-11-27 12:16:43 +01:00
okybaca
9c59c6814b updated apache libs 2023-11-15 10:22:00 +01:00
Michael Peter Christen
656b3e3e77 updated guava to latest and added missing library for failureaccess 2023-11-13 10:59:49 +01:00
Michael Peter Christen
7db0534d8a Added a zim parser to the surrogate import option.
You can now import zim files into YaCy by simply moving them
to the DATA/SURROGATE/IN folder. They will be fetched and after
parsing moved to DATA/SURROGATE/OUT.
There are exceptions where the parser is not able to identify the
original URL of the documents in the zim file. In that case the file
is simply ignored.
This commit also carries an important fix to the pdf parser and an
increase of the maximum parsing speed to 60000 PPM which should make it
possible to index up to 1000 files in one second.
2023-11-05 02:16:40 +01:00
Michael Peter Christen
b0ae660790 added Zstandard compressed data decompression for ZIM files type 5
also: more generalization and performance enhancements
2023-10-28 12:24:29 +02:00
Michael Peter Christen
5ba5fb5d23 upgraded pdfbox to 3.0.0 2023-10-27 12:05:24 +02:00
Michael Peter Christen
c10944bd4a updated bcmail-jdk15on 1.75 to bcmail-jdk18on 1.67 2023-10-27 11:08:19 +02:00
Michael Peter Christen
0c4478cd71 migrated jetty to 9.4.52.v20230823 2023-09-26 16:15:42 +02:00
Michael Peter Christen
88cd17ea57 migrated solr from 8.9.0 to 8.11.2; activated also migration script. A YaCy index with solr 8.9.0 will automatically be migrated to 8.11.2. This is a preparation step to migrate to 9.0.0 soon. 2023-09-01 18:24:52 +02:00
Michael Peter Christen
c3824854c7 upgraded several libraries 2023-07-27 23:26:59 +02:00
Michael Peter Christen
5afcba162b updated libraries 2023-07-27 22:55:46 +02:00
Michael Christen
1b825df086 possible fix for
https://github.com/yacy/yacy_search_server/issues/496#issuecomment-1268710276
2022-10-05 21:56:12 +02:00
Michael Peter Christen
a0ddc168e2 upgraded a large number of libraries to latest 2022-10-05 17:54:47 +02:00
Michael Peter Christen
f475ecbd0b upgraded jetty to 9.4.41.v20210516 2022-10-05 17:39:53 +02:00
Michael Peter Christen
482f507e65 upgraded solr from 8.8.1 to 8.9.0
should hopefully fix
https://github.com/yacy/yacy_search_server/issues/496
because it includes https://issues.apache.org/jira/browse/SOLR-13034
2022-10-05 17:24:07 +02:00
Michael Christen
7bf5f6c7ad upgraded jsoup after security warning 2022-10-04 20:13:16 +02:00
Michael Peter Christen
9c1bc533fa removed hazelcast because it is phoning home, see also:
https://github.com/yacy/yacy_search_server/issues/504
2022-09-28 17:30:37 +02:00
Michael Peter Christen
fc98ca7a9c removed ContentControl servlet and functinality
This was not used at all (as I know) and was blocking a smooth
integration of ivy in the context of an existing JSON parser.
2022-09-28 17:25:04 +02:00
Thomas Koch
c98d09b664 rm GitRevTask
The releaseNr is now set to a static value in build.properties. We
can increment it there manually and eventually switch to another
version number scheme if we like.
2022-07-10 12:33:28 +00:00
Thomas Koch
8fbd6386fd use ivy to manage jars 2022-04-08 18:33:20 +00:00