Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
14,449 Commits 1 Branch 20 Tags 836 MiB
53b01dbf2e
Commit Graph

14449 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Michael Peter Christen
53b01dbf2e Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2023-11-01 18:57:04 +01:00
Michael Peter Christen
41856e9f34 added an optimized zim file entry iterator 2023-11-01 18:50:28 +01:00
Michael Peter Christen
1c0df28bfb added a zim importer that can be used for surrogate imports. 
Can not be used yet because it requires some security additions
to verify that the given urls actually work.
 2023-11-01 18:48:40 +01:00
Michael Peter Christen
b9912ff50d repaired dockerfiles for aarch64 and armv7 2023-10-29 22:09:24 +00:00
Michael Peter Christen
33b6878ded Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2023-10-29 14:58:47 +01:00
Michael Christen
68554cea07
Merge pull request #605 from okybaca/readme-docker-link 
added a link to docker build guide
 2023-10-29 14:56:26 +01:00
Michael Christen
06bfd5802f
Merge pull request #603 from okybaca/dark-green-css 
fine tuned the dark-green color scheme
 2023-10-29 14:55:58 +01:00
Michael Christen
43d5cd101e
Merge pull request #607 from okybaca/wikilinks 
replaced all the links to legacy legacy wiki to legacy wiki
 2023-10-29 14:55:26 +01:00
okybaca
4add1f6bc7 replaced all the links to legacy legacy wiki to legacy wiki 2023-10-29 13:12:24 +01:00
Michael Peter Christen
e2c86a8eba added a ZIM cluster pointer cache 2023-10-29 12:49:08 +01:00
Michael Peter Christen
4a54b24703 fix for "negative seek offset" error during extension of heap files. 
This would have always happend when a heap file exceeds 2GB.
should fix https://github.com/yacy/yacy_search_server/issues/372
 2023-10-29 09:32:21 +01:00
okybaca
69db75ce45 added a link to docker build guide 2023-10-29 02:35:57 +01:00
Michael Peter Christen
9c8fb97985 introduced url list and title list caching and enhanced input stream 
performance in ZIM reader
 2023-10-29 00:43:12 +02:00
Michael Peter Christen
b0ae660790 added Zstandard compressed data decompression for ZIM files type 5 
also: more generalization and performance enhancements
 2023-10-28 12:24:29 +02:00
Michael Peter Christen
ad8ee3a0b6 fixed typo in class name 2023-10-28 08:57:42 +02:00
Michael Peter Christen
c4082c4ff2 refactoring of ZIM reader, simplification, removed unnecessary code 2023-10-28 08:56:58 +02:00
Michael Peter Christen
c2b6b6e7b9 Fixed a large number of problems in the ZIM reader. 
This library was not prepared for large data because it was missing long
data types for pointers. I had to modify the code-base in a fundamental
way:
- Proof-Reading,
- unclustering,
- refactoring,
- naming adoption to https://wiki.openzim.org/wiki/ZIM_file_format,
- change of Exception handling,
- extension to more attributes as defined in spec (bugfix for mime type
loading)
- bugfix to long parsing (prevented reading of large files)
The code is furthermore very inefficient and requires more attention.
However the format is very useful for YaCy as there are numerous data
sources for ZIM-Files.
 2023-10-27 15:49:23 +02:00
Michael Peter Christen
5ba5fb5d23 upgraded pdfbox to 3.0.0 2023-10-27 12:05:24 +02:00
Michael Peter Christen
c10944bd4a updated bcmail-jdk15on 1.75 to bcmail-jdk18on 1.67 2023-10-27 11:08:19 +02:00
Michael Peter Christen
1fefae9baf integrated the source code of a openzim file format reader. These are 
the raw format reader files with no integration in YaCy yet, which will
maybe follow as a next step. The zim file format is documented in
https://openzim.org and the reader code was taken from the archived,
non-maintained repository at https://github.com/openzim/zimreader-java
 2023-10-27 10:59:06 +02:00
okybaca
ec2d14e973 fine tuning the dark-green color scheme 2023-10-26 12:35:22 +02:00
Michael Peter Christen
4308aa5415 removed concept of empty passwords as "no passwords used", 
because we now start YaCy with a default password (yacy).
This has impact of all function that check the current state of
password-protection that included the empty password situation,
including the warnings to set a password in case that none is set (which
cannot be the case any more).
 2023-10-25 22:56:06 +02:00
Michael Peter Christen
2c60ff14bb fixed default pw comparison 2023-10-25 13:59:02 +02:00
Michael Peter Christen
4da320bebf added a warning message in ConfigBasic in case that the default password 
was not changed.
 2023-10-24 23:36:26 +02:00
Michael Peter Christen
7830268be1 fix 756c817b5a 
must be applied to all code where a transaction token is generated.
 2023-10-21 13:00:49 +02:00
Michael Peter Christen
dc6f218520 set the default password for the admin account to "yacy" 2023-10-21 12:09:19 +02:00
Michael Peter Christen
756c817b5a fix for https://github.com/yacy/yacy_search_server/issues/544 2023-10-21 11:45:26 +02:00
Michael Christen
bab1cfc7ea
added required build tools installation 2023-10-20 16:09:47 +02:00
Michael Peter Christen
03bf259601 fix for https://github.com/yacy/yacy_search_server/issues/363 
We still need to set the load in the process because a demand for higher
crawl speed may require to increase the maximum load limit. However,
following the criticism in the bug, we do never reduce the load limit
again.
 2023-10-16 18:26:47 +02:00
Michael Christen
5bc09af426
Merge pull request #600 from okybaca/scheduler-sort 
UI: modified link to Process Scheduler in left menu
 2023-10-16 13:00:24 +02:00
okybaca
4c1eb34e85 modified link to Process Scheduler in left menu 2023-10-10 08:30:04 +02:00
Michael Peter Christen
aeb4c7a660 removed warnings during normal build 2023-10-04 22:00:30 +02:00
Michael Peter Christen
095a444aa7 removed wiki links and added more shields badges 2023-09-30 18:16:38 +02:00
Michael Peter Christen
ca2a21008a added screenshots 2023-09-30 13:07:18 +02:00
Michael Christen
961d3cc8af
Merge pull request #597 from joestr/issue/574-fix-mac-script 
Fix macOS script
 2023-09-28 21:10:49 +02:00
Michael Christen
a035b21f63
Merge pull request #598 from joestr/improvement/remove-travis-yml 
Remove .travis.yml
 2023-09-28 21:10:04 +02:00
Joel Strasser
b29c0ef133
remove .travis.yml since YaCy is not build on Travis CI anymore 2023-09-27 21:29:22 +02:00
Joel Strasser
09783ae89e
apply patches from @HenryLoenwind 2023-09-27 19:56:08 +02:00
Michael Peter Christen
94db89a757 small remaining changes in readme 2023-09-26 16:15:58 +02:00
Michael Peter Christen
0c4478cd71 migrated jetty to 9.4.52.v20230823 2023-09-26 16:15:42 +02:00
Michael Peter Christen
938724caa8 new development on-boarding process in eclipse with changes for ivy 2023-09-26 16:07:59 +02:00
mchristen
8fc51f66c6 fixed a test class which prevented compilation on latest jvm 2023-09-26 15:39:34 +02:00
Michael Christen
bda118af5d
Merge pull request #594 from joestr/master 
Match more YaCy versions
 2023-09-26 09:39:15 +02:00
Joel Strasser
53bafa1544
consistent formatting in string concatenation 2023-09-25 23:31:55 +02:00
Joel Strasser
22c4188001
additionally match release stub for YaCy version 2023-09-25 22:41:04 +02:00
Michael Peter Christen
4a5820eb03 7zip parser was removed previously. 
see also https://github.com/yacy/yacy_search_server/issues/491
 2023-09-03 20:23:23 +02:00
Michael Peter Christen
ff8fe7b6a4 fix for ',' or '.' appearing within a word or number. This will not 
tokenize the query into parts around that character to make it possible
to search for numbers or version numbers.
 2023-09-03 11:37:25 +02:00
Michael Peter Christen
0689f4f0ae Check if the character is a minus sign and is followed by a letter or a 
digit. Treat it as part of the word/number.
 2023-09-03 10:22:03 +02:00
Michael Peter Christen
5db97a8928 parser can now separate numbers from words also when they are not 
separated by space, i.e. 4.7Ohm
 2023-09-02 19:15:22 +02:00
Michael Peter Christen
079eafe7f1 removed 7zip from eclipse classpath 2023-09-02 11:44:33 +02:00