Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
14,522 Commits 1 Branch 20 Tags 836 MiB
master
Commit Graph

14522 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Michael Peter Christen
6db374fdcf upgraded metadata-extractor to 2.19.0
Some checks failed
CI Script to build on self-hosted server / build (push) Has been cancelled
Details
2024-08-26 23:49:27 +02:00
Michael Peter Christen
3944984840 added snippet extraction with synonym matching 2024-08-26 23:44:42 +02:00
Michael Peter Christen
d181b9e89b added deleted files from commit 254f12d60b which are still needed and had been linked outside of yacy/ui
Some checks failed
CI Script to build on self-hosted server / build (push) Has been cancelled
Details
2024-07-24 15:57:51 +02:00
Michael Peter Christen
910a496c9f replaced http links with https
Some checks failed
CI Script to build on self-hosted server / build (push) Has been cancelled
Details
2024-07-21 18:02:58 +02:00
Michael Peter Christen
fd45ccf76e added sponsoring images 2024-07-21 17:25:22 +02:00
Michael Peter Christen
833d720989 upgraded ppt parser by migration of org.apache,poi from 3.17 to 5.3.0 
This also fixes the security waning
https://github.com/yacy/yacy_search_server/security/dependabot/37
 2024-07-21 15:28:13 +02:00
Michael Peter Christen
687820788d this assert does not work because of the 9_0_0 solr version format. 
An 9_0 is expected but it does not work this way with this version.
 2024-07-21 13:33:47 +02:00
Michael Christen
accf4e424b
Merge pull request #649 from virginOne/master
Some checks failed
CI Script to build on self-hosted server / build (push) Has been cancelled
Details 
Fix the issue of not being able to import the JSON format
 2024-07-10 16:36:54 +02:00
Michael Christen
2f5f3f8853
Merge pull request #650 from zutto/master 
Fix autocrawler crashing
 2024-07-10 16:35:39 +02:00
Michael Christen
326b5f6e6e
Merge pull request #651 from okybaca/removeui 
removed yacy/ui as obsolete
 2024-07-10 16:34:07 +02:00
okybaca
254f12d60b removed yacy/ui as obsolete 2024-07-09 16:26:50 +02:00
zutto
5268ae2ce9 check the document protocol & host values before proceeding to form final url. 2024-06-29 10:11:58 +03:00
zutto
962aaec0c0 Improve the clarity of deep crawl feature UI text on AutoCrawler 2024-06-29 09:37:05 +03:00
zutto
d958d1c0c4 ensure that returned SolrDocument is not null 2024-06-29 09:33:06 +03:00
virginOne
f3cc818305
Merge branch 'yacy:master' into master 2024-06-23 19:52:54 +08:00
sgaebel
66cf7d4ca5 disables autowarm of filtercache, corrects luceneMatchVersion 2024-06-21 19:10:12 +02:00
Virgo
89c07f0900 Fix the issue of not being able to import the JSON format export of Solr index due to the inconsistency in time format between the exported JSON format and the Solr time format. 2024-06-21 10:03:08 +08:00
Michael Peter Christen
70454654f3 by default open the https url for a given host, not the http url 
(http does almost not exist any more)
 2024-05-27 00:53:18 +02:00
Michael Peter Christen
71a6074cc5 added setting of cache configuration for solr 
according to recommendation from
https://community.searchlab.eu/t/yacy-support-gpt-chatgpt-assistant/1622
However it is not clear if this configuration actually works (has an
effect at all) or is the solution for performance issues.
 2024-05-26 12:59:59 +02:00
Michael Peter Christen
b8479430b6 400 is too small 2024-05-25 01:21:06 +02:00
Michael Peter Christen
5f4ea9ac5d reduced memory amount for network image 
reduced also the number of memory allocation for image storage
 2024-05-25 01:10:23 +02:00
Michael Peter Christen
fe4c0aa890 refactoring of RAG reverse proxy: extracted code for ollama code to 
their own classes
 2024-05-21 00:06:19 +02:00
Michael Peter Christen
8b65a4d14e fixed build clean 2024-05-19 18:02:49 +02:00
Michael Peter Christen
f1c70dce33 Merge branch 'master' of github.com:yacy/yacy_search_server 2024-05-19 17:35:24 +02:00
Michael Peter Christen
8eb0d490aa migrated solr to 9.0 
This is a major step because solr removed support for embedded solr
instances in 9.0 and we want to keep it because we want to ship
YaCy with an embedded solr. It was necessary to add parts of solr
code into YaCy to make this migration possible. Further on with
Solr 9.1 they removed even more parts which are required for embedded
operation, therefore we cannot migrate yet further without big
changes.
If you are running a YaCy instance with Solr 8.x, the migration should
be done automatically. If not you require to first migrate to a YaCy
version 1.93 with Solr 8.x to migrate to Solr 8 data.
 2024-05-19 17:34:57 +02:00
Michael Peter Christen
b8417e5619 removed Mac specific code which is not working any more on recent Macs 2024-05-19 17:29:16 +02:00
Michael Peter Christen
13fbff0bff Added a RAG Proxy for AI Chat with YaCy 
RAG (Retrieval Augmented Generation) is a method to combine a search
engine with a LLM (Large Language Model). When a new prompt is
submitted, a search engine injects knowledge from a search into the
content. This is done using a reverse proxy between the Chat Client and
the LLM. In this case, we used the following software:

LLM Backend - Ollama:
https://github.com/ollama/ollama
Install ollama and then load two required LLM models
with the following commands:
ollama pull phi3:3.8b
ollama pull llama3:8b

Chat Client - susi_chat:
https://github.com/susiai/susi_chat
just clone the repository and the open the file
susi_chat/chat_terminal/index.html
in your browser. This displays a chat terminal.
In this terminal, run the following command:
host http://localhost:8090
This sets the LLM backend to your YaCy peer.

Then start YaCy. It will provide the LLM endpoint to the client
while using ollama in the backend. It then injects search results
only from the local Solr index, not from the p2p network (so far).
 2024-05-19 17:19:09 +02:00
Michael Peter Christen
59c0cb0f30 fixed aarch64 dockerfile 2024-05-13 02:10:24 +02:00
Michael Christen
0405ec8ad2
Merge pull request #642 from HeliosLHC/reduce_image_size 
Reduce Docker Image Size
 2024-05-12 23:50:24 +02:00
Michael Peter Christen
c2ad1950e8 updated jetty to 9.4.54.v20240208 2024-05-10 15:41:20 +02:00
Michael Peter Christen
b295e38969 fine-tuned the import process of jsonl files which had been missing 
to actually be able to make searches and browse the index with the host
browser
 2024-05-10 12:13:44 +02:00
HeliosLHC
262b23532d reduce image size 2024-05-05 23:23:34 +02:00
Michael Christen
de941c6fee
Merge pull request #633 from LillySchramm/fix/632/remove-sayat-link 
fix: Remove SayAt.Me Link
 2024-04-05 17:43:55 +08:00
EPS-DEV
160e346d4c fix: Remove SayAt.Me Link 2024-04-04 15:05:41 +00:00
Michael Christen
656d47c1ac
Merge pull request #628 from frankenstein91/vagrant 
Vagrant demo
 2024-02-27 14:18:24 +01:00
Frank Tornack
9a406d310c
switch user 2024-02-04 19:36:48 +01:00
Frank Tornack
6864486196
add Yacy vagrant 
untested
 2024-02-04 19:29:16 +01:00
Michael Christen
331e0a24fc
Merge pull request #621 from OFA54/patch-1 
turkish translation tr.lng
 2023-12-20 23:34:35 +01:00
Michael Christen
d825a85a01
Merge pull request #619 from pr0vieh/initrecrawl 
bring defaults for recrawlindex to init config
 2023-12-09 14:47:13 +01:00
pr0vieh
35620762ac bring defaults for recrawlindex to init config 2023-12-09 01:32:31 +01:00
Michael Christen
d097a642c2
Merge pull request #615 from okybaca/logging2 
Logging unclutter
 2023-12-03 16:40:21 +01:00
Michael Christen
6d5e9ff53f
Merge pull request #616 from okybaca/logging3 
changed the log entry REJECTED to CRAWLER * REJECTED, loglevel fine
 2023-12-03 16:39:29 +01:00
Michael Christen
d5d4e8fe3a
Merge pull request #617 from pr0vieh/master 
Add setting for DHT receive loadprereq insted of hardcoded load < 2.0
 2023-12-03 16:38:46 +01:00
pr0vieh
dfb2b79609 Add setting for DHT receive loadprereq insted of hardcoded load < 2.0 2023-12-03 01:27:36 +01:00
okybaca
5dee8dbcbd changed the log entry REJECTED to CRAWLER * REJECTED, loglevel fine 2023-12-02 12:24:36 +01:00
Michael Christen
4c603e23f0
Merge pull request #610 from okybaca/cr-text 
UI: added a more descriptive message, CitationRank instead of cr
 2023-11-27 12:17:05 +01:00
Michael Christen
040cd8be6d
Merge pull request #612 from okybaca/sitemap-fix 
updated apache libs
 2023-11-27 12:16:43 +01:00
Michael Christen
0233ecd481
Merge pull request #614 from okybaca/logging 
added some logging prefixes to yacy.logging
 2023-11-27 12:15:34 +01:00
okybaca
7831f294a9 changed regular peerping messages to level fine 2023-11-27 08:12:03 +01:00
okybaca
553c859703 logging: moved some log-cluttering DHT messages to level 'fine' 2023-11-27 07:51:42 +01:00