Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
12,632 Commits 1 Branch 20 Tags 836 MiB
f34b493ab6
Commit Graph

10 Commits

Author SHA1 Message Date
reger
72f6a0b0b2 enhance recrawl job 
- allow to modify the query to select documents to  process (after job has started)
- allow to include failed urls (httpstatus <> 200)
 2015-06-06 18:45:39 +02:00
reger
ace71a8877 Initial (experimental) implementation of index update/re-crawl job 
added to IndexReIndexMonitor_p.html
Selects existing documents from index and feeds it to the crawler.
currently only the field fresh_date_dt is used determine documents for recrawl (fresh_date_dt:[* TO NOW-1DAY]
Documents are  added in small chunks (200) to the crawler, only if no other crawl is running.
 2015-05-16 01:23:08 +02:00
Michael Peter Christen
5a060c9f26 refactoring of reindexSolr (just replaced constant string) 2015-01-29 00:33:07 +01:00
reger
5f0bb1214f modified FieldReIndex to reindex queries with low number of documents first 
by using a internally a score map with number of documents as score
and working through the list from low to high.
 2014-12-07 04:31:09 +01:00
Michael Peter Christen
15b2fad6a2 reverted latest change for reindexing because that works actually only 
for internal Solr indexes. This is mainly caused by the fact that an
external Solr may be also a SolrCloud which do not support LukeRequests,
which are needed to request the old Schema.
 2014-07-02 14:56:34 +02:00
Michael Peter Christen
e09218129c remove check for local solr. This check was made during a time when Solr 
was optional and another alternative metadata store was available. Since
that store is now removed, Solr is always available (internally or
externally)
 2014-07-02 14:34:48 +02:00
reger
82d81a57bd info msg if no embedded Solr http://bugs.yacy.net/view.php?id=279 2013-08-14 20:59:46 +02:00
reger
02fe8b43ba Field Re-Indexing: display list of fields in reindex queue 
change servlet to display statistic on 1st click (instead after refresh)
 2013-08-11 04:51:29 +02:00
Michael Peter Christen
1fd006cc56 fixes using the embedded connector 2013-07-17 12:41:54 +02:00
reger
79401cb938 added reindex option for documents with disabled or obsolete fields to Solr Schema Editor page (IndexSchema_p.html) 
this allows to remove obsolete fields from the index (according to current schema config)
by selecting all documents containig disabled fields.
 2013-05-13 04:06:57 +02:00