Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
11,804 Commits 1 Branch 20 Tags 836 MiB
72f6a0b0b2
Commit Graph

3 Commits

Author SHA1 Message Date
reger
72f6a0b0b2 enhance recrawl job 
- allow to modify the query to select documents to  process (after job has started)
- allow to include failed urls (httpstatus <> 200)
 2015-06-06 18:45:39 +02:00
reger
cd7c0e0aae detail optimization of RecrawlThread 2015-05-17 00:13:00 +02:00
reger
ace71a8877 Initial (experimental) implementation of index update/re-crawl job 
added to IndexReIndexMonitor_p.html
Selects existing documents from index and feeds it to the crawler.
currently only the field fresh_date_dt is used determine documents for recrawl (fresh_date_dt:[* TO NOW-1DAY]
Documents are  added in small chunks (200) to the crawler, only if no other crawl is running.
 2015-05-16 01:23:08 +02:00