Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
12,354 Commits 1 Branch 20 Tags 836 MiB
6bf9c55584
Commit Graph

3569 Commits

Author SHA1 Message Date
reger
6bf9c55584 adjust Solr select servlet to lates bugfix for boostquery (bq param) 
to split query into multiple parameter on line separator in input query.
e.g. split "crawldepth_i_0^10.0 \n crawldepth_i:1^5.0"
but allow   "url_file_ext_s:jpg OR url_file_ext_s:png"  to be unsplitted
 2016-05-22 22:43:56 +02:00
Burkhard
9a18e2297b Merge pull request #51 from JeremyRand/multiple-boost-query 
Fix multiple boost queries
 2016-05-22 22:24:04 +02:00
reger
f0d7b93372 make use and activate autodetect charset in Vocabulary input from file 
+ revert mistake of empty cn.lng
 2016-05-22 05:38:26 +02:00
JeremyRand
433217b33e Properly support multiple Boost Queries. (Previous code was broken because it concatenated multiple Boost Queries together rather than passing Solr an array.) 2016-05-20 20:17:51 -05:00
JeremyRand
58824dfa6c Refactor escaping in config file read/write code. Now it uses Apache Commons StringUtils instead of RegEx. 2016-05-20 20:17:51 -05:00
reger
9e94989237 upd to PDFBox 2.0.1 2016-05-20 23:12:16 +02:00
reger
d0a571bed2 del cytag trail for own index.html (save resource not used by default) 2016-05-19 01:59:00 +02:00
reger
de46879637 fix SeedDB.get(byte[]) hash string compare (for returning own seed shortcut) 2016-05-17 02:07:49 +02:00
reger
24b0fa2a38 extend snapshot Html2Image.pdf2image to use PDFBox image export capability 
if no external tool installed (and for Win)
Resulting jpg are not always perfect (if graphic included) but imho sufficient.
 2016-05-16 02:13:33 +02:00
reger
eb2a00b1d8 fix NPE on missing crawldepth_i 2016-05-15 01:26:38 +02:00
reger
efb9f1a8b7 save resource for unused blacklistFiles map 2016-05-12 00:13:57 +02:00
reger
5f113be760 cleanup connectPeer & yacyVersion.latestRelease usage 
obsolete since 
527b3decde
 2016-05-06 21:05:15 +02:00
reger
7097dcbdbd cleanup hack for partial Solr update on multivalued datefields 
has been fixed in Solr http://issues.apache.org/jira/browse/SOLR-8050
 2016-05-06 02:47:04 +02:00
reger
f10ea3c155 clean-out unused SwitchboardConstants 2016-05-05 00:55:22 +02:00
reger
ef24593347 delete obsolete SEARCHRESULT busythread constants 
not used since 29.05.2013 18:27:27
0c1a018bbd
 2016-05-04 01:30:10 +02:00
reger
125b5e26a5 apply bugfix for ChartPlotter from Pullreq 42 
https://github.com/yacy/yacy_search_server/pull/42
thanks to otteresk (https://github.com/otteresk)
 2016-05-03 03:06:06 +02:00
reger
06ce9ae711 prevent "unchecked conversion" compiler message 
+ include "translate" property in xlf "trans-unit" export
 2016-05-01 02:22:05 +02:00
reger
b4a576dbdf exclude unused protocol param "duetime" 
(receiver interpretes param "time" only)
 2016-04-25 01:57:33 +02:00
reger
3bd6ae8d8b keep addon/Notepad++ keyword marker on lng export 
(length of remarks devider line)
+ harmonize status_p.inc lng text
 2016-04-21 00:51:08 +02:00
reger
16837d60c7 fix version in locale version file 
(it's compared to full version)
 2016-04-17 22:54:28 +02:00
reger
0fb01e429e fix migration, account for ssl port in config (for auto-disable https) 2016-04-17 04:42:05 +02:00
reger
7be1c7a05a fix logger name 2016-04-17 03:20:14 +02:00
reger
1d940e5a94 upd commons-compress 1.11 2016-04-16 23:31:03 +02:00
reger
7789c32c82 delete crawl queue on init exception 
(happens occasionally on path name vaiolation and will never get resolved)
 2016-04-16 00:22:48 +02:00
reger
f781b9dd47 revert call condition f. migration.installSkins 
(a bug introduced in fb8ae14b21 , 
see comment on that commit )
 2016-04-14 22:14:32 +02:00
reger
3adb670f44 remove never used Domains.myHostNames set 2016-04-14 02:54:41 +02:00
reger
6ecc180299 fix rwi doubledom return best (highest) ranking 2016-04-12 03:55:43 +02:00
reger
2343e3f1cd keep and update existing xlf translation master instead of create new 
in utility CreateTranslationMasters
+ small fixes in lng's
 2016-04-09 23:25:05 +02:00
reger
a1935f485f Added utility class CreateTranslationMasters to create a language independant 
translation master as source to harmonize individual translation files
Included a main to create masters in YaCy an xliff format for testing 

+ restrict TranslatorXliff to use only entries with State=translated

P.S. used https://open-language-tools.java.net/editor/about-xliff-editor.html to
experiement with xlf output (haven't a Pootle avail.)
 2016-04-05 01:57:32 +02:00
reger
acaf51b296 keep ConfigLanguage_p as 1st entry in exported translation file 
+ rem untranslated text & some typo fixes in several translations
(considering to create a translation master file to harmonize entries)
 2016-04-04 02:56:19 +02:00
reger
61c5b6b403 fix empty drop down list in ConfigLanguage after wrong/empty download 
+ add xliff translated attribut
+ append japanese lng name
 2016-03-31 01:51:25 +02:00
reger
4eddabee42 translate Network History screen -> de 
+ remove leftover debug line
 2016-03-30 01:09:13 +02:00
reger
90c79014ae remove unused translator routine which also doesn't handle rel path input 
+ correct some language file match issues
 2016-03-29 21:31:02 +02:00
reger
902e79e261 Introduce a TranslatorXliff wich can read/write xliff from/to internal translation map. 
This eases up suggested initatives from http://mantis.tokeek.de/view.php?id=649
Allows longer term also to store translation maps for the htroot files 
in standardized/reuseable xliff format ( http://docs.oasis-open.org/xliff/xliff-core/xliff-core.html ).
+ added test case creating and comparing xliff file with internal custom prop file.
(currently the introduced class is not used in core code)
 2016-03-28 23:26:30 +02:00
reger
d9adc2c255 load handler for Transparent Proxy on startup only if feature is activated 
to save the resources and keep handler chain small if the feature is not used.
+add a warning message on settingsack_p page to restart on first activation
 2016-03-25 05:26:48 +01:00
reger
ec24a0c85a add test case for optimized toTokens() 2016-03-24 19:26:38 +01:00
reger
cada24f918 adjust utility ListNonTranslatedFiles for path compare on windows 
(backslash replace)
 2016-03-20 23:46:39 +01:00
reger
fb8ae14b21 make migration version safe 2016-03-20 03:34:28 +01:00
reger
258cd41577 reduce logging (EmbeddedSolrConnector.query) 
mainly to reduce the frequent metadat checks like
> EmbeddedSolrConnector.query QUERY: q={!cache=false raw f=id}xXxXxX&rows=1&start=0&fl=id,load_date_dt
(p.s. direct servlet queries logged via AccessTracker.addToDump)
 2016-03-14 22:32:06 +01:00
reger
6783ef5540 move example code SearchClient out of yacycore package 
to example directory
 2016-03-14 02:22:06 +01:00
Michael Peter Christen
b89465d952 0N - basic dump upload servlet infrastructure, to share index dumps 
within an experimental new sharing model
 2016-03-11 18:12:13 +01:00
Michael Peter Christen
f12a900f3e harmonization of http post of files for one and several files - this had 
been differently - and wrong for several files. also: base64-encoding
for gzipped push files because our data structures currently only
supports ASCII POST pushes..
 2016-03-11 08:59:33 +01:00
Michael Peter Christen
849ab671a9 0n: modified the p2p bootstraping process - rules had been too tight and 
did not support the re-start of a network with just one principal peer.
 2016-03-11 08:54:42 +01:00
reger
764f5100f0 fix delete of temp file after odt % ooxml parser 
Close zipfile after parsing
 2016-03-04 23:05:55 +01:00
reger
379e9b330d use supplied url port to get robots.txt in crawlers hostqueue 2016-03-02 00:12:34 +01:00
reger
58a959403d fix mixed logfactory in UrlProxyServlet, 
Class doesn't use functions of declared ancestor, change to extend on httpservlet
 2016-02-27 03:44:43 +01:00
Michael Peter Christen
2494a820c7 0N - added recording of dump exports if given time frame is not negative 2016-02-24 15:13:20 +01:00
Michael Peter Christen
ef2cc4f690 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2016-02-24 11:19:32 +01:00
Michael Peter Christen
a6bf0b1649 0N - added option to generate index export files for a specific number 
of minutes in the past and reverted latest change. The export file dump
will now contain four data elements: f - first date of index entry write
date, l - last date of index write date, n - now-date of index dump
time, c - count of numbers inside the dump. '0N' denotes a series of
changes which will lead to the opportunity to exchange index data dumps
in a way that is needed to integrate ZeroNet index data. This will be
based on index dump sharing; that causes this commit.
 2016-02-23 18:56:20 +01:00
reger
6d56beaed8 fix assertion exception in toString of MultiProtocolURL 
toString of AnchorURL and MultiProtocolURL are identical code
(no need to override or to protect call to parent)

as reported in https://github.com/yacy/yacy_search_server/issues/43
 2016-02-21 00:23:00 +01:00