Commit Graph

3673 Commits

Author SHA1 Message Date
Michael Peter Christen
2107674999 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2016-09-14 16:24:55 +02:00
Michael Peter Christen
0d28f563f4 fix for java version "9-ea" 2016-09-14 16:24:32 +02:00
reger
3b694b3935 add some javadoc to rwi wordreference distance, position
to remember facts for http://mantis.tokeek.de/view.php?id=683
Init missing word position to 0 like in other non text body words
2016-09-14 00:36:19 +02:00
reger
a4465c97d6 as requested, disable/remove old swf parser
http://forum.yacy-websuche.de/viewtopic.php?f=8&t=5861#p33098
2016-09-13 02:47:36 +02:00
reger
7f63fc50f3 prepare a IndexSegment test case for RWI index testing
+ prevent NPE in Segment.clear() on missing embedded solr instance.
2016-09-11 23:25:44 +02:00
reger
96467c5467 remove not needed counter in Tokeninzer (completing last changes)
including a small change, word posintext counting. 
We remember/store 1st posintext. Previously following words got a handle (posintext)
excluding found. Now it just counts and assigns true posintext as handle (posintext)
2016-09-10 18:23:09 +02:00
luccioman
d66b0f7b7b Fixed french messages encoding in YaCy tray.
Also added the missing french translations.
2016-09-09 07:43:33 +02:00
reger
7efb66ee10 adjust the WordReference.join wordsintext calc to take the max (instead of sum)
The reference is for the same url (add same for title and phrases).
+ del redundant join() procedure
2016-09-08 02:29:48 +02:00
luccioman
0a9ff14d96 Fixed NullPointerException case and added Javadoc 2016-09-07 10:03:48 +02:00
luccioman
06d4f93d03 Merged master into postprocessing branch 2016-09-07 09:28:37 +02:00
Michael Peter Christen
b73d2db914 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2016-09-07 06:49:15 +02:00
Michael Peter Christen
25a3c7a6d0 catch exception and write end of object 2016-09-07 06:48:52 +02:00
reger
272cdd496a reactivate sentence counter in WordTokenizer for phrasepos ranking,
by counting punktuation (delivered as 1 char word) again.
2016-09-07 02:16:16 +02:00
Michael Peter Christen
5e165a8150 removed unused imports 2016-09-06 18:46:24 +02:00
Michael Peter Christen
c716648c78 enhanced json encoding of strings 2016-09-06 18:45:29 +02:00
Michael Peter Christen
6139bd85a8 fix for broken facet names 2016-09-06 17:19:54 +02:00
Michael Peter Christen
5060f9fee9 fix for too long snippets 2016-09-06 09:05:39 +02:00
Michael Peter Christen
8681cee3f3 fix for bad comma 2016-09-06 09:00:35 +02:00
Michael Peter Christen
db6d8fc197 fix for bad json 2016-09-06 07:44:38 +02:00
Michael Peter Christen
8f4a341735 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2016-09-06 06:58:17 +02:00
Michael Peter Christen
9934f546bb added default fl to solr query, removed large texts retrieval and
changed snippet to description tag if no other description is available
2016-09-06 06:56:51 +02:00
reger
120bf7e6e2 implemented RWI WordReference to return the word position value (was always left empty)
This is needed and enables existing word position ranking for RWI.
The upcoming concurrency issue in word position min/max calculation were eliminated
by iterator.hasHext check before next() access.
2016-09-06 03:18:02 +02:00
reger
e310ec5f70 fix posInText ranking calculation to score 0 on no position info
+ fix Word posInText calc in Tokenizer to start with 1
+ test case
2016-09-06 00:05:59 +02:00
luccioman
74f9927ddc Merge remote-tracking branch 'origin/master' into dist_macOS 2016-09-05 22:42:17 +02:00
reger
51c077f493 adjust the getTopics() and getTopicNavigator() to current useage
- move the maxcount limit restriction completely to getTopicNavigator (as there not used in getTopics)
- let search servlet use getTopics by default (w/o RWI connected check, as of now, Topics are available w/o any additional index interaction)
2016-09-05 00:07:01 +02:00
reger
39dd244693 fix ConcurrentScoreMap.set() calculation of totalCount()
+ test case
2016-09-04 22:18:07 +02:00
reger
ebf818ad95 log a error on aborted news publish (due to duplicate news.id)
+ change printed err msg to log entry in PeerAction.processPeerArrival
2016-09-04 06:42:48 +02:00
reger
cc2d9dd3f1 reactivate the use of included-in-topwords boost in postRanking
+ changed the postRanking to add one score only if word appears more as one time.
+ getTopics() unused code block rem'd (save performace)-> routine needs rework !
2016-09-04 00:09:45 +02:00
luccioman
39ea28adfd Merged master to dist_macOS branch. 2016-09-03 15:22:57 +02:00
luccioman
8255e91c99 Fixed serverClassLoader.findClass method
htroot is a supposed to be a subfolder of appPath and not of dataPath,
as assumed in other places where htroot is loaded. This issue was not
visible when dataPath and appPath are equals.
2016-09-03 15:21:02 +02:00
reger
6801673a07 apply postranking media search boost only on media queries 2016-09-03 03:37:40 +02:00
luccioman
1dc4306058 Fixed indentation for better readability. 2016-09-02 11:23:02 +02:00
luccioman
8c49a755da Postprocessing refactoring
Added Javadocs to refactored methods.
Added log warnings instead of silently failing some errors.
Only fill collection1hosts when required ( shallComputeCR true).
2016-09-01 15:40:28 +02:00
luccioman
42f45760ed Refactored postprocessing
For easier understanding and performances profiling.
2016-08-31 12:16:25 +02:00
reger
4386e84b55 correct NewPool rentention calculation
(was still clearing everything after one day)
2016-08-31 02:24:30 +02:00
reger
5e72d37f0a TransNews_p: add ad-hoc translation of target file on positive vote (additon to local translation)
+ errmsg on language=default
2016-08-30 00:06:42 +02:00
reger
9462a32244 Added news service for easy, community driven UI translation support.
New or modified translation (via /Translator_p.html) can be shared/distributed
via the YaCy internal news service. Remote peers can see and vote on the
translation via the new http://localhost:8090/TransNews_p.html servlet.
A positive vote will add the received translation to the local translation
list and post a voting message to the news service.
(at this no processing of received votings is implemented)

+ fixed the msg service retention time check (NewsPool.automaticProcessP)
2016-08-29 02:15:06 +02:00
reger
f8d6543a23 Rename class CreateTranslationMaster to TranslationManager and add
additional routines and the capability to handle translation maps internally 
(to reduce complexity of handling translation maps for calling servelets)
2016-08-28 23:08:03 +02:00
reger
19b4509d54 speed-up reading of xlif language file, by using xmlparser (stax) instead of jaxb
making xliff-core-1.2-1.1.jar obsolete
2016-08-28 02:55:42 +02:00
Michael Peter Christen
e1fac86f53 Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2016-08-26 14:51:43 +02:00
Michael Peter Christen
a9316ceff6 force browser-caching of favicons from search results 2016-08-26 14:51:32 +02:00
Orbiter
503312ca43 Merge pull request #61 from luccioman/heroku_experiments
Deploy YaCy on Heroku
2016-08-26 11:57:41 +02:00
reger
33bf35d90f missing file for prev commint "Introduction of additional language setting browser" 2016-08-23 00:13:20 +02:00
reger
16e8ed3f01 Introduce additional language setting "browser/Browser Language" for UI internationalization.
If language is set to "browser" the client/user browser language is used to choose from
available translation.
simply: one users browser speaks English -> YaCy responds in English, other users browser speaks French -> YaCy responds in French.

! To make a translation/language available you have to activate the language once ! 
(or manually use the utility class TranslateAll)
In ConfigBasic.html availabel translations are marked green on setting language=Browser
The client language is determined by http header Accept-Language (checked in DefaultServlet)
2016-08-23 00:04:24 +02:00
reger
3b47a07dd1 change unused servletProperties entry CONNECTION_PROP_CLIENT_REQUEST_HEADER to
use directly HttpServletRequest. This is used to get the http protocol version
in HTTPDProxyHandler.fulfillRequestFromWeb() for error response to client.
- adjust YaCyProxyServlet and UrlProxyServlet accordingly
- use more http_version constants in headerframework and httpdeamon
- equalize servlets (3) use of HeaderFramework.CONNECTION_PROP_HOST to HeaderFramework.HOST
2016-08-21 19:34:44 +02:00
reger
036c1dc6ef fix CookieTest_p formatting (output of <br> as text),
change to dataoutput only by servlet, leave formatting to html.
+ removed link to obsolete env/grafics gif
2016-08-20 22:23:47 +02:00
Michael Peter Christen
bf6709d196 fixed missing browser activation in linux 2016-08-19 19:24:15 +02:00
Michael Peter Christen
d8504418b6 enhanced browser-caching of static content 2016-08-19 19:23:51 +02:00
Michael Peter Christen
079112358c Merge branch 'master' of https://github.com/yacy/yacy_search_server.git 2016-08-19 15:31:09 +02:00
Michael Peter Christen
efeb592661 don't do solr optimization, this create high IO load. We should leave
this task to solr to do that on it's own instead of forcing it.
2016-08-19 15:30:53 +02:00