Commit Graph

12140 Commits

Author SHA1 Message Date
reger
15e46b2bad exclude in/outboundlinksnofollowcount_i from default schema fields
(not used in any function)
2015-12-19 21:25:08 +01:00
reger
dec3e6ad96 fix: adjust urlstub for mailto links
(skip protocol)
2015-12-19 20:13:33 +01:00
reger
cb83e65f89 drop returning document language "en" if unknown (fix todo)
which also harmonizes handling of query.modifier for rwi and solr results
(to result must match a given language filter)
2015-12-19 01:42:35 +01:00
reger
0c5548a7ff fix (todo) remove redundant holding of email link nameproperty in parser document 2015-12-18 02:35:44 +01:00
reger
71c416f383 show mailto links in ViewFile.html linklist 2015-12-18 01:11:55 +01:00
reger
6b7c10cef8 fix dc:date in mediawikiimporter/document.writexml to use lastmodified 2015-12-17 02:53:10 +01:00
reger
14803d58cd let html scraper accept html5 <link rel="icon"> for favicon links 2015-12-17 00:36:08 +01:00
reger
4d2b934487 prevent mailto links getting into parser result document's in/outbound link collection
by checking mailto scheme early.
- fix upper case mailto protocol assignment
- add test case for getProtocol
2015-12-16 03:01:17 +01:00
reger
288acceac3 fix test htmlParserTest, charset parameter
+ upd maven templating-plugin version
2015-12-15 02:09:43 +01:00
sixcooler
1be67d9ab6 CachedSolrConnector was replaced by ConcurrentUpdateSolrConnector years
ago - time to let it go
Commented out unused table of cache-objects
2015-12-14 21:33:27 +01:00
reger
28b8bc290a fix use of NETWORK_SEARCHVERIFY for rwi verification
was not used to set the searchevent parameter (done in SearchEventCache.getEvent)
- remove unused corresponding QueryParams.filterfailurls param.
2015-12-13 20:01:49 +01:00
reger
020630efd8 remove unused network scanner parameter from queryparameter
Search event is not using networkscanner 
(removed filterscannerfail param always init to false)
2015-12-13 02:50:08 +01:00
reger
7cda48a9d6 add hint to "default max results per page" limit on ConfigPortal
(limit is applied in yacysearch & max. total results by sum result-stack size)
- remove obsolete search.navigation prop (has moved to ConfigSearchPage_p)
2015-12-09 00:49:38 +01:00
Michael Peter Christen
b2fac989fd Merge pull request #32 from luccioman/master
Fix for MediaWiki import (mantis 625)
2015-12-08 12:19:05 +01:00
luc
ad5586f8f6 Merge branch 'master' of https://github.com/yacy/yacy_search_server 2015-12-08 03:35:36 +01:00
luc
8ebefa4233 Fixed MediaWiki import : DCEntry conversion to SolrInputDocument was
failing. Looks like it was broken since Commit
b43811d38c
2015-12-08 03:34:03 +01:00
luc
7736ee5a42 Updated MediaWimporter main() : display usage in console and stop
properly without calling System.exit
2015-12-08 03:30:51 +01:00
reger
cdb8f3b10d make current ranking score value avail. to search interface / api
Update the result score result field with the result queue ranking value to reflect
the actual calculated/used score,
for rwi & solr stack results.
(calc. etc. is unchanged, it's just that result entry carries the latest val
as api retrieves the number from it)
2015-12-08 03:17:32 +01:00
reger
a622c9b656 upd to Bootstrap v3.3.6 2015-12-07 23:03:59 +01:00
luc
92df100596 Merge branch 'master' of https://github.com/yacy/yacy_search_server 2015-12-07 21:59:05 +01:00
luc
27d11f8671 Fixed isSolrDump function : PushBackInputStream was not unread when
returning false (for example with a WikiMedia dump).
2015-12-07 21:58:36 +01:00
reger
1043fe55a3 add missing bootstrap 3.3.4 glyphicons file
see comment @luc http://mantis.tokeek.de/view.php?id=623#c1151
2015-12-07 01:30:00 +01:00
Michael Peter Christen
135a123a77 less logging in new language detection 2015-12-03 00:39:15 +01:00
Michael Peter Christen
ef8cd80593 fix for npe 2015-12-03 00:33:13 +01:00
reger
0347bfa71f Apply collection query constraint/modifiert to rwi result stack.
Collection is not available in pure rwi entries (but in local solr metadata)
But if user wishes to filter by query constraint also rwi shall adhere to this
(even if only rwi entries with parsed or solr received metadata may fit)
2015-12-02 22:57:59 +01:00
Michael Peter Christen
dac8332476 Merge pull request #29 from luccioman/master
Modified images render error management
2015-12-01 14:39:59 +01:00
luc
29585e2c5b Corrected return type when licence is gone to be consistent with other
error cases.
2015-12-01 09:55:47 +01:00
luc
df77e90ed7 Merge branch 'master' of https://github.com/yacy/yacy_search_server 2015-12-01 09:13:16 +01:00
luc
2a67d2ba6f Corrected error management for unsupported image formats, parsing
errors, and unavailable resources : avoid logging to much Exceptions as
these errors easily occur when searching images.
2015-12-01 01:06:01 +01:00
reger
997f18f658 prevent exception on repeated ViewImage with same urlLicense 2015-12-01 00:06:50 +01:00
reger
9cfa847c94 upd maven pom (add langdetect) 2015-11-30 18:57:16 +01:00
Michael Peter Christen
5309b99e98 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-11-30 17:01:39 +01:00
Michael Peter Christen
d6e9834040 Merge branch 'master' of
https://github.com/Scarfmonster/yacy_search_server

# Conflicts:
#	.classpath
#	build.xml
2015-11-30 16:54:54 +01:00
Michael Peter Christen
c030b9bc5c Merge pull request #27 from Stepanov-Sergey/master
added Russian synonyms
2015-11-30 13:45:25 +01:00
Michael Peter Christen
cff152f26e Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-11-30 13:44:36 +01:00
Michael Peter Christen
7e785dac8e urlproxyheader must be in the default package because all classes in the
htroot path must be in the default package
2015-11-30 13:35:41 +01:00
Michael Peter Christen
d82d311995 Merge branch 'master' of https://github.com/luccioman/yacy_search_server
# Conflicts:
#	.classpath
2015-11-30 13:34:10 +01:00
Michael Peter Christen
d3ab43e743 fixed classpath 2015-11-30 13:19:49 +01:00
Michael Peter Christen
06994b5853 Merge pull request #23 from linkerlin/patch-1
Create .travis.yml
2015-11-30 13:18:03 +01:00
Sergey Stepanov
de0f3c6ff1 added Russian synonyms 2015-11-30 11:37:47 +03:00
reger
b5371ea8c1 read/init crawl queue in a thread
to speed-up YaCy start on large existing crawler queues
2015-11-29 05:19:39 +01:00
reger
f05b34fc35 upd to slf4j-1.7.13 2015-11-29 01:24:46 +01:00
reger
1160b13172 remove unused md5 from ViewFile servlet params 2015-11-28 23:09:15 +01:00
reger
e163ea88f6 fix vsdParser (Visio) parser return statement
(final block un-necessary throw)
2015-11-28 02:43:38 +01:00
reger
b2c8bc0ae6 remove md5_s from default index fields
it is not assigned a value / not used
Due to above also excluded from transfer protocol.
2015-11-27 02:41:02 +01:00
luc
e40ae0943b - No max dimensions specified : render raw image data when source and
target image format are the same.
- Corrected scaling condition.
2015-11-26 09:30:43 +01:00
luc
4c36b7bd14 Merge branch 'master' of https://github.com/yacy/yacy_search_server
Conflicts:
	.classpath
2015-11-26 09:28:34 +01:00
reger
90686a75a2 fix flux factor (additional crawl delay by access count) calculation 2015-11-25 01:34:41 +01:00
reger
d79fa7fbeb upd to Jetty v9.2.14.v20151106 2015-11-24 21:35:58 +01:00
luc
4af27289e5 Merge branch 'master' of https://github.com/yacy/yacy_search_server 2015-11-23 09:01:25 +01:00