Commit Graph

12328 Commits

Author SHA1 Message Date
Michael Peter Christen
fe308f47d5 added greeting line to interactive search and harmonized display
position with 'Administration' line in all administration pages
2015-12-28 23:20:37 +01:00
Michael Peter Christen
582d059fb7 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-12-28 22:57:39 +01:00
Michael Peter Christen
a7b41bd206 use curl downloads in download script with silent mode 2015-12-28 22:57:31 +01:00
reger
46ac0867ff fix poison mediawikiimporter output queue also after ExecutionException
in worker thread.
Writer of importer keeps needs a poison to close the file. On exception (e.g. OOM)
add a poison marker in outer most try/catch to assure output queue will terminate
in this condition too (and closes+renames the surrogate/in/xxx.prt file)
2015-12-28 02:32:00 +01:00
reger
a7591d3ed0 fix mediawikiimporter number format exception on coordinate parsing
handle uncomplete metadata like "NS=43/50//N". 
For other {expr ... } type entries a try catch added
2015-12-27 01:59:15 +01:00
Michael Peter Christen
fade8452c6 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-12-26 23:45:00 +01:00
Michael Peter Christen
7274e50d7f Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-12-26 22:25:15 +01:00
Michael Peter Christen
5a39f9f679 stub to use a new app launcher for mac 2015-12-26 22:25:08 +01:00
reger
9da1712a31 increase http header EXPIRES for css and images in DefaultServlet
to increase browser cache hits for not changing content
2015-12-26 17:35:46 +01:00
reger
6d54eb3d36 skip loading document on crawl start for YMark bookmarks
by adding a constructor giving the already loaded document as parameter.
2015-12-26 01:15:07 +01:00
reger
50f64ddc3b apply default css styles (class btn) to submit buttons 2015-12-25 01:08:51 +01:00
reger
7f6ee76eb9 upd to ImageIO 3.2.1 2015-12-25 00:53:16 +01:00
reger
09d3dd13d6 limit bookmark tag cloud font-size to 2.0em 2015-12-24 19:39:37 +01:00
reger
3076c87247 fix typo in Steering.html 2015-12-24 04:37:24 +01:00
reger
80e2c82249 fix NPE on empty blog importfile parameter 2015-12-24 02:00:45 +01:00
reger
8a8e53b1a1 apply default css styles (class btn) to blacklist* submit buttons 2015-12-23 23:11:37 +01:00
reger
0fa6340936 apply more default css styles (class btn) to submit buttons 2015-12-23 00:04:40 +01:00
reger
bf098412cf use input type=file for choosing IndexImportMediawiki_p dump file 2015-12-22 20:15:08 +01:00
reger
e84d94f8ca fix mime table for ms office / open office documents
(causing wrong parser detect in intranet mode)
2015-12-22 17:48:24 +01:00
reger
7c6d6cd69a change some more submit button to bootstrap btn css class 2015-12-22 01:36:23 +01:00
reger
4eb7fb0ee5 just remove debug leftover 2015-12-21 19:47:40 +01:00
reger
45b9bd8403 adjust MultiProtocolURL.protocol detection to handle mailto with "://" in parameters,
and feeding hyperlinks to webgraph processing.
2015-12-21 04:42:26 +01:00
reger
67f64af4b4 quick fix: go back to display search results favicon via <img> tag and ViewImage,
! until better solution is found !.

Reason: in IE-Browser no individual favicon is displayed with <object> tag 
(always the default) and only few individual fav's with Firefox (randomly)

hint: to be able to use <img src=ViewImage/> return of default icon was
added back to it.

relates to http://mantis.tokeek.de/view.php?id=629
2015-12-21 01:05:59 +01:00
reger
d5fd031449 fix reading of ippattern config array in URLProxy 2015-12-20 15:51:54 +01:00
reger
b7e8358645 make use of header.getContentType where possible (mime is normalized afterwards)
otherwise use header.mime() differentiated in prev. commit.
2015-12-20 15:49:24 +01:00
reger
7a8c077838 fix HeaderFramework.mime() to strip charset parameter.
Differentiate mime() and getContentType() which gives the raw header field.
This improves parser detection if charsets are included in http content-type field.
2015-12-20 06:44:16 +01:00
reger
b4b6910d60 fix (todo): correct doc.id of remote search result if no match with newly
calculated doc hash if different.
Testing showed that in some cases delivered url doesn't match the local
calculated hash. In this case replace doc.id (and host_id_s) with calculation
from url.
2015-12-20 02:10:49 +01:00
reger
15e46b2bad exclude in/outboundlinksnofollowcount_i from default schema fields
(not used in any function)
2015-12-19 21:25:08 +01:00
reger
dec3e6ad96 fix: adjust urlstub for mailto links
(skip protocol)
2015-12-19 20:13:33 +01:00
reger
cb83e65f89 drop returning document language "en" if unknown (fix todo)
which also harmonizes handling of query.modifier for rwi and solr results
(to result must match a given language filter)
2015-12-19 01:42:35 +01:00
reger
0c5548a7ff fix (todo) remove redundant holding of email link nameproperty in parser document 2015-12-18 02:35:44 +01:00
reger
71c416f383 show mailto links in ViewFile.html linklist 2015-12-18 01:11:55 +01:00
reger
6b7c10cef8 fix dc:date in mediawikiimporter/document.writexml to use lastmodified 2015-12-17 02:53:10 +01:00
reger
14803d58cd let html scraper accept html5 <link rel="icon"> for favicon links 2015-12-17 00:36:08 +01:00
luc
b4cdacee76 Merge branch 'master' of https://github.com/yacy/yacy_search_server 2015-12-16 03:26:06 +01:00
luc
ba0a293f5c Corrected another case of
org.apache.lucene.store.AlreadyClosedException" occuring when
SearchEvent.cleanup() was called while committing local solr index.
2015-12-16 03:25:07 +01:00
reger
4d2b934487 prevent mailto links getting into parser result document's in/outbound link collection
by checking mailto scheme early.
- fix upper case mailto protocol assignment
- add test case for getProtocol
2015-12-16 03:01:17 +01:00
luc
befb2415f8 Corrected frames preview displaying eventually incorrectly in local
administration mode.
2015-12-16 02:23:58 +01:00
luc
8c4ab9c76b Added an option to eventually limit size of remote solr documents put to
local index. See mantis #626.
2015-12-16 02:20:03 +01:00
luc
8827b86b2a Added useful debug JVM parameters as comment. 2015-12-16 02:09:33 +01:00
luc
a2c08402af Merge branch 'master' of https://github.com/yacy/yacy_search_server 2015-12-15 23:30:30 +01:00
reger
288acceac3 fix test htmlParserTest, charset parameter
+ upd maven templating-plugin version
2015-12-15 02:09:43 +01:00
luc
55a4d15775 Added a note on deprecated default search field and operator. 2015-12-14 23:55:12 +01:00
luc
70595d05d0 Modified MemoryControl.main() test to properly end for better results
displaying.
2015-12-14 23:49:28 +01:00
sixcooler
1be67d9ab6 CachedSolrConnector was replaced by ConcurrentUpdateSolrConnector years
ago - time to let it go
Commented out unused table of cache-objects
2015-12-14 21:33:27 +01:00
reger
28b8bc290a fix use of NETWORK_SEARCHVERIFY for rwi verification
was not used to set the searchevent parameter (done in SearchEventCache.getEvent)
- remove unused corresponding QueryParams.filterfailurls param.
2015-12-13 20:01:49 +01:00
reger
020630efd8 remove unused network scanner parameter from queryparameter
Search event is not using networkscanner 
(removed filterscannerfail param always init to false)
2015-12-13 02:50:08 +01:00
Michael Peter Christen
967508a87d fix in error handling 2015-12-09 01:21:00 +01:00
reger
7cda48a9d6 add hint to "default max results per page" limit on ConfigPortal
(limit is applied in yacysearch & max. total results by sum result-stack size)
- remove obsolete search.navigation prop (has moved to ConfigSearchPage_p)
2015-12-09 00:49:38 +01:00
Michael Peter Christen
b2fac989fd Merge pull request #32 from luccioman/master
Fix for MediaWiki import (mantis 625)
2015-12-08 12:19:05 +01:00