Commit Graph

11954 Commits

Author SHA1 Message Date
Michael Peter Christen
f810915717 added crawl start from a clone with very, very large url: they are now
encoded as post submit form inside a javascript creation function.
2015-05-11 16:30:41 +02:00
Michael Peter Christen
51de86c992 disabled debug thread dumps 2015-05-11 14:46:09 +02:00
Michael Peter Christen
d524a9d77c Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-05-11 14:42:40 +02:00
Michael Peter Christen
0710648c31 enable api calls with very long urls 2015-05-11 14:42:21 +02:00
reger
31346e873b upd library reference of missing jsch-0.1.21 in seeduploadscp.xml
upd to jsch-0.1.52.jar
2015-05-11 01:35:12 +02:00
reger
609c52e987 refactor getBookmark
to consistenly check existance by != null (w/o throwing exception on not found)
2015-05-11 00:37:04 +02:00
reger
1481a8ab56 add opensearch rss results to dht collection (due to text = snippet)
which is used to differentiate meta from full data
- make sure check for dht is not dependant on number of collection entries
2015-05-10 18:52:33 +02:00
reger
5f4d35437e add bookmark.query to edit form 2015-05-10 15:30:21 +02:00
reger
f134aa7f7f persist bookmark timestamp
on setTimeStamp()
2015-05-10 15:29:23 +02:00
reger
752eec6697 fix NPE in addToIndex when used outside searchEvent 2015-05-10 05:18:23 +02:00
reger
a6daddbeaa upd to commons-io-2.4.jar 2015-05-10 03:00:05 +02:00
reger
89124335c4 update bookmark autosearch description
- add german translation
2015-05-10 02:29:08 +02:00
Michael Peter Christen
fbf85a1561 added temporary debug output in http client 2015-05-08 15:31:01 +02:00
Michael Peter Christen
ff29b0e503 added option to re-index exported xml snapshot dumps to
HTCACHE/snapshots by just placing them in the SURROGATES/in path
2015-05-08 15:30:26 +02:00
Michael Peter Christen
6f4fe4b175 revert of 8a7c68e4c7
keeping surrogates after processing is essential for some users. If the
space they are taking is too high, please set up an automatic deletion
process (like a cronjob).
2015-05-08 14:01:30 +02:00
Michael Peter Christen
213401a446 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-05-08 13:48:29 +02:00
Michael Peter Christen
97930a6aad added must-not-match filter to snapshot generation.
also: fixed some bugs
2015-05-08 13:46:27 +02:00
Michael Peter Christen
9d8f426890 adding a try-catch to link graph processing to prevent that a single
malformed url interrupts the storage process
2015-05-08 10:38:33 +02:00
reger
b47267b79c precaution against NPE on createorgetBookmark on search result 2015-05-07 03:25:19 +02:00
Michael Peter Christen
75879e051b Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-05-03 03:03:45 +02:00
reger
8a5b8f8789 on bookmaring of search result, remember orig. query in separate bookmark property
(instead of using the description field)
- adjust display and autosearch
- don't overwrite existing bookmark but combine info
2015-05-03 02:31:50 +02:00
reger
7224209486 break out of NormalizeDistributor loop on timeout 2015-05-02 02:36:18 +02:00
reger
cf1fc7f700 harmonize filesearch input box layout 2015-05-01 19:24:14 +02:00
reger
4d73e9de06 upd to metadata-extractor-2.8.1 2015-04-30 00:01:11 +02:00
Michael Peter Christen
e334a06370 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-04-29 10:51:09 +02:00
reger
0904a041a6 upd to poi-3.11.jar 2015-04-29 01:53:04 +02:00
reger
47e61f8325 fix typo in image filter query
(extra bracket)
2015-04-28 03:12:14 +02:00
reger
4b4ab6799f fix String out of range in Collection Nav
see http://mantis.tokeek.de/view.php?id=573
2015-04-27 22:38:40 +02:00
reger
572cfe8fd4 improve character encoding for urlproxy servlet
for none utf-8 pages
2015-04-26 17:42:39 +02:00
reger
b161473cd0 upd to jsoup-1.8.2 2015-04-26 17:41:05 +02:00
reger
6bc8a9b11e make Quality of Service Servlet available to prioritize requests from local host
This assigns priorities to incoming requests. Higher priority numbers are served before lower.
(disabled by default in defaults/web.xml, 
uncomment or copy entry to DATA/Settings/web.xml)
2015-04-26 04:29:32 +02:00
reger
af2d66e3d8 correct typo in de.lng 2015-04-25 22:38:38 +02:00
reger
71bf95af8a upd parser calls in test cases 2015-04-25 03:24:28 +02:00
reger
579303a04e add additional links to crawl queue pages 2015-04-25 02:45:05 +02:00
Michael Peter Christen
99718dc09a don't record dump generation calls since that
- is not a change of the index
- happens very often within self-backup strategies from the outside
(i.e. cronjobs)
2015-04-23 18:17:28 +02:00
Michael Peter Christen
5b59477415 update to bootstrap.css 3.3.4 2015-04-23 06:36:57 +02:00
Michael Peter Christen
016b4e58ac Merge pull request #4 from dertuxmalwieder/master
Readme improvements
2015-04-21 10:13:57 +02:00
Sven Knurr
82a8c282f7 Readme improvements
Now GitHub should display it properly. Also, added OpenBSD.
2015-04-20 14:30:45 +02:00
Michael Peter Christen
0d365e67a5 Merge pull request #2 from Scarfmonster/master
English Synonyms and small fixes
2015-04-20 10:24:34 +02:00
Michael Peter Christen
1ded4b4889 Merge pull request #3 from shaman/master
How about normal font weight in the searched titles & fix RSS icon position?
2015-04-20 10:23:39 +02:00
Eugene Kuligin
4f1cb7c65c fix typos 2015-04-20 05:27:15 +03:00
Eugene Kuligin
8ae3229306 add vertical margin to the search cloud block 2015-04-20 05:24:50 +03:00
Eugene Kuligin
f9408dfa48 fix RSS icon displaying 2015-04-20 05:19:37 +03:00
Eugene Kuligin
62c95c6759 increase view space with normal font weight in the searched titles 2015-04-20 05:13:05 +03:00
reger
f7b0148f6a fix NPE in Vocabulary_p servlet
called w/o parameter
2015-04-20 00:01:14 +02:00
Ryszard Goń
ca1a70aec8 fix for Accept '?' URLs column in Crawl Profile List 2015-04-19 15:55:49 +02:00
Ryszard Goń
b0cd0212fd SynonymLibrary status check fix for multiple files 2015-04-17 17:38:48 +02:00
Ryszard Goń
f3f1b2e899 added English synonyms 2015-04-17 17:32:54 +02:00
reger
5408448a56 skip redundant add. of keywords to text
search uses keywords as default search field
2015-04-17 02:14:13 +02:00
reger
296e97c78e put https port in peers dna
as we flag if a peer is accesible via https, we need to know the port if we want to use is (e.g. for interYaCy communication)
start to provide / tansport the port by recording it in peers dna.
- add https link on the Network.html lock symbol
2015-04-16 02:36:12 +02:00