Commit Graph

12211 Commits

Author SHA1 Message Date
Michael Peter Christen
5d635879f8 Merge pull request #40 from Scarfmonster/autocrawl
Automatic crawling
2016-01-14 22:19:55 +01:00
Ryszard Goń
7d6e0d8470 Add missing settings to autocrawl settings page 2016-01-14 03:27:33 +01:00
Ryszard Goń
7a7a1277bd Add autocrawl settings page 2016-01-14 02:40:46 +01:00
Ryszard Goń
a98c395023 Add the Autocrawl thread 2016-01-14 00:50:23 +01:00
reger
4765e374e6 altered clac. of search result items per page to display
taking the existing limits into account but make it consistent with search option screen for admin and public user
changes:
  - configured default number of items per page (ConfigPortal_p.html) is used as is (no hardcoded limit)
  - otherwise requests are limited to 100 results per page ( = search option, index.html)
      (this basically is the major change, inc. limit from 20 to 100 for public user)
P.S. - the older grant of more (1000), if no online snippet calculation, is kept (for the time being)

see http://mantis.tokeek.de/view.php?id=627
2016-01-13 01:30:49 +01:00
Ryszard Goń
1728cd30c6 Create autocrawl profiles 2016-01-12 16:28:34 +01:00
reger
abd8ecb503 remove contendom depending override of search result items per page
initially introduced e4570bffaf (diff-ae6c130fc11088c830b00ed9256ab56b)
(as one part of unexpected difference in actual vs requested results, partial bugfix for http://mantis.tokeek.de/view.php?id=627 )
2016-01-12 01:04:10 +01:00
reger
8271f783ca upd pom javadoc goal
to not fail a build on javadoc errors
2016-01-11 01:38:45 +01:00
reger
ff27824964 fix swfParser reading file signature
before passing to library (current version expects data w/o signature)
2016-01-10 01:16:31 +01:00
reger
b29db4640c update Maven pom - add release-profile
to create the release archive only if profile is activated (speeding up normal compilation)
- bind install of the 2 jar's not available in repository to validate phase (was clean)
  to automatically add these to local repository (with disadvantage it's done every time)
2016-01-09 20:32:47 +01:00
reger
04161912a5 fix tray icon switch
(using predefined/correct config name)
2016-01-09 01:19:06 +01:00
reger
e3d53f0248 add de translation for IndexExport_p 2016-01-08 02:46:29 +01:00
reger
9f5b768d84 fix typo in translation (de,hi) for AccessTracker_p
- rem some not translated in ru (-> currently best maintained translation)
2016-01-08 01:10:09 +01:00
reger
c91e712178 further refactor using standard java / (one) utf-8 charset variable
extending initiative of commit 9a25751850
2016-01-07 16:17:37 +01:00
Michael Peter Christen
e3e8015306 Merge pull request #28 from Stepanov-Sergey/patch-1
fixed typos
2016-01-06 14:57:26 +01:00
Michael Peter Christen
3dbd3caecf Merge pull request #37 from sudheesh001/LogFix
Log files are commitable and shouldn't be
2016-01-06 14:56:55 +01:00
Michael Peter Christen
9a25751850 Merge pull request #38 from luccioman/master
Refactoring : use StandardCharsets instead of hardcoded charset names
2016-01-06 14:55:54 +01:00
reger
bfcca6bfee update on translation files
- delete removed servlets
 AugmentedBrowsingFilters_p.html (de)
 CrawlStartIntranet_p.html (de)
 IndexCreateWWW***Queue_p.html (de)
 Ranking_p.html (de)
- add
 IndexCreateQueues_p.html
- rename
 Settings_Http.inc -> Settings_ProxyAccess.inc
 Language_p.html -> ConfigLanguage_p.html
2016-01-06 11:36:57 +01:00
reger
c283efdd6d remove obsolete css style for removed file CacheAdmin_p.html
and remove from translations
2016-01-06 00:51:49 +01:00
luc
571bc55937 Refactoring : use StandardCharsets constants instead of hard-coded
charset names.
2016-01-05 23:37:05 +01:00
reger
218061752e add missing quote chars in sk.lng translation file
+ minor: del one redundancy
2016-01-05 10:48:51 +01:00
reger
e8256bb3b1 remove blekko from opensearch config (not available)
see https://blekko.com/
http://searchengineland.com/goodbye-blekko-search-engine-joins-ibms-watson-team-217633
2016-01-04 04:49:10 +01:00
sudheesh001
23ac8d186e Log files are commitable and shouldn't be 2016-01-04 07:45:08 +05:30
reger
1af0e9ef74 remove workaround for Solr bug regarding multivalued date fields
fixed in 5.4.0
http://issues.apache.org/jira/browse/SOLR-8050
2016-01-03 01:11:27 +01:00
sixcooler
5a35f9383a bump to solr/lucene 5.4.0 2016-01-02 21:07:50 +01:00
reger
a58d34a4e8 check error URL cache before adding errorDoc to index
- del obsolete related switchboardconstant
2016-01-02 05:03:57 +01:00
reger
9636a74633 remove local credential on download of config files from remote systems
(blacklists, language, skins) to reduce risk to expose md5-pwd.
- remove NoSuchElementException in loop
2016-01-01 06:08:41 +01:00
reger
e9539b1086 reintroduce special handling of file upload multipart/form-data from HTTPDemon.parseMultipart
- add filename to parameter fieldname
- add filecontent to special parameter fieldname$file
(some servlets use this $file parameter)

fix for http://mantis.tokeek.de/view.php?id=542
2015-12-31 03:04:13 +01:00
reger
1636541c48 correct filename input in settings_seed_upload.inc form
to get filename
(recently introduced by change form "text" to the more convenient "file" input  50f64ddc3b)
2015-12-30 21:27:44 +01:00
reger
cd26717ba2 fix low memory status hint (dht-in disabled)
http://mantis.tokeek.de/view.php?id=619
2015-12-29 20:38:45 +01:00
reger
a5faf73afa remove obsolete yacy.init entries interaction.*
(related to removed triplestore)
2015-12-29 15:41:19 +01:00
sixcooler
775e74b055 Merge branch 'master' of https://github.com/yacy/yacy_search_server 2015-12-28 23:23:37 +01:00
sixcooler
dce1cb65c4 Merge remote-tracking branch 'choose_remote_name/master' 2015-12-28 23:20:42 +01:00
Michael Peter Christen
fe308f47d5 added greeting line to interactive search and harmonized display
position with 'Administration' line in all administration pages
2015-12-28 23:20:37 +01:00
Michael Peter Christen
582d059fb7 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-12-28 22:57:39 +01:00
Michael Peter Christen
a7b41bd206 use curl downloads in download script with silent mode 2015-12-28 22:57:31 +01:00
reger
46ac0867ff fix poison mediawikiimporter output queue also after ExecutionException
in worker thread.
Writer of importer keeps needs a poison to close the file. On exception (e.g. OOM)
add a poison marker in outer most try/catch to assure output queue will terminate
in this condition too (and closes+renames the surrogate/in/xxx.prt file)
2015-12-28 02:32:00 +01:00
reger
a7591d3ed0 fix mediawikiimporter number format exception on coordinate parsing
handle uncomplete metadata like "NS=43/50//N". 
For other {expr ... } type entries a try catch added
2015-12-27 01:59:15 +01:00
Michael Peter Christen
fade8452c6 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-12-26 23:45:00 +01:00
Michael Peter Christen
7274e50d7f Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-12-26 22:25:15 +01:00
Michael Peter Christen
5a39f9f679 stub to use a new app launcher for mac 2015-12-26 22:25:08 +01:00
reger
9da1712a31 increase http header EXPIRES for css and images in DefaultServlet
to increase browser cache hits for not changing content
2015-12-26 17:35:46 +01:00
reger
6d54eb3d36 skip loading document on crawl start for YMark bookmarks
by adding a constructor giving the already loaded document as parameter.
2015-12-26 01:15:07 +01:00
reger
50f64ddc3b apply default css styles (class btn) to submit buttons 2015-12-25 01:08:51 +01:00
reger
7f6ee76eb9 upd to ImageIO 3.2.1 2015-12-25 00:53:16 +01:00
reger
09d3dd13d6 limit bookmark tag cloud font-size to 2.0em 2015-12-24 19:39:37 +01:00
reger
3076c87247 fix typo in Steering.html 2015-12-24 04:37:24 +01:00
reger
80e2c82249 fix NPE on empty blog importfile parameter 2015-12-24 02:00:45 +01:00
reger
8a8e53b1a1 apply default css styles (class btn) to blacklist* submit buttons 2015-12-23 23:11:37 +01:00
reger
0fa6340936 apply more default css styles (class btn) to submit buttons 2015-12-23 00:04:40 +01:00