Commit Graph

11288 Commits

Author SHA1 Message Date
reger
e033e79826 remove old description for proxy port settings (Settings_p.html?page=ProxyAccess)
- The options were not current (only port number accepted, which is part of ConfigBasic.html)
- Deleted options and the port number input field from the proxyaccess page.
- joined both transparent proxy setup pages (Settings_Http.inc & Settings_ProxyAccess.inc) in one page
- adjustments to the related/linked pages
2014-08-20 22:45:36 +02:00
orbiter
e4e1bdeba0 added 0x40 to image of lockopen-gif image palette (light grey) 2014-08-20 00:55:31 +02:00
orbiter
7028a39abb changed lock/unlock image design 2014-08-20 00:48:48 +02:00
orbiter
b4f2a1db6e added a unlock icon for all protected pages that are unlocked because
the administrator is logged in.
2014-08-19 19:58:31 +02:00
sixcooler
aa3e5f2046 bump to httpclient-4.3.5 2014-08-19 14:51:07 +02:00
reger
7267c76881 set default "Search Interfaces"."Solr RSS/Opensearch" query to show latest 10 addition to index 2014-08-18 02:53:03 +02:00
reger
d5077b94e4 update Netbeans IDE classpath 2014-08-18 00:05:52 +02:00
reger
516c8c02b1 update to commons-compress-1.8.1
(bugfix release)
2014-08-18 00:04:55 +02:00
reger
ea6c9e9b07 reduce mem buffer overhead for gap files during r/w
(they are typically small compared to idx allowing to use smaller buffersize -> set to 16k records)
2014-08-18 00:03:24 +02:00
reger
8d1b764458 update to Jetty 9.2.2 2014-08-17 00:59:16 +02:00
reger
e88537522d allow single quote " ' " in query
see http://mantis.tokeek.de/view.php?id=379
-add QueryGoal test case for this
2014-08-16 14:29:52 +02:00
reger
f76d81f5c9 fix: hanging text in input fields of WatchWebStructure_p.html
in IE11
2014-08-16 03:37:36 +02:00
orbiter
487021fb0a snippet computation update 2014-08-15 01:17:11 +02:00
orbiter
cf9e7fdbb8 reverted template from latest cherry-picked commit 2014-08-15 00:06:22 +02:00
Alex
f6c7467a90 updated some french translations 2014-08-15 00:04:10 +02:00
orbiter
1c2f1f233a Merge branch 'master' of git@gitorious.org:yacy/rc1.git 2014-08-14 20:58:05 +02:00
reger
5a4995ded3 fill solr rss writer dc:subject tag with keyword content 2014-08-14 03:06:41 +02:00
orbiter
927aaa95a6 concurrency bugfix 2014-08-13 00:59:11 +02:00
Alexandre Vouilloz
564f1cf6d3 updated fr traduction of ConfigBasic.html and header.template + fixed some accents in fr.lng 2014-08-13 00:27:06 +02:00
orbiter
c9e593cf78 removed warnings 2014-08-11 23:53:12 +02:00
reger
19e35a9126 add type attribute to atom feed <link> tag
(for /yacysearch.atom)
2014-08-11 21:46:39 +02:00
orbiter
51bb21c6b4 reverted .classpath from cherry-picked
ce1fd1e901
2014-08-11 20:05:15 +02:00
Alexandre Vouilloz
2dd8be3c66 updated the traduction of Status_p.inc in the french locale 2014-08-11 20:03:47 +02:00
reger
e50b2b4d04 fix test case MultiProtocolURL.toString()
(only allowed on AnchorURL)
2014-08-11 04:29:43 +02:00
reger
0a2f4a0e2f eliminate lat/lon type conversion in osm
(define as double)
2014-08-10 22:35:25 +02:00
reger
7584352e7b use more predefined Solr query parameter constants
- use CommonParams and DisMaxParams constants
- fix typo in get sort parameter
- getDocumentCountByParams redundant implementation and risk of not optimized call (row parameter unspecified) -> as only used from getCountByQuery removed from interface
2014-08-10 22:33:10 +02:00
reger
f9db5dd6c5 reduce doublecontent check document (prevent out of memory)
see http://mantis.tokeek.de/view.php?id=437

test result (concurrency=7)
2000 docs = eom always
1000 docs = eom always
100 docs = eom never

chosen -> 200 docs (eom not encountered during test with 1GB mem setting)
2014-08-10 03:18:15 +02:00
reger
e9eae45b55 simplify rssreader and improve atom feed link extraction
- type detection (rss/atom) 
    - init type parameter overwritten during parse, parameter obsolete
    - detection by endtag changed to simpler first-tag evaluation
- channel image not used, removed related extra parser handling
    - remove unused code (set/getImage) in rssfeed
- atom link extraction to account for possible multipe link tags
   - spec limits link to one with rel="alternate" or one without rel attribute
     not accounting for the follwing type & hreflang exception yet:

   o  atom:entry elements MUST NOT contain more than one atom:link
      element with a rel attribute value of "alternate" that has the
      same combination of type and hreflang attribute values.
2014-08-10 01:29:16 +02:00
reger
a8508417d1 catch NPE during crawl (OAI import)
- condenseDocument mime=null (allowed)
- collectionconfiguration responseheader = null (allowed)
2014-08-08 00:02:59 +02:00
reger
3dde94422f center searchevent lines on network graph
(PerformanceSearch_p.html)
2014-08-06 23:04:42 +02:00
Michael Peter Christen
3860711aef fix for possible interruption of concurrent queries 2014-08-06 12:55:18 +02:00
Michael Peter Christen
01bbb20666 increased default logging line count to max 2014-08-06 12:40:35 +02:00
Michael Peter Christen
6344718f8b reducing the concurrent query stack size and reduced concurrency of
postprocessing to avoid OOM situations
2014-08-06 12:36:59 +02:00
Michael Peter Christen
eca9380e3d bugfix for crawler double-check: if an url is redirected, the
redirect-target was not double-checked. This is now done by replacing
the redirect-URL on the crawl queue again (where it is double-checked)
2014-08-06 12:35:12 +02:00
Michael Peter Christen
9ac0c93f17 fix for subpath crawl filter 2014-08-06 01:33:24 +02:00
Michael Peter Christen
9bc3e457dd fix for termination of all crawls 2014-08-05 22:23:52 +02:00
Michael Peter Christen
66106bdaf0 fix for crawler attribute maxdompages 2014-08-05 21:32:25 +02:00
Michael Peter Christen
49d91b94c3 npe fix in crawler 2014-08-05 21:31:59 +02:00
Michael Peter Christen
8d650ca225 added hint to port forwarding videos 2014-08-05 21:31:28 +02:00
Michael Peter Christen
b7183a7321 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-08-05 09:54:18 +02:00
reger
ea2e627662 fix ConfigAccounts del user with uppercase letter in name
(usernames are case sensitive, userdb.delete used toLower)
2014-08-05 01:27:27 +02:00
Michael Peter Christen
c465b791af typo 2014-08-04 16:13:39 +02:00
Michael Peter Christen
191ec8c82a added concurrency to postprocess rewrite process 2014-08-04 15:28:58 +02:00
Michael Peter Christen
a1e8bdd5e9 log ppm instead of docs/second 2014-08-04 14:44:42 +02:00
Michael Peter Christen
cc0ded7abd set process type of web graph according to fields as defined in the
schema
2014-08-04 14:44:20 +02:00
Michael Peter Christen
12fb9d7cd1 log postprocessing constraints in case that postprocessing is not
performed
2014-08-04 14:19:37 +02:00
Michael Peter Christen
3c23b89823 less logging 2014-08-04 13:37:34 +02:00
Michael Peter Christen
a0c53174c5 better solr query logging to detect unnecessary sort requests for more
performance profiling
2014-08-04 13:00:45 +02:00
Michael Peter Christen
338f574bdc no sorting if http/www unique fields are not demanded (makes query
faster) and some code restrucuring
2014-08-04 12:59:38 +02:00
Michael Peter Christen
1609763be5 toString fix 2014-08-04 12:58:39 +02:00