Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
11,099 Commits 1 Branch 20 Tags 836 MiB
b3ebd38079
Commit Graph

110 Commits

Author SHA1 Message Date
orbiter
b3ebd38079 removed the HTDOCS repository concept because the concept to host files 
on the YaCy http server is obsolete; YaCy can index file:// and smb://
paths
 2014-08-26 19:02:53 +02:00
Michael Peter Christen
2de159719b added an option to set 'obey nofollow' for links with rel="nofollow" 
attribute in the <a> tag for each crawl. This introduces a lot of
changes because it extends the usage of the AnchorURL Object type which
now also has a different toString method that the underlying
DigestURL.toString. It is therefore not advised to use .toString at all
for urls, just just toNormalform(false) instead.
 2014-07-18 12:43:01 +02:00
reger
d9472d043a cleanup older unused classes 2014-07-10 02:20:01 +02:00
reger
665e12f88e move startup time from old serverCore to switchboard (most used here) 
to make servercore eventually obsolete.
 2014-07-10 02:17:56 +02:00
Michael Peter Christen
ba6ffddefc refactoring 2014-06-12 05:23:26 +02:00
reger
0587077d06 cleanup obsolete and not used serverswitch Authentify code 
as auth is mostly delegated to Jetty container.
 2014-05-14 23:13:49 +02:00
reger
79e7947442 - remove empty http0_9 status text array 
and unused default_charset = ISO-8859-1
 2014-04-18 22:03:16 +02:00
reger
2dabe2009d - remove unused manual http KeepAlive config 
(reducing references to obsolete httpdemon)
- add port info to settings_http
 2014-04-18 19:57:35 +02:00
reger
710054bb37 implement gzip input handling directly in defaultservlet 
(making reference to legacy httpdemon obsolete)
 2014-04-17 03:20:29 +02:00
Michael Peter Christen
36a66b0704 fix for parsing of numeric value in case that boolean values are given 2014-04-04 11:59:51 +02:00
orbiter
41730c8048 better logging in template engine: shows filename of servlets where 
errors in templates occur
 2014-04-04 10:55:46 +02:00
sixcooler
f06775850f fix receiving DHT / parse pultipart 
+ another close to fix possible resource leak warning
 2014-04-02 01:24:15 +02:00
reger
b12200cafe alternative UrlProxyServlet (for /proxy.html) using different url rewrite rules 
- use JSoup parser for selective rewrite of html body <a href=  links only,
instead of regex which rewrites also header href/src links
- this improves display of pages which use header <base> tag
- tags with src attribute are taken from original location (like css) improving display and are not routed trough the indexer
Disadvantage: scripting links will drop out of proxy

Setting of the servlet through web.xml exclusivly (in case one would like to quickly switch back to the YaCyProxyServlet,
leaving the existing code of YaCyProxyServlet untouched available)
 2014-03-30 04:04:02 +02:00
Michael Peter Christen
b488f33975 added close to fix possible resource leak warning 2014-03-28 14:34:49 +01:00
reger
b9056ef2db remove unused private header entries (HeaderFramework) 
X_YACY_ORIGINAL_REQUEST_LINE
X_YACY_KEEP_ALIVE_REQUEST_COUNT
CONNECTION_PROP_REQUESTLINE
 2014-03-26 23:28:19 +01:00
reger
c297de5145 remove check for unused virtual path /currentyacypeer/ 
-  del jqueryheader.template (not used)
 2014-03-21 03:02:19 +01:00
Michael Peter Christen
453bfd0f17 removed unused variables and warnings 2014-03-19 09:29:01 +01:00
reger
a373fb717d remove more unused from legacy server.http 
- triggerOnlineAction not used
- useTemplateCache not used
 2014-03-14 03:12:04 +01:00
reger
749d020aeb remove redundant url string manipulation in HTTPDProxyHandler 
(still used by ProxyServlet)
 2014-03-14 02:24:12 +01:00
Michael Peter Christen
b08375da33 fix for bad/missing values of size_i 2014-03-11 09:51:04 +01:00
reger
dd5bf0b71b cleanup old reference to HTTPDemon.setAlternativeResolver 
optimize .yacyh check in AbstractRemoteHandler
 2014-03-06 03:08:04 +01:00
reger
3b89176b9f use config value htroot in Jetty init (was hardcoded) 
- move htroot exist check from old httpdfilehandler to startup, remove from filehandler and legacy proxyhandler
- use SwitchboardConstant.htroot where appropriate
 2014-02-27 00:23:34 +01:00
reger
ad4b213145 remove unused static var from HTTPDProxyHandler 2014-02-02 03:47:12 +01:00
Michael Peter Christen
d2b8f2b477 enhancements for staticIP and ipv6 handling 2014-01-27 13:48:20 +01:00
Michael Peter Christen
6ada0daae9 making latency_factor and maximum number of same hosts in loader queue 
settings available in Crawler_p.html servlet for steering.
 2014-01-21 19:28:00 +01:00
sixcooler
40a4030b55 configurable max-load values for YaCy-Threads: 
try lower values on smal systems like a Pi
 2014-01-21 17:04:22 +01:00
Michael Peter Christen
022c6d3ce1 do YaCy p2p connections using a timeout-request which covers the http 
request into a separate thread and ignores the furthure result of a
request if that does not answer within the requested time-out. This is a
try to solve a problem with the peer-ping, which hangs whenever a peer
appears to be dead or blocked.
 2014-01-19 15:21:23 +01:00
reger
ea7cef5d05 fix NPE in TemplateEngine 
StackTrace For input string: ""
java.lang.NumberFormatException: For input string: ""
	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
	at java.lang.Integer.parseInt(Integer.java:504)
	at java.lang.Integer.parseInt(Integer.java:527)
	at net.yacy.server.http.TemplateEngine.writeTemplate(TemplateEngine.java:241)
	at net.yacy.server.http.TemplateEngine.writeTemplate(TemplateEngine.java:199)
	at net.yacy.http.servlets.YaCyDefaultServlet.handleTemplate(YaCyDefaultServlet.java:896)
 2014-01-10 18:11:32 +01:00
reger
6932aa4d7a use configured admin-username for api calls 
- the admin user name can be configured, in apiExec calls the default "admin" username is used. 

TODO: the bin/apicall.sh script should likely take that into account.
 2014-01-07 21:26:50 +01:00
orbiter
3cb6c7861f fixed shutdown authenticaton problem 2014-01-06 01:48:54 +01:00
Michael Peter Christen
7005ecdabd cleanup 2014-01-05 15:06:40 +01:00
Michael Peter Christen
9bd71fdbb4 made the access tracker class static because it shall be used by the 
jetty auth module
 2014-01-05 05:04:28 +01:00
reger
4c38bceafc handle http connect for proxy 
refactor header cleanup (reuse existing code)
 2014-01-04 13:09:34 +01:00
reger
0583f44306 reimplement proxy access log (to Jetty ProxyHandler) 
- using existing HTTPDProxyHandler logger
- allow local loopback ip to access proxy
 2014-01-02 03:37:33 +01:00
reger
8eaabb9600 remove dependency from old serverCore.java 
- remaining getPortNr not needed 
  (as current release allows only to set plain integer as port,
   see ConfigBasic)
 2013-12-29 02:00:44 +01:00
Michael Peter Christen
667a6adddb - use default files from yacy.init property "defaultFiles" if no 
jetty-configuration is given for default files.
- fix a problem with default paths if no path is given (i.e.
http://localhost:8090 instead of http://localhost:8090/). Without this
patch the path was resolved automatically to http://localhost:8090//
 2013-12-26 23:59:04 +01:00
Michael Peter Christen
e17624b6dd added html retrieval from alternative DATA/HTDOCS path 2013-12-23 02:06:33 +01:00
Michael Peter Christen
07cee6b99c removed more unused code 2013-12-23 01:51:48 +01:00
Michael Peter Christen
84167adb49 removed unused anomichttpd code after migration to jetty 2013-12-23 01:23:40 +01:00
Michael Peter Christen
7603e879dc Merge branch 'master' into HEAD 
Conflicts:
	.classpath
	source/net/yacy/cora/federate/solr/SolrServlet.java
 2013-12-20 01:19:06 +01:00
Michael Peter Christen
25250405f1 solr servlet preparation for join with jetty branch 2013-12-20 00:45:58 +01:00
reger
f111f30ace Merge origin/master into jetty 2013-11-17 00:18:25 +01:00
orbiter
ff86cb683f fixed some XSS bugs reported by Marius from http://ctf365.com/ 2013-11-16 20:34:31 +01:00
Michael Peter Christen
087df05e24 added option to Config_Network_p.html to enable remote search while 
DHT-Receive is switched off.
 2013-11-13 13:38:01 +01:00
reger
b29d262e70 implement Jetty8HttpServerImpl.generateSocketAddress 
(code 1:1 copied from serverCore)
 2013-11-10 18:59:18 +01:00
reger
f017066197 Merge origin/master into jetty 2013-10-27 15:09:24 +01:00
reger
69599566f9 catch one more malformed url in proxy url rewrite 2013-10-27 04:42:33 +01:00
reger
605530fec5 catch proxy url rewrite exception 
malformed url (" http:\/\/" ) may cause error response
 testcase http://localhost:8090/proxy.html?url=http://dictionary.reference.com/browse/test
 2013-10-27 04:06:11 +01:00
reger
1adb4b8741 merge rc1/master 2013-10-16 03:02:21 +02:00
reger
0d4efabaa8 fix YaCy version string in proxy headers 
(config parameter vString not longer used)
 2013-10-13 17:56:53 +02:00