orbiter
b3ebd38079
removed the HTDOCS repository concept because the concept to host files
...
on the YaCy http server is obsolete; YaCy can index file:// and smb://
paths
2014-08-26 19:02:53 +02:00
Michael Peter Christen
2de159719b
added an option to set 'obey nofollow' for links with rel="nofollow"
...
attribute in the <a> tag for each crawl. This introduces a lot of
changes because it extends the usage of the AnchorURL Object type which
now also has a different toString method that the underlying
DigestURL.toString. It is therefore not advised to use .toString at all
for urls, just just toNormalform(false) instead.
2014-07-18 12:43:01 +02:00
reger
d9472d043a
cleanup older unused classes
2014-07-10 02:20:01 +02:00
reger
665e12f88e
move startup time from old serverCore to switchboard (most used here)
...
to make servercore eventually obsolete.
2014-07-10 02:17:56 +02:00
Michael Peter Christen
ba6ffddefc
refactoring
2014-06-12 05:23:26 +02:00
reger
0587077d06
cleanup obsolete and not used serverswitch Authentify code
...
as auth is mostly delegated to Jetty container.
2014-05-14 23:13:49 +02:00
reger
79e7947442
- remove empty http0_9 status text array
...
and unused default_charset = ISO-8859-1
2014-04-18 22:03:16 +02:00
reger
2dabe2009d
- remove unused manual http KeepAlive config
...
(reducing references to obsolete httpdemon)
- add port info to settings_http
2014-04-18 19:57:35 +02:00
reger
710054bb37
implement gzip input handling directly in defaultservlet
...
(making reference to legacy httpdemon obsolete)
2014-04-17 03:20:29 +02:00
Michael Peter Christen
36a66b0704
fix for parsing of numeric value in case that boolean values are given
2014-04-04 11:59:51 +02:00
orbiter
41730c8048
better logging in template engine: shows filename of servlets where
...
errors in templates occur
2014-04-04 10:55:46 +02:00
sixcooler
f06775850f
fix receiving DHT / parse pultipart
...
+ another close to fix possible resource leak warning
2014-04-02 01:24:15 +02:00
reger
b12200cafe
alternative UrlProxyServlet (for /proxy.html) using different url rewrite rules
...
- use JSoup parser for selective rewrite of html body <a href= links only,
instead of regex which rewrites also header href/src links
- this improves display of pages which use header <base> tag
- tags with src attribute are taken from original location (like css) improving display and are not routed trough the indexer
Disadvantage: scripting links will drop out of proxy
Setting of the servlet through web.xml exclusivly (in case one would like to quickly switch back to the YaCyProxyServlet,
leaving the existing code of YaCyProxyServlet untouched available)
2014-03-30 04:04:02 +02:00
Michael Peter Christen
b488f33975
added close to fix possible resource leak warning
2014-03-28 14:34:49 +01:00
reger
b9056ef2db
remove unused private header entries (HeaderFramework)
...
X_YACY_ORIGINAL_REQUEST_LINE
X_YACY_KEEP_ALIVE_REQUEST_COUNT
CONNECTION_PROP_REQUESTLINE
2014-03-26 23:28:19 +01:00
reger
c297de5145
remove check for unused virtual path /currentyacypeer/
...
- del jqueryheader.template (not used)
2014-03-21 03:02:19 +01:00
Michael Peter Christen
453bfd0f17
removed unused variables and warnings
2014-03-19 09:29:01 +01:00
reger
a373fb717d
remove more unused from legacy server.http
...
- triggerOnlineAction not used
- useTemplateCache not used
2014-03-14 03:12:04 +01:00
reger
749d020aeb
remove redundant url string manipulation in HTTPDProxyHandler
...
(still used by ProxyServlet)
2014-03-14 02:24:12 +01:00
Michael Peter Christen
b08375da33
fix for bad/missing values of size_i
2014-03-11 09:51:04 +01:00
reger
dd5bf0b71b
cleanup old reference to HTTPDemon.setAlternativeResolver
...
optimize .yacyh check in AbstractRemoteHandler
2014-03-06 03:08:04 +01:00
reger
3b89176b9f
use config value htroot in Jetty init (was hardcoded)
...
- move htroot exist check from old httpdfilehandler to startup, remove from filehandler and legacy proxyhandler
- use SwitchboardConstant.htroot where appropriate
2014-02-27 00:23:34 +01:00
reger
ad4b213145
remove unused static var from HTTPDProxyHandler
2014-02-02 03:47:12 +01:00
Michael Peter Christen
d2b8f2b477
enhancements for staticIP and ipv6 handling
2014-01-27 13:48:20 +01:00
Michael Peter Christen
6ada0daae9
making latency_factor and maximum number of same hosts in loader queue
...
settings available in Crawler_p.html servlet for steering.
2014-01-21 19:28:00 +01:00
sixcooler
40a4030b55
configurable max-load values for YaCy-Threads:
...
try lower values on smal systems like a Pi
2014-01-21 17:04:22 +01:00
Michael Peter Christen
022c6d3ce1
do YaCy p2p connections using a timeout-request which covers the http
...
request into a separate thread and ignores the furthure result of a
request if that does not answer within the requested time-out. This is a
try to solve a problem with the peer-ping, which hangs whenever a peer
appears to be dead or blocked.
2014-01-19 15:21:23 +01:00
reger
ea7cef5d05
fix NPE in TemplateEngine
...
StackTrace For input string: ""
java.lang.NumberFormatException: For input string: ""
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:504)
at java.lang.Integer.parseInt(Integer.java:527)
at net.yacy.server.http.TemplateEngine.writeTemplate(TemplateEngine.java:241)
at net.yacy.server.http.TemplateEngine.writeTemplate(TemplateEngine.java:199)
at net.yacy.http.servlets.YaCyDefaultServlet.handleTemplate(YaCyDefaultServlet.java:896)
2014-01-10 18:11:32 +01:00
reger
6932aa4d7a
use configured admin-username for api calls
...
- the admin user name can be configured, in apiExec calls the default "admin" username is used.
TODO: the bin/apicall.sh script should likely take that into account.
2014-01-07 21:26:50 +01:00
orbiter
3cb6c7861f
fixed shutdown authenticaton problem
2014-01-06 01:48:54 +01:00
Michael Peter Christen
7005ecdabd
cleanup
2014-01-05 15:06:40 +01:00
Michael Peter Christen
9bd71fdbb4
made the access tracker class static because it shall be used by the
...
jetty auth module
2014-01-05 05:04:28 +01:00
reger
4c38bceafc
handle http connect for proxy
...
refactor header cleanup (reuse existing code)
2014-01-04 13:09:34 +01:00
reger
0583f44306
reimplement proxy access log (to Jetty ProxyHandler)
...
- using existing HTTPDProxyHandler logger
- allow local loopback ip to access proxy
2014-01-02 03:37:33 +01:00
reger
8eaabb9600
remove dependency from old serverCore.java
...
- remaining getPortNr not needed
(as current release allows only to set plain integer as port,
see ConfigBasic)
2013-12-29 02:00:44 +01:00
Michael Peter Christen
667a6adddb
- use default files from yacy.init property "defaultFiles" if no
...
jetty-configuration is given for default files.
- fix a problem with default paths if no path is given (i.e.
http://localhost:8090 instead of http://localhost:8090/ ). Without this
patch the path was resolved automatically to http://localhost:8090//
2013-12-26 23:59:04 +01:00
Michael Peter Christen
e17624b6dd
added html retrieval from alternative DATA/HTDOCS path
2013-12-23 02:06:33 +01:00
Michael Peter Christen
07cee6b99c
removed more unused code
2013-12-23 01:51:48 +01:00
Michael Peter Christen
84167adb49
removed unused anomichttpd code after migration to jetty
2013-12-23 01:23:40 +01:00
Michael Peter Christen
7603e879dc
Merge branch 'master' into HEAD
...
Conflicts:
.classpath
source/net/yacy/cora/federate/solr/SolrServlet.java
2013-12-20 01:19:06 +01:00
Michael Peter Christen
25250405f1
solr servlet preparation for join with jetty branch
2013-12-20 00:45:58 +01:00
reger
f111f30ace
Merge origin/master into jetty
2013-11-17 00:18:25 +01:00
orbiter
ff86cb683f
fixed some XSS bugs reported by Marius from http://ctf365.com/
2013-11-16 20:34:31 +01:00
Michael Peter Christen
087df05e24
added option to Config_Network_p.html to enable remote search while
...
DHT-Receive is switched off.
2013-11-13 13:38:01 +01:00
reger
b29d262e70
implement Jetty8HttpServerImpl.generateSocketAddress
...
(code 1:1 copied from serverCore)
2013-11-10 18:59:18 +01:00
reger
f017066197
Merge origin/master into jetty
2013-10-27 15:09:24 +01:00
reger
69599566f9
catch one more malformed url in proxy url rewrite
2013-10-27 04:42:33 +01:00
reger
605530fec5
catch proxy url rewrite exception
...
malformed url (" http:\/\/" ) may cause error response
testcase http://localhost:8090/proxy.html?url=http://dictionary.reference.com/browse/test
2013-10-27 04:06:11 +01:00
reger
1adb4b8741
merge rc1/master
2013-10-16 03:02:21 +02:00
reger
0d4efabaa8
fix YaCy version string in proxy headers
...
(config parameter vString not longer used)
2013-10-13 17:56:53 +02:00