Michael Peter Christen
b461a27abb
fixed the SolrServlet
2013-12-20 01:51:51 +01:00
Michael Peter Christen
7603e879dc
Merge branch 'master' into HEAD
...
Conflicts:
.classpath
source/net/yacy/cora/federate/solr/SolrServlet.java
2013-12-20 01:19:06 +01:00
Michael Peter Christen
25250405f1
solr servlet preparation for join with jetty branch
2013-12-20 00:45:58 +01:00
reger
c84c313fe1
Merge origin/master into jetty
2013-12-14 20:02:24 +01:00
Michael Peter Christen
74466d731a
use pre-compiled patterns in ymark
2013-12-12 11:50:48 +01:00
Michael Peter Christen
09412ea3a4
counting search requests in solr interface
2013-12-12 03:37:19 +01:00
Michael Peter Christen
67e7dc0cc6
added more properties to seedlist servlet
2013-12-06 14:30:47 +01:00
Michael Peter Christen
79771c60c0
IPv6 fixes
2013-12-06 14:30:08 +01:00
reger
92d9c56f9f
Merge origin/master into jetty
2013-12-05 22:53:29 +01:00
Michael Peter Christen
da380343c2
perform greedy learning heuristic only if load < 1.0
2013-12-04 22:44:51 +01:00
Michael Peter Christen
81926c055d
fixed bug with image search in yacyinteractive
2013-12-04 18:44:23 +01:00
Michael Peter Christen
edda0699e4
changed default timeout for port scanner
2013-12-04 18:13:43 +01:00
Michael Peter Christen
f1b5db2c45
- performance graph does not shop peer ping in memory monitor any more
...
- after a forced GC, the PerformanceMemory view switches to automatic
update by default
2013-12-04 12:59:30 +01:00
Michael Peter Christen
0db8e34625
enhanced webgraph processing
2013-12-04 01:54:45 +01:00
Michael Peter Christen
9d8b32c63a
fixed a division by zero
2013-12-04 01:54:14 +01:00
Michael Peter Christen
957f6297fb
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2013-11-30 01:46:03 +01:00
reger
effea4bca0
Merge origin/master into jetty
...
Conflicts:
source/net/yacy/cora/federate/solr/SolrServlet.java
2013-11-29 22:39:52 +01:00
reger
b49e90d2e9
remove reference to solrServlet from YaCy servlet select
...
- reference is not used
- solrServlet is used in Jetty branch and adjustments there conflict with unused solrServlet here.
2013-11-29 22:10:14 +01:00
Michael Peter Christen
38e1e3a707
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2013-11-29 02:46:38 +01:00
sixcooler
2c2ebb0d92
tried some hardening in order not letting any Solr-Searchers open
2013-11-29 02:40:12 +01:00
Michael Peter Christen
cca79d12ef
setting of some default values to make an client development start easy
...
using the description at
http://www.yacy-websuche.de/wiki/index.php/Dev:APIhello
2013-11-29 01:28:48 +01:00
Michael Peter Christen
3d4b5e66ce
disallow remote robots to crawl the HostBrowser servlet
2013-11-26 07:06:25 +01:00
Michael Peter Christen
234ca720f5
only admins should be able to force a commit
2013-11-26 07:03:20 +01:00
Michael Peter Christen
2c39b65409
fixes for searches containing stopwords. The fix was done using a
...
reconstruction of the search word set access method to protect that
words are deleted from the sets from the outside of the QueryGoal class.
2013-11-26 02:24:47 +01:00
orbiter
61409788eb
less word hash computations (removing some overhead because of MD5
...
calcs) using the clear word in a normalized form.
2013-11-25 15:20:54 +01:00
reger
5c4a3d1c01
Merge origin/master into jetty
2013-11-24 21:00:39 +01:00
Michael Peter Christen
caa20d63d9
fixed seedlist (hash was missing)
2013-11-22 14:15:52 +01:00
Michael Peter Christen
ccf2f4e43b
refactoring of seed attributes (introduced more constants)
2013-11-22 14:15:31 +01:00
Michael Peter Christen
c927b428d3
fixed json
2013-11-22 10:07:08 +01:00
Michael Peter Christen
64048ff217
fir for XSS
2013-11-22 09:53:32 +01:00
orbiter
b7f1e5af51
added new servlet which generates the same file as the principal peers
...
upload to a bootstrap position
you can call it either with
http://localhost:8090/yacy/seedlist.html
or to generate json (or jsonp) with
http://localhost:8090/yacy/seedlist.json
http://localhost:8090/yacy/seedlist.json?callback=seedlist
2013-11-19 15:56:10 +01:00
orbiter
3e552550d1
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2013-11-18 22:48:00 +01:00
orbiter
c2d720cdaf
purge a lucene cache - possible memory leak fix
2013-11-18 22:47:35 +01:00
reger
f111f30ace
Merge origin/master into jetty
2013-11-17 00:18:25 +01:00
Michael Peter Christen
f4172cbb3d
fix for another XSS bug
2013-11-17 00:17:25 +01:00
orbiter
ff86cb683f
fixed some XSS bugs reported by Marius from http://ctf365.com/
2013-11-16 20:34:31 +01:00
orbiter
19a051bec8
more monitoring for postprocessing and enhanced layout in Crawler
...
monitor page
2013-11-16 18:23:14 +01:00
Michael Peter Christen
fceac8cffd
more monitoring for postprocessing
2013-11-16 08:23:42 +01:00
Michael Peter Christen
9d5895f643
enhanced and fixed postprocessing
2013-11-15 15:41:12 +01:00
Michael Peter Christen
087df05e24
added option to Config_Network_p.html to enable remote search while
...
DHT-Receive is switched off.
2013-11-13 13:38:01 +01:00
Michael Peter Christen
1a4a69c226
set more logger to 'final static'
2013-11-13 06:18:48 +01:00
Michael Peter Christen
69b8d61c47
fix for search requests in GSA interface which contain 'funny'
...
characters (like ':' etc.)
2013-11-12 15:54:54 +01:00
orbiter
4234b0ed6c
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2013-11-10 18:50:43 +01:00
orbiter
74c86a72a0
better default value for crawler user agent
2013-11-10 18:48:00 +01:00
reger
1437c45383
merge rc1/master
2013-11-07 21:30:17 +01:00
Michael Peter Christen
87a956e881
calculating and showing the number of files and the average size of a
...
file in the HTCACHE in ConfigHTCache_p.html
2013-11-07 12:13:12 +01:00
Michael Peter Christen
acc1f8a749
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2013-11-07 12:01:37 +01:00
Michael Peter Christen
81bb50118e
found and fixed a huge memory leak in solr caching (inside Solr). The
...
not-flushed Solr cache is now handled in this way:
- it is smaller by default
- an Solr-internal process is started to flush the cache periodically
(this does NOT clean the cache, just removes old objects)
- a Solr-external process (the standard YaCy cleanup-process) now has
direct access to the solr internal cache and flushes them completely.
The time frame for such a flush is defined by the cleanup-process
frequency, by default 10 minutes.
2013-11-07 10:01:44 +01:00
sixcooler
987f410011
URL-export:add query and fix for cast-class-exception
2013-11-06 19:22:26 +01:00
Michael Peter Christen
ffe8276063
replaced referrer link masking to 'pure' links to the referring page
...
(that was more useful during testing)
2013-11-06 18:05:46 +01:00
