Commit Graph

12291 Commits

Author SHA1 Message Date
reger
fb8ae14b21 make migration version safe 2016-03-20 03:34:28 +01:00
Burkhard
be0b09552c Merge pull request #46 from reelsense/patch-1
Grammar fix - ConfigRobotsTxt_p.html
2016-03-19 18:29:34 +01:00
Bryan Black
94ce617188 Grammar fix
The sentence sounded odd.
2016-03-18 21:40:11 -07:00
reger
23b523cb50 upd to poi-3.14 2016-03-14 22:34:13 +01:00
reger
258cd41577 reduce logging (EmbeddedSolrConnector.query)
mainly to reduce the frequent metadat checks like
> EmbeddedSolrConnector.query QUERY: q={!cache=false raw f=id}xXxXxX&rows=1&start=0&fl=id,load_date_dt
(p.s. direct servlet queries logged via AccessTracker.addToDump)
2016-03-14 22:32:06 +01:00
reger
6783ef5540 move example code SearchClient out of yacycore package
to example directory
2016-03-14 02:22:06 +01:00
reger
6a8f3f3eba adding Mavens output dir to gitignore 2016-03-14 01:17:41 +01:00
reger
df80ff3c81 upd Eclipse classpath for slf4j jars 2016-03-14 00:57:21 +01:00
reger
dce85a72c5 correct "SLF4J: Defaulting to no-operation (NOP) logger implementation"
introduced earlier d9036bb9b7
2016-03-13 05:50:51 +01:00
reger
b1926d1e98 activate hack in libbuild/pom.xml to include main project as build module
This allows to use libbuild/pom as main maven project to build all needed
libs to compile and run YaCy, including YaCy itself.

Furthermore, maven is well supported by Netbeans IDE so we can discontinue
to maintaine Netbeans IDE specific project settings (in directory nbproject,
which lack config for debug anyway, nbproject can be deleted and NB will
compile YaCy via maven).

Additionally adjusted pom's project name to match the name in the repository.
2016-03-13 04:03:32 +01:00
reger
d9036bb9b7 upd to slf4j-1.7.18
remove direct declaration of slf4j-api in pom (let maven do it's job)
2016-03-13 01:34:10 +01:00
reger
a9c2f8503e upd to Solr 5.5.0 2016-03-12 22:08:22 +01:00
reger
5ee56ea8e5 del outdated lib/dependencies.txt
as alternative you may use maven build site:site goal which produces
a complete list of direct and transitive dependencies.
2016-03-12 02:12:56 +01:00
reger
567467869e upd to httpclient-4.5.2 2016-03-12 02:00:23 +01:00
reger
a57226caa6 put settings_p servlet (back) as start page for System Administration
to display the options available (as tables_p only used for indepth edit)
see http://mantis.tokeek.de/view.php?id=460
2016-03-12 01:15:05 +01:00
Michael Peter Christen
f4591b1b51 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2016-03-11 18:12:38 +01:00
Michael Peter Christen
b89465d952 0N - basic dump upload servlet infrastructure, to share index dumps
within an experimental new sharing model
2016-03-11 18:12:13 +01:00
Michael Peter Christen
f12a900f3e harmonization of http post of files for one and several files - this had
been differently - and wrong for several files. also: base64-encoding
for gzipped push files because our data structures currently only
supports ASCII POST pushes..
2016-03-11 08:59:33 +01:00
Michael Peter Christen
1ce38fdaed 0n - added experimental zeronet network which supports intranet peers
(still needs work)
2016-03-11 08:55:51 +01:00
Michael Peter Christen
849ab671a9 0n: modified the p2p bootstraping process - rules had been too tight and
did not support the re-start of a network with just one principal peer.
2016-03-11 08:54:42 +01:00
Michael Peter Christen
d05ffa1c51 update to seed list 2016-03-11 07:20:38 +01:00
reger
16724c1283 remove unused proxyCookieWhiteList from yacy.init 2016-03-11 01:14:54 +01:00
reger
51e7151591 more fixes for sevenZip parser exception on specific archives
Found 2 more cases were modified code throws exceptions while original J7Zip
unpacks it.
Reimplemented error prone CoderMixer2ST from unmodified J7Zip.jar.
2016-03-09 01:01:58 +01:00
reger
826e6e5894 remove transitive dependency guava from pom
(let Maven do it's job)
2016-03-09 00:56:34 +01:00
reger
5b07f3473e fix sevenZip parser exception with LZMA BCJ2 format archives,
see http://mantis.tokeek.de/view.php?id=641
+ sanitize some type cast's in modified sevenZip lib
2016-03-08 00:53:38 +01:00
reger
c2a88d53ab fix use of not initialized variable (m_LiteralDecoder) 2016-03-06 03:24:09 +01:00
reger
96b8d9b09e moving the J7Zip-modified source and Maven build to libbuild
from main pom. 
Using source included in j7zip-modified.jar.
This combines all external lib preparation in the libbuild main pom.
2016-03-06 03:19:52 +01:00
reger
764f5100f0 fix delete of temp file after odt % ooxml parser
Close zipfile after parsing
2016-03-04 23:05:55 +01:00
reger
379e9b330d use supplied url port to get robots.txt in crawlers hostqueue 2016-03-02 00:12:34 +01:00
reger
ed765de29b adjust start/stop classpath in build script
(with servlet classloader no need for htroot in system classpath)
2016-02-29 00:04:36 +01:00
reger
9a7efa7814 harmonize classpath with startYaCy.bat
(with servlet classloader no need for htroot in system classpath)
2016-02-28 22:53:41 +01:00
reger
0dcda3809e harmonize classpath with startYaCy.bat 2016-02-28 22:10:43 +01:00
reger
58a959403d fix mixed logfactory in UrlProxyServlet,
Class doesn't use functions of declared ancestor, change to extend on httpservlet
2016-02-27 03:44:43 +01:00
reger
dc112d0e32 upd to slf4j-1.7.16 2016-02-26 00:50:26 +01:00
Michael Peter Christen
2494a820c7 0N - added recording of dump exports if given time frame is not negative 2016-02-24 15:13:20 +01:00
Michael Peter Christen
ef2cc4f690 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2016-02-24 11:19:32 +01:00
reger
7b02cacb12 upd to Jetty 9.2.15.v20160210 2016-02-24 02:32:12 +01:00
Michael Peter Christen
a6bf0b1649 0N - added option to generate index export files for a specific number
of minutes in the past and reverted latest change. The export file dump
will now contain four data elements: f - first date of index entry write
date, l - last date of index write date, n - now-date of index dump
time, c - count of numbers inside the dump. '0N' denotes a series of
changes which will lead to the opportunity to exchange index data dumps
in a way that is needed to integrate ZeroNet index data. This will be
based on index dump sharing; that causes this commit.
2016-02-23 18:56:20 +01:00
reger
9312fbe563 making WebStructurePicture_p less vulnerable to faulty host input parameter (like host1,,host3)
by continue host loop on exception

inspired by http://mantis.tokeek.de/view.php?id=637
2016-02-21 21:38:11 +01:00
reger
6d56beaed8 fix assertion exception in toString of MultiProtocolURL
toString of AnchorURL and MultiProtocolURL are identical code
(no need to override or to protect call to parent)

as reported in https://github.com/yacy/yacy_search_server/issues/43
2016-02-21 00:23:00 +01:00
reger
b12b8fb1c2 include initial japaneese translation to language selection 2016-02-20 23:17:59 +01:00
Burkhard
6a3d27ca5b Merge pull request #44 from ImpactCrater/master
Created a translation file ja.lng
2016-02-20 22:43:41 +01:00
reger
42a7bdb2af fix SolrSelectServlet authentication to default to true 2016-02-20 22:30:15 +01:00
ImpactCrater
567c292302 Created a translation file ja.lng
I wrote a bit of translation to Japanese.
2016-02-21 03:55:33 +09:00
Michael Peter Christen
5b9030180c added peer hash to export dump name. 2016-02-19 19:26:02 +01:00
Michael Peter Christen
287b918bd7 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2016-02-19 07:52:59 +01:00
reger
20e3c25ae3 upd to weupnp-0.1.4.jar 2016-02-18 01:09:29 +01:00
reger
dbb28bb4f3 del unused statistic parameter (from status servlet) 2016-02-17 22:47:03 +01:00
Michael Peter Christen
b851308ee6 enhanced robustnes of image computation 2016-02-16 17:36:49 +01:00
reger
06d0e2aeb9 result heuristic (also used in greedy learning mode) to use outbound links if result is full index doc. Otherwise use default loader methode.
- Above brought up that parser start url parameter, declared as AnchorURL uses only methodes of parent object DigestURL (changed parameter declaration accordingly).
2016-02-16 02:05:58 +01:00