Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
13,752 Commits 1 Branch 20 Tags 836 MiB
b5eabb626f
Commit Graph

524 Commits

Author SHA1 Message Date
reger
84c970eaec move test classes to test/java (subdirectory as in Maven standard subdir layout) 
because ViewImage*Test.java breaks test run
 2016-01-16 19:22:27 +01:00
sixcooler
5a35f9383a bump to solr/lucene 5.4.0 2016-01-02 21:07:50 +01:00
sixcooler
dce1cb65c4 Merge remote-tracking branch 'choose_remote_name/master' 2015-12-28 23:20:42 +01:00
Michael Peter Christen
7274e50d7f Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-12-26 22:25:15 +01:00
Michael Peter Christen
5a39f9f679 stub to use a new app launcher for mac 2015-12-26 22:25:08 +01:00
reger
7f6ee76eb9 upd to ImageIO 3.2.1 2015-12-25 00:53:16 +01:00
luc
8827b86b2a Added useful debug JVM parameters as comment. 2015-12-16 02:09:33 +01:00
Michael Peter Christen
d6e9834040 Merge branch 'master' of 
https://github.com/Scarfmonster/yacy_search_server

# Conflicts:
#	.classpath
#	build.xml
 2015-11-30 16:54:54 +01:00
Michael Peter Christen
d82d311995 Merge branch 'master' of https://github.com/luccioman/yacy_search_server 
# Conflicts:
#	.classpath
 2015-11-30 13:34:10 +01:00
reger
f05b34fc35 upd to slf4j-1.7.13 2015-11-29 01:24:46 +01:00
luc
4c36b7bd14 Merge branch 'master' of https://github.com/yacy/yacy_search_server 
Conflicts:
	.classpath
 2015-11-26 09:28:34 +01:00
reger
d79fa7fbeb upd to Jetty v9.2.14.v20151106 2015-11-24 21:35:58 +01:00
luc
f0478bb14d BMP and ICO image formats support : integrated /haraldk/TwelveMonkeys 
imageio-bmp-3.2 library.

 - better BMP format flavours support
 - handle PNG encoded icons
 - handle transparency
 
Added some javadoc url references to .classpath
 2015-11-20 09:38:16 +01:00
reger
5362a80f1c upd to httpcore 4.4.4 2015-11-14 21:16:31 +01:00
reger
e90593450c upd to TwelveMonkeys ImageIO 3.2 2015-11-14 01:46:25 +01:00
reger
c4fa6d7bf5 upd to icu4j-56_1 2015-10-19 01:06:51 +02:00
reger
5445f38070 upd to jetty 9.2.13.v20150730 2015-10-19 00:53:10 +02:00
reger
6ca02ad577 upd httpclient-4.5.1, httpmime-4.5.1, httpcore-4.4.3, commons-compress-1.10 2015-10-18 19:53:39 +02:00
luc
d6522fa4a2 Integrated haraldk/TwelveMonkeys library to first add TIF image format 
support.
 2015-10-15 10:06:51 +02:00
reger
43c27aa550 upd to solr/lucene 5.3.1 2015-10-03 23:20:33 +02:00
reger
fd5a1dc297 upd to poi-3.13 2015-10-03 21:43:41 +02:00
reger
c7c5e2dff9 fix old/obsolete solr dependency to stax 
delete obsolete jar
 2015-09-27 00:17:42 +02:00
reger
0f80bc8309 upd to jsoup-1.8.3 2015-08-19 22:46:48 +02:00
reger
92e5b217b6 upd to pdfbox-1.8.10 2015-08-01 00:25:40 +02:00
reger
165561706d upd to Solr-5.2.1 2015-07-30 00:16:09 +02:00
reger
7f49dbfbd1 upd to SLF4J-1.7.12 2015-07-27 00:57:19 +02:00
reger
807e3dc78a upd to httpclient-4.5 and httpmime-4.5 2015-07-26 00:53:40 +02:00
reger
202620b4a2 upd to icu4j-55.1.jar 2015-07-25 00:50:41 +02:00
reger
149e41f25b upd to jsch-0.1.53.jar 2015-07-21 22:31:34 +02:00
reger
30135d8964 upd to lib/weupnp-0.1.3.jar 2015-07-20 03:45:23 +02:00
Ryszard Goń
59096935d0 Use language-detection library for increased accuracy 2015-07-02 18:41:13 +02:00
Michael Peter Christen
694b22f165 migration to Solr 5.2: huge benefits - this is a lot faster! 
This is a very complex migration: many classes had been renamed or
removed, dependencies changed and the solr index type is now aligned to
be a solr cloud repository.
Together with the Solr 5.2 library update, one other dependent library
had been updated as well: httpclient 4.4->4.4.1

Older indexes are migrated from 4_10 to 5_2. However, the new index
structure is more efficient and we recommend to re-index everything.
Please use the index export before you do the update to a large
surrogate xml file. After the update, start with an empty index and then
initialize this with your dump.
 2015-06-24 01:55:51 +02:00
sixcooler
480e4a6a5c Update to Jetty-9.2.11 - a bugfix-release that did not solve my 
Problems, but does not harm anything
 2015-06-07 20:09:27 +02:00
reger
5183ad718d upd to poi-3.12.jar 2015-06-05 03:36:57 +02:00
reger
31346e873b upd library reference of missing jsch-0.1.21 in seeduploadscp.xml 
upd to jsch-0.1.52.jar
 2015-05-11 01:35:12 +02:00
reger
a6daddbeaa upd to commons-io-2.4.jar 2015-05-10 03:00:05 +02:00
reger
4d73e9de06 upd to metadata-extractor-2.8.1 2015-04-30 00:01:11 +02:00
reger
0904a041a6 upd to poi-3.11.jar 2015-04-29 01:53:04 +02:00
reger
b161473cd0 upd to jsoup-1.8.2 2015-04-26 17:41:05 +02:00
reger
642daad528 upd to httpcore 4.4.1 2015-04-08 22:42:30 +02:00
reger
01759e9af9 upd to PDFBox 1.8.9 2015-04-05 23:38:14 +02:00
reger
7cf28c4f94 upd to Jetty 9.2.10 2015-03-22 02:47:12 +01:00
Michael Peter Christen
c3aadcf899 Fix for Jetty "JetLeak" bug: update to jetty 9.2.9 
The bug was inside the jetty library, for details see:
http://blog.gdssecurity.com/labs/2015/2/25/jetleak-vulnerability-remote-leakage-of-shared-buffers-in-je.html
We recommend to update your YaCy peer with this bugfix.
 2015-02-28 15:46:46 +01:00
reger
49281617d2 upd to commons-codec-1.10.jar, commons-compress-1.9.jar 2015-02-14 23:04:05 +01:00
Michael Peter Christen
f989f955dc fixed httpclient lib paths in ant build 2015-02-14 01:38:20 +01:00
reger
8fa542a8e1 upd to Jetty 9.2.7 2015-02-07 00:44:09 +01:00
Michael Peter Christen
287c528f46 replaced old JavaApplicationStub for Mac Application framework with new 
script. Adopted the YaCyApp environment and fixed a problem in the
startYACY.sh application wrapper which caused wrong usage of logging
option -l which caused that files had been written to the YaCy
application folder.
As a result of this fix, it is not necessary any more to change path
settings in Info.plist if libraries are changed.
 2015-01-23 11:30:13 +01:00
sixcooler
5594c43d2e bump to Solr-/Lucene-4.10.3 2015-01-04 18:47:47 +01:00
reger
17808898c6 update to SLF4J 1.7.9 2014-12-23 19:11:21 +01:00
reger
5332c9df21 update to commons-fileupload-1.3.1.jar 
(includes a security fix)
 2014-12-22 20:34:13 +01:00
reger
fe5d4e6c7b update to Jetty 9.2.6 2014-12-19 21:54:17 +01:00
reger
eca578a5fa update to PDFBox 1.8.8 2014-12-19 02:54:38 +01:00
reger
0f7d4c42e9 include xmpcore.jar in classpath 
used by metadata-extractor
 2014-12-16 21:12:37 +01:00
reger
9edc7308aa update to metadata-extractor-2.7.0.jar 
add 2 simple JUnit test cases for jpeg and tif parsing
 2014-12-15 20:45:05 +01:00
Michael Peter Christen
413eeefed4 added character set detection library from 
http://www-archive.mozilla.org/projects/intl/chardet.html
 2014-12-10 13:08:29 +01:00
reger
8055ed5b2a update to commons-logging-1.2 2014-12-06 22:32:24 +01:00
reger
aa7122f079 update to guava.18.0.jar and jsch.0.1.51.jar 2014-11-30 19:43:53 +01:00
reger
4c14a8b44d update to poi-3.10.1.jar 2014-11-29 22:36:02 +01:00
reger
ef5c5b4489 update to Jetty 9.2.4 2014-11-28 20:24:39 +01:00
sixcooler
bad5dd7836 update to httpclient-4.3.6 2014-11-09 23:06:36 +01:00
sixcooler
725b206fb4 update to solr-/lucene-4.10.2 2014-11-07 18:51:31 +01:00
sixcooler
4a35570c90 bump to httpcore-4.3.3 2014-10-24 12:32:44 +02:00
reger
0773c73a19 upd to jsoup-1.8.1.jar 2014-10-03 20:54:45 +02:00
reger
cd0a16cf2e update to PDFBox 1.8.7 2014-09-28 03:18:18 +02:00
reger
0ecbf32134 update to Jetty 9.2.3 2014-09-27 23:27:05 +02:00
sixcooler
aa3e5f2046 bump to httpclient-4.3.5 2014-08-19 14:51:07 +02:00
reger
516c8c02b1 update to commons-compress-1.8.1 
(bugfix release)
 2014-08-18 00:04:55 +02:00
reger
8d1b764458 update to Jetty 9.2.2 2014-08-17 00:59:16 +02:00
Marc Nause
3dcfc717eb This hopefully fixes http://mantis.tokeek.de/view.php?id=424 2014-07-29 22:02:11 +02:00
Marc Nause
477be17c51 Replaced old UPNP library with Weupnp. UPNP should 
work now, at least it does on my network. UPNP code in YaCy can still
be improved though (see TODO comment: make port on gateway configurable
or find free one).

*) removed old code
*) added new lib
*) changed code to work with new lib
 2014-07-29 21:26:27 +02:00
reger
b4b937a046 update to pdfbox 1.8.6 2014-07-25 23:55:10 +02:00
reger
e94efd4d7c update to JUnit 4.11 
- fix build.xml -> parserTest error on Windows due to javac encoding
 2014-07-06 05:38:32 +02:00
Michael Peter Christen
09dcdb9b19 update to solr 4.9.0 2014-07-01 16:39:00 +02:00
Michael Peter Christen
282b53db42 update of commons-io and slf4j-api (as preparation for Solr 4.9.0) 2014-07-01 16:18:12 +02:00
sixcooler
66c784c552 bump to httpclient-4.3.4 2014-06-22 16:24:45 +02:00
reger
b9f6acee23 update to Jetty 9.2.1 2014-06-22 00:21:47 +02:00
Michael Peter Christen
b803622ac3 changed javadoc publishing path from 'api' to 'javadoc' because there 
are also other APIs in in YaCy.
 2014-06-01 22:25:55 +02:00
orbiter
ee7416816b upgraded poi library (office document format parser) from 3.9 to 3.10 2014-05-22 15:53:07 +02:00
orbiter
a12701ddf6 upgraded bouncy caste libraries (needed for encrypted pdfs, dependency 
in pdfbox) to 1.46
removed the activation.jar library; I don't know which other library
depends on it.
 2014-05-22 12:09:21 +02:00
Michael Peter Christen
2520590b45 migrated from pdfbox 1.8.4 to 1.8.5. They have a very long bugfix list 
for that update:
http://www.apache.org/dist/pdfbox/1.8.5/RELEASE-NOTES.txt
 2014-05-21 22:48:41 +02:00
Michael Peter Christen
d4157184ec migration to Solr 4.8.1 
This includes also an update to zookeeper 3.4.6 and a new library that
Solr initializes by default: org.restlet from
http://restlet.com/download/current#release=stable&edition=jse&distribution=zip
which is included in version 2.2.1 from may 6th 2014
 2014-05-21 11:48:08 +02:00
reger
e9060d31bd update to Jetty 9 
besides adjustments in code it makes the servlet settings in web.xml significant.
This applies to solr, gsa and proxy servlet. There is no longer a default setup in code during init (as jetty 9 checks for double definition).
 2014-05-11 01:53:11 +02:00
Michael Peter Christen
ebd44a7080 replaced solr 4.6.1 with solr 4.7.1 and added index migration to 
lucene_47
 2014-04-06 10:45:03 +02:00
reger
1a6e0354db update commons-compress.jar to 1.8 2014-04-06 03:59:11 +02:00
sixcooler
9afd7db043 bump to httpclient-4.3.3 2014-02-27 18:33:45 +01:00
Michael Peter Christen
7eab0a2cb8 replaced guava-15.0 with guava-16.0.1 2014-02-10 11:55:40 +01:00
Michael Peter Christen
cb4fd27bbe replaced pdfbox 1.8.3 with 1.8.4 2014-02-10 11:49:48 +01:00
Michael Peter Christen
4fcddcf13b replaced solr 4.6.0. with 4.6.1 2014-02-10 11:42:11 +01:00
Michael Peter Christen
9f921c27f3 removed libraries which had been used by jena and were added together 
with jena in commit 5d20cd324a, see:
5d20cd324a
 2014-02-07 01:38:58 +01:00
Michael Peter Christen
6e59ca4ebf removed jena library and all code that depended on jena. When jena was 
introduced, it was also used for search facets. The generic search
facets are now deduced from generic solr fields which makes jena as tool
for facet semantics superfluous.
 2014-02-07 01:20:06 +01:00
sixcooler
0512e46c6a bump to httpclient-4.3.2 2014-01-22 01:31:22 +01:00
Michael Peter Christen
84cf7e8e9f backmigration from solrj 4.6.0 to 4.5.1. This is necessary because 
solrj.4.6.0 has a bug which prevents the attachment of a remote solr (as
tested with a SolrCloud). See bug report
https://issues.apache.org/jira/browse/SOLR-5532
This bug shall be fixed in Solr 4.6.1.
Fortunately, solrj-4.5.1 works together with solr-4.6.0 thus the current
index does not need to be changed.
 2014-01-15 17:18:32 +01:00
reger
37f2a82a5d making root context (htroot) a WebAppContext 
- this allows additional features, like servlet configuration via web.xml and many more things.
- currently the standard servlets are still configured in the code (so the supplied defaults/web.xml is not realy needed, yet),
  but could be expanded
- lookup for web.xml - 1. in /DATA/SETTINGS then in /defaults
 2014-01-10 10:42:47 +01:00
reger
1b6d173b14 update to Jetty 8.1.14 2014-01-06 08:48:43 +01:00
reger
e03c9306e8 include install/uninstallYaCyWindowsService.bat 
as wrappers to copy
 2013-12-29 23:16:20 +01:00
reger
2507722fbb updated poi-3.9 / poi-scratchpad-3.9 2013-12-25 22:31:41 +01:00
Michael Peter Christen
122d026910 alphabetic order fix 2013-12-23 10:47:11 +01:00
Michael Peter Christen
7603e879dc Merge branch 'master' into HEAD 
Conflicts:
	.classpath
	source/net/yacy/cora/federate/solr/SolrServlet.java
 2013-12-20 01:19:06 +01:00
Michael Peter Christen
8b97489ff2 updated guava to 15.0 2013-12-19 22:21:33 +01:00
Michael Peter Christen
34b4eda4a8 upgraded json-simple to 1.1.1 2013-12-19 22:16:01 +01:00
Michael Peter Christen
75ae36da9c upgraded jsch to 0.1.50 2013-12-19 22:13:34 +01:00
Michael Peter Christen
db793a2a5e removed mysql connector which was used only for testing in the past 2013-12-19 22:09:01 +01:00
Michael Peter Christen
7ebc74b76a migrated to pdfbox 1.8.3 2013-12-19 22:06:10 +01:00
Michael Peter Christen
2f16770681 migrated to solr 4.6.0 2013-12-19 21:51:05 +01:00
reger
06da6f517c add YaCyProxyServlet to handle /proxy.html?url=proxyurl 
- based on Jetty ProxyServlet
- at this time use existing HTTPD ProxyHandler  for url rewrite
- add jetty-client jar (dependency in Jetty ProxyServlet)

reuse ProxyHandler.convertHeaderFromJetty in YaCyDefaultServlet
 2013-10-27 05:04:24 +01:00
reger
1adb4b8741 merge rc1/master 2013-10-16 03:02:21 +02:00
sixcooler
dfb73c9519 bump to httpclient-4.3.1 - a bugfix release 2013-10-14 23:32:24 +02:00
reger
cf32a92629 - add size check to multipart form data handling of YaCyDefaultServlet (same as in HTTPDemon.parseMultipart) 
- reduce Jetty logging 
- give build.run a bit more memory (set to YaCy.default 600m from 512m)
 2013-10-13 20:56:03 +02:00
reger
a44eede8b8 merge rc1/master 2013-10-11 01:50:25 +02:00
reger
71d2655c02 downgrade to Jetty 8 to assure support of JRE 1.6 
- introduce a YaCyHttp interface to modulize/separate http server
- adjust the Jetty version specific implementation part (in package net.yacy.http)
     - putting the version specific code in classes starting with Jetty8xxxx
     - moved existing Jetty9xxx implementation into a test class (to keep the code)
- adjust build to the changed jars
- make use of the introduced YaCyHttpServer interface in related htroot servlets

- adjust other test cases/classes
 2013-10-09 00:40:48 +02:00
Michael Peter Christen
21aa6a0321 migration to Solr 4.5.0 2013-10-07 17:09:40 +02:00
reger
f46771bdf5 upd build script from rc1/master 2013-09-30 03:47:55 +02:00
sixcooler
15b1bb2513 bump to httpClient-4.3 2013-09-25 14:48:37 +02:00
reger
f7f86d8a5d update to Jetty 9 jars 
- include javax.servlet 3.0
 2013-09-14 20:49:05 +02:00
reger
aafef72a8a merged current rc1/master into jetty branch to allow further development with latest version 
ServerSideIncludes and servlet return values need further work (for working jetty integration)
- TODO: added nasty quickfix to allow SSI -  needs further work
- TODO: YaCy servlet return values/parameters are not handled
 2013-09-09 02:36:06 +02:00
sixcooler
5189620026 add branch to packet-name if not build from master 2013-08-06 03:48:29 +02:00
Michael Peter Christen
5b7c0d0745 update to pdfbox 1.8.2 2013-07-30 14:14:16 +02:00
Michael Peter Christen
f13df9dbb6 migration to solr 4.4.0 2013-07-30 14:01:16 +02:00
reger
3760e2616b bump up lib/metadata-extractor-2.6.2.jar (used for image parser) with needed code adjustments 2013-06-25 23:24:02 +02:00
Michael Peter Christen
5f92c68f1f removed block rank ranking and all YBR files in /ranking 2013-05-30 13:01:22 +02:00
Michael Peter Christen
9bd2aee180 migrated to solr 4.3.0 2013-05-09 02:17:53 +02:00
Michael Peter Christen
ad050ec88d - upgraded httpclient, httpcore and httpmime 
- removed httpclient 3.1 which has been used by solrj < 4.x.x and is now
not used any more
- fixed some parts in YaCy which used methods from httpclient 3.1
 2013-05-09 00:22:45 +02:00
orbiter
48e9a54e80 updated pdf parser 2013-05-08 15:17:06 +02:00
Michael Peter Christen
27907c9739 added missing library after solr upgrade 2013-04-07 10:36:05 +02:00
Michael Peter Christen
cf0acd2cb4 upgrade to solr 4.2.1 2013-04-06 16:11:24 +02:00
Michael Peter Christen
461d46101d - Removed log4j from libraries. This can be removed because the package 
log4j-over-slf4j is there. From slf4j all loggings are routed to the jdk
logger. Now all loggings are consistently done to the jdk logger.
- added some lines to the logging properties to suppress many solr
logging statements. The number of the logging entries had already become
a performance issue, therefore removing these from the log should
increase performance.
 2013-02-23 16:45:05 +01:00
orbiter
36f9b0fc16 updated wstx-asl to 3.2.9 2013-02-23 14:33:17 +01:00
reger
1951ba61ae remove CPGEN from Windows batch files 
(classpath for all needed libraries is defined in manifest  of yacycore.jar)
 2013-02-17 03:26:46 +01:00
Michael Peter Christen
09a2b09c48 guava update 2013-02-04 11:21:05 +01:00
Michael Peter Christen
80fe3d7860 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 
Conflicts:
	source/net/yacy/cora/federate/solr/connector/EmbeddedSolrConnector.java
 2013-02-04 10:57:54 +01:00
Michael Peter Christen
4323621a76 update to Solr 4.1.0 2013-02-04 10:55:49 +01:00
reger
160ce568b3 move testing SolrServlet.main to test, making include of jetty*.jar in distribution and classpath obsolete 
- move jetty*.jar to test library 
- move SolrServlet.main as is to test, add also a junit test simulating main 
  - add build.xml cleanup for EmbeddedSolrConnectorTest created test/DATA
- adjust some test compile errors
 2013-02-03 22:32:38 +01:00
reger
be5d3a1066 adding classpath to Manfiest of yacycore.jar 
- this allows to start w/o giving explicite java -cp (just java -jar lib/yacycore.jar works)
- especially helpful while running YaCy as Win service, 
  making it obsolete to adjust classpath cfg of the service wrapper on upgrades of lib/*.jar's
 2013-01-29 03:01:57 +01:00
sixcooler
f3e705c4fe bump to httpclient / httpcore 4.2.3 (bugfix-release) 2013-01-17 20:10:49 +01:00
Michael Peter Christen
9dfc9c95d8 updated slf4j and log4j 2012-12-27 04:37:21 +01:00
Michael Peter Christen
95712fdc8b update to pdf parser 2012-12-27 04:16:31 +01:00
Michael Peter Christen
e2c4c3c7d3 migration to solr 4.0.0 2012-11-02 12:29:48 +01:00
Michael Peter Christen
69aa39d664 update to libraries required by solr 4.0.0 2012-11-02 10:27:44 +01:00
sixcooler
9d062873d2 bump to httpclient-4.2.2 2012-10-31 19:09:48 +01:00
sof
5cb244b79b Merge remote branch 'origin/master' 2012-10-05 18:54:39 +02:00
apfelmaennchen
88b062210c Added a parser for audio file tags (e.g. ID3 tags for MP3 files) based 
on the jaudiotagger library. The parser is disabled by default as it
needs to store temporary files for non file:// protocols, which might be
disliked. For your local MP3-collection it loads nicely Artist,
Title, Album etc. from the audio files meta data.
 2012-10-05 18:54:26 +02:00
sixcooler
9aa21506be bump to httpcore-4.2.2 (maintenance release) 2012-10-03 02:15:02 +02:00
Michael Peter Christen
d0015df61c added lucene memory library which is now necessary as solr has to 
process more complex queries
 2012-09-28 13:48:51 +02:00
Michael Peter Christen
80edd8ecd7 some more after-refactoring fixes 2012-09-28 10:24:57 +02:00
Michael Peter Christen
bc865ab816 more cleaning (yacy-cora) 2012-09-25 12:19:24 +02:00
Michael Peter Christen
e65cecc419 - updated lucene libraries to 3.6.1 
- added lucene-grouping which enables faceted search; try this:
http://localhost:8090/solr/select?q=*:*&start=0&rows=3&facet=true&facet.field=host_s
 2012-09-10 10:12:38 +02:00
Michael Peter Christen
2ccf1dba71 upgrade to solr 3.6.1 2012-08-17 15:11:21 +02:00
cominch
e74d66e28c augmented browsing: remove htmlparser library 2012-08-14 10:09:46 +02:00
cominch
e2119f4e76 augmented browsing: replace htmlparser by jsoup, which is more stable 
and reliable
 2012-08-14 10:06:12 +02:00
sixcooler
a99ef68422 bump to httpclient-4.2.1 2012-07-09 18:58:33 +02:00