Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
9,786 Commits 1 Branch 20 Tags 836 MiB
a67a4b7d86
Commit Graph

9786 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
reger
a67a4b7d86 improve tld: query modifier filter pattern (to prevent tld:net accepting www.abcinet.org) 2013-08-12 21:20:23 +02:00
reger
02fe8b43ba Field Re-Indexing: display list of fields in reindex queue 
change servlet to display statistic on 1st click (instead after refresh)
 2013-08-11 04:51:29 +02:00
sixcooler
7f501b7c38 clear some caches before reporting low Memory 
do not break lines in Network-table-rows
 2013-08-08 14:38:26 +02:00
reger
b355dd52c6 Index Administration - Field Re-Indexing: exclude internal Solr _version_ field from obsolete field check 2013-08-08 00:55:21 +02:00
sixcooler
1bc6003057 rise autoCommit maxTime to 3 Minutes to reduce IO 
lower mergeFactor again (5) for less segments
 2013-08-06 03:58:53 +02:00
sixcooler
5189620026 add branch to packet-name if not build from master 2013-08-06 03:48:29 +02:00
reger
070bf85b33 css fix for IE10 showing border on all img within <a /> tag since introduction of external link icon (commit 112836dcc9) 2013-08-04 05:37:20 +02:00
sixcooler
8a96140f92 fix / workaround for 
http://forum.yacy-websuche.de/viewtopic.php?f=5&t=4750
+ Seed.hash should be final
 2013-08-01 16:40:58 +02:00
Michael Peter Christen
c0ff91b9a8 bugfix release 1.62 2013-08-01 12:36:59 +02:00
Michael Peter Christen
2674d28ef4 protection against self-ping (may be cause by fraud attempts) 2013-08-01 12:35:44 +02:00
orbiter
944ae5686c added donation plea to the about box as default (you can replace this in 
your peer!)
 2013-08-01 12:11:56 +02:00
orbiter
f3d001c7ab more space in the about section 2013-08-01 11:49:07 +02:00
Michael Peter Christen
e879b97b0a added line to enhance debugging 2013-07-31 13:33:05 +02:00
Michael Peter Christen
2857499467 fix to collection schema; bug appeared for _txt fields with empty String 
as content
 2013-07-31 13:32:05 +02:00
Michael Peter Christen
dbfa865700 added a stub of a class for crawler redesign 2013-07-31 13:16:32 +02:00
Michael Peter Christen
76afcccaaf fix for default boolean post values: the default value MUST NOT be TRUE, 
because it's normal that a boolean value is missing in the post argument
if a checkbox is not selected.
Added also some style enhancements to IndexFederated, removed the Solr
attachment manual and replaced it with a link to the wiki which explains
this in more detail.
 2013-07-31 10:49:26 +02:00
orbiter
252c525709 fixed feed api servlet and and enhanced RSSReader class 2013-07-31 06:18:30 +02:00
orbiter
d38c3c14d8 fix for CGI test 2013-07-31 05:43:58 +02:00
Marc Nause
112836dcc9 Improved external links. 
*) image links will not be marked (if they have class "yacylogo" or
"forceNoExternalIcon")
*) external links in menu on left (and "fork me"-banner) will open in
new tab/window now
 2013-07-30 21:40:37 +02:00
Marc Nause
d64a094f0e External links in HTML interface are marked as external with small icon. 
*) added new icon
*) added CSS rules to mark all external links except search results
(target="_self")
 2013-07-30 20:46:51 +02:00
Michael Peter Christen
31902f54df fix for NPE which happens within solr code at MultiMapSolrParams.java, 
line 52 in case that the array arr.length == 0
 2013-07-30 14:32:59 +02:00
Michael Peter Christen
5b7c0d0745 update to pdfbox 1.8.2 2013-07-30 14:14:16 +02:00
Michael Peter Christen
f13df9dbb6 migration to solr 4.4.0 2013-07-30 14:01:16 +02:00
Michael Peter Christen
dc1002e511 cleaned sourcepaths from eclipse classpath 2013-07-30 13:05:32 +02:00
Michael Peter Christen
1b09362949 next development cycle 2013-07-30 12:51:00 +02:00
Michael Peter Christen
58fe986cca Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2013-07-30 12:49:14 +02:00
Michael Peter Christen
cf12835f20 replaced the single-text description solr field with a multi-value 
description_txt text field
 2013-07-30 12:48:57 +02:00
sixcooler
7d53ac86a3 fix for Blacklist (-Administration) 2013-07-29 19:09:28 +02:00
reger
f2d99053ed Field Re-Indexing: prevent endless error loop in ReindexSolrBusyThread on Solr exception (by skipping query causing the exception) 
(occured during testing while working on q=store:[* TO *])
 2013-07-29 01:32:02 +02:00
reger
92d3f71b16 htmlParser: closes input stream -> changed it to leave it open for a reset (used by AugmentParser - even if this is practically not used), 
note: stream.close is done by caller (Textparser.parseSource)
- removed unnecessary reset in AugmentParser
- added stream.mark in tdfatripleimpl. to make stream.reset work here
 2013-07-28 03:41:09 +02:00
orbiter
f117ea0492 reverted start script options - yacy on windows did not start with the 
given values
 2013-07-27 15:36:46 +02:00
orbiter
87cfeaa4f3 fix for npe 2013-07-27 15:20:09 +02:00
orbiter
268a36aaff emergency fix for crawler: this will otherwise cause loss of complete 
crawl queue if latency of remote system is too low
 2013-07-27 11:59:07 +02:00
orbiter
743e4878a8 Release 1.6 2013-07-27 11:26:14 +02:00
orbiter
e7fcb81cea we should not do too much greedylearning at this time as we don't have 
enough experience with it. set greedylearning.limit.doccount to a much
lower limit.
 2013-07-27 11:22:40 +02:00
orbiter
d05e0c5368 wait a bit longer before doing the first peer ping 2013-07-27 11:00:35 +02:00
orbiter
f425b2c61c re-try to fetch url after a soft commit 2013-07-27 10:56:02 +02:00
orbiter
b8f57f7703 don't be noisy when doing background tasks that may be allowed to fail 2013-07-27 10:51:58 +02:00
orbiter
bf0ad04e1b apply load limitation also to dht-in 2013-07-27 10:42:38 +02:00
Roland Haeder
0343f0668c Fix for NPE: 
E 2013/07/26 20:29:29 BUSYTHREAD Runtime Error in
serverInstantThread.job, thread
'net.yacy.search.Switchboard.cleanupJob': null; target exception: null
java.lang.NullPointerException
        at
net.yacy.search.schema.CollectionConfiguration.convergenceStep(CollectionConfiguration.java:1116)
        at
net.yacy.search.schema.CollectionConfiguration.postprocessing(CollectionConfiguration.java:897)
        at net.yacy.search.Switchboard.cleanupJob(Switchboard.java:2296)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at
net.yacy.kelondro.workflow.InstantBusyThread.job(InstantBusyThread.java:107)
        at
net.yacy.kelondro.workflow.AbstractBusyThread.run(AbstractBusyThread.java:165)

Conflicts:
	source/net/yacy/search/schema/CollectionConfiguration.java
 2013-07-27 10:19:46 +02:00
Roland Haeder
b58ca8622d Some cleanups: 
- added SKINS_PATH_DEFAULT as same as LISTS_PATH_DEFAULT was added
- Added 'final' keyword to a string
 2013-07-27 10:13:57 +02:00
Roland Haeder
e2ee412160 Use SwitchboardConstants.LISTS_PATH_DEFAULT instead of 'DATA/LISTS' 
Conflicts:
	htroot/api/blacklists_p.java
 2013-07-27 10:12:58 +02:00
Roland Haeder
ae19401af0 Removed another duplicate occurance of Blacklist.BLACKLIST_FILENAME_FILTER 2013-07-27 09:59:09 +02:00
Roland Haeder
59225487ea Fix for blacklist export, also applied the filename filter here 2013-07-27 09:58:56 +02:00
Roland Haeder
952fc0e7bd Removed superfluous check for files ending '.black' as the previous commit already excluded all other files (e.g. .ser dumps), added logging in catch-all block 2013-07-27 09:58:38 +02:00
Roland Haeder
060fec1577 Reuse Blacklist.BLACKLIST_FILENAME_FILTER 2013-07-27 09:57:50 +02:00
Roland Haeder
29049c71f5 Possible fix for ticket http://bugs.yacy.net/view.php?id=270, the filter for only including *.black must be applied 2013-07-27 09:57:07 +02:00
Roland Haeder
7263bb82fb Fix for NPE on shutdown: 
java.lang.NullPointerException
        at net.yacy.search.Switchboard.storeDocumentIndex(Switchboard.java:2732)
        at net.yacy.search.Switchboard.access00(Switchboard.java:207)
        at net.yacy.search.Switchboard.run(Switchboard.java:3049)
 2013-07-27 09:55:43 +02:00
Roland Haeder
13433d41a1 Log this exception better 
Conflicts:
	source/net/yacy/kelondro/blob/Tables.java
 2013-07-27 09:54:51 +02:00
orbiter
080d80c9de do not write an empty failreason in case that there is no fail. Because 
of the lazy instantiation rule this value was not actually written, but
if lazy instantiation is switched on, then this causes that all crawl
starts delete all crawl-start-hosts completely because this looks for
filled error reasons.
 2013-07-26 17:53:28 +02:00