Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
14764632b5
yacy_search_server/source/net/yacy
History
orbiter 14764632b5 clear solr caches in case that an exception occurrs. The reason behind 
this hack is the occurrence of Exceptions like:
W 2014/02/11 18:51:33 ConcurrentLog GC overhead limit exceeded
java.io.IOException: GC overhead limit exceeded
        at
net.yacy.cora.federate.solr.connector.AbstractSolrConnector.getDocumentById(AbstractSolrConnector.java:334)
        at
net.yacy.cora.federate.solr.connector.MirrorSolrConnector.getDocumentById(MirrorSolrConnector.java:173)
        at
net.yacy.cora.federate.solr.connector.ConcurrentUpdateSolrConnector.getDocumentById(ConcurrentUpdateSolrConnector.java:415)
        at net.yacy.search.index.Fulltext.getMetadata(Fulltext.java:331)
        at net.yacy.search.index.Fulltext.getMetadata(Fulltext.java:317)
        at
net.yacy.search.query.SearchEvent.pullOneRWI(SearchEvent.java:1024)
        at
net.yacy.search.query.SearchEvent.pullOneFilteredFromRWI(SearchEvent.java:1047)
        at
net.yacy.search.query.SearchEvent$3.run(SearchEvent.java:1263)
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
        at java.util.Arrays.copyOfRange(Arrays.java:3077)
        at java.lang.StringCoding.decode(StringCoding.java:196)
        at java.lang.String.<init>(String.java:491)
        at java.lang.String.<init>(String.java:547)
        at
org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.readField(CompressingStoredFieldsReader.java:187)
        at
org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.visitDocument(CompressingStoredFieldsReader.java:351)
        at
org.apache.lucene.index.SegmentReader.document(SegmentReader.java:276)
        at
org.apache.lucene.index.BaseCompositeReader.document(BaseCompositeReader.java:110)
        at
org.apache.lucene.index.IndexReader.document(IndexReader.java:436)
        at
org.apache.solr.search.SolrIndexSearcher.doc(SolrIndexSearcher.java:657)
        at
net.yacy.cora.federate.solr.connector.EmbeddedSolrConnector.SolrQueryResponse2SolrDocumentList(EmbeddedSolrConnector.java:230)
        at
net.yacy.cora.federate.solr.connector.EmbeddedSolrConnector.getDocumentListByParams(EmbeddedSolrConnector.java:320)
        at
net.yacy.cora.federate.solr.connector.AbstractSolrConnector.getDocumentById(AbstractSolrConnector.java:330)
        ... 7 more
        
This problem was analysed with the Eclipse Memory Analyser after a heap
dump, where the following problem was reported as the main Problem
Suspect:

One instance of "org.apache.solr.util.ConcurrentLRUCache" loaded by
"sun.misc.Launcher$AppClassLoader @ 0x42e940a0" occupies 902.898.256
(61,80%) bytes. The memory is accumulated in one instance of
"java.util.concurrent.ConcurrentHashMap$Segment[]" loaded by "<system
class loader>".

This memory is part of the result cache of Solr. Flushing this cache
appears the most appropriate solution to that problem.
2014-02-11 20:56:40 +01:00
..
cider * augmented proxy 2011-02-25 12:02:48 +01:00
contentcontrol do YaCy p2p connections using a timeout-request which covers the http 2014-01-19 15:21:23 +01:00
cora clear solr caches in case that an exception occurrs. The reason behind 2014-02-11 20:56:40 +01:00
crawler added button in host browser to re-load 404/failed documents 2014-01-23 15:56:36 +01:00
data removed jena library and all code that depended on jena. When jena was 2014-02-07 01:20:06 +01:00
document removed jena library and all code that depended on jena. When jena was 2014-02-07 01:20:06 +01:00
gui set more logger to 'final static' 2013-11-13 06:18:48 +01:00
http fixed 'resource leak' warning 2014-02-03 13:38:26 +01:00
kelondro fixed setting of shortMemoryStatus in MemoryControl 2014-02-09 12:25:55 +01:00
peers adopted network image drawing to increased number of peers 2014-02-11 00:53:10 +01:00
repository - removed old metadata database and all migration code 2014-01-20 18:31:46 +01:00
search Added methods in resource observer to calculate the available and the 2014-02-11 03:20:03 +01:00
server remove unused static var from HTTPDProxyHandler 2014-02-02 03:47:12 +01:00
upnp replaced StringBuffer with StringBuilder 2013-07-23 12:21:27 +02:00
utils use configured admin-username for api calls 2014-01-07 21:26:50 +01:00
visualization logger should be static 2013-11-13 06:04:28 +01:00
dbtest.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
migration.java - removed old metadata database and all migration code 2014-01-20 18:31:46 +01:00
yacy.java removed jena library and all code that depended on jena. When jena was 2014-02-07 01:20:06 +01:00
YaCySearchClient.java Added 'final' for all exception blocks as this helps the Java compiler 2013-07-17 18:31:30 +02:00