Michael Peter Christen
43c2c6e588
better logging
2012-05-30 15:27:45 +02:00
sixcooler
56087c1f23
bump to httpclient- httpcore-, httpmime- 4.2
2012-05-30 14:46:21 +02:00
Michael Peter Christen
71c3163f3d
- fixes to node identification
...
- added link to node in network list
- added marking of portal search node peers
2012-05-29 01:38:54 +02:00
Michael Peter Christen
4d3cc02168
replaced old bzip2 library against better documented commons-compress
...
package from http://commons.apache.org/compress/
2012-05-28 23:53:48 +02:00
Michael Peter Christen
ad222be7f8
added node state icon in network list
2012-05-25 17:29:54 +02:00
Michael Peter Christen
3c2bec681f
added a root node flag: identifies peers with short ping time
2012-05-25 15:33:02 +02:00
Michael Peter Christen
c846e9ca14
redesign of the crawler monitor page: show crawled pages instead of
...
queue of urls that shall be crawled
2012-05-25 01:45:38 +02:00
Michael Peter Christen
c15fcde1c8
add-on to latest commit
2012-05-21 17:52:30 +02:00
Michael Peter Christen
cf47d94888
performance hack to parse numbers inside of substrings without actually
...
generating a substring. This avoids the allocation of a String object
ech time a substring is parsed. Should affect CPU load during RWI
transmission.
2012-05-21 13:40:46 +02:00
Michael Peter Christen
7e0ddbd275
added a "fromCache" flag in Response object to omit one cache.has()
...
check during snippet generation. This should cause less blockings
2012-05-21 03:03:47 +02:00
Michael Peter Christen
81737dcb18
removed stack trace from swf parser since we cant do anything there
2012-05-21 02:27:06 +02:00
Michael Peter Christen
7bf421b9dd
- fixed image search page navigation
...
- removed some deadlocks and ConcurrentModificationExceptions during
DidYouMean collection
2012-05-21 01:58:29 +02:00
Michael Peter Christen
c6a09eab0b
synchronization needed
2012-05-21 00:58:29 +02:00
Michael Peter Christen
fb94b47b1a
changed queue sizes to have less memory occupied during indexing
2012-05-21 00:19:03 +02:00
Michael Peter Christen
76157dc2c3
bugfix for http://bugs.yacy.net/view.php?id=173
2012-05-21 00:18:00 +02:00
reger
6696cb1313
bugfix: lookup of peernames no result for active peer in page IndexControlRWIs_p.html -> Transfer RWI to other Peer
...
SeedDB.lookupByName searche for lowercase peerNames, while MapColumnIndex.getIndex uses peername as is in the keyset.
Changed the index init to insert lowercase peer names as key
2012-05-20 05:25:16 +02:00
Michael Peter Christen
c6558cba08
more classification bugs
2012-05-20 02:59:47 +02:00
Michael Peter Christen
082831b9d6
search contentdom was checked in wrong way - fixed
2012-05-20 01:23:02 +02:00
reger
ee553d971e
correct typo in scripts_txt comment
2012-05-19 02:09:16 +02:00
Michael Peter Christen
f294f2e295
bugfix to http://bugs.yacy.net/view.php?id=181
...
tried to make a bit less 'noise' to dns server
also included: less processes in snippet fetch to reduce load during
search on small computers
2012-05-19 01:06:33 +02:00
Michael Peter Christen
acf8d521a2
fix for http://bugs.yacy.net/view.php?id=126
2012-05-19 00:21:03 +02:00
Michael Peter Christen
bb88878b4d
the last commit was incomplete..
2012-05-18 22:33:16 +02:00
Michael Peter Christen
d320a31ae1
bugfix for http://bugs.yacy.net/view.php?id=186
2012-05-18 22:18:47 +02:00
Michael Peter Christen
fa735f4f04
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2012-05-17 23:40:08 +02:00
Michael Peter Christen
3e1bc9477f
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2012-05-17 13:58:09 +02:00
Michael Peter Christen
6f8a2fef1f
small speed enhancement using a column factory
2012-05-17 11:08:48 +02:00
Roland 'Quix0r' Haeder
d10627d591
More sync in close() methods
...
Conflicts:
source/net/yacy/kelondro/logging/GuiHandler.java
source/net/yacy/kelondro/workflow/InstantBusyThread.java
2012-05-17 06:03:18 +02:00
Roland 'Quix0r' Haeder
b3ae2aa41f
With or without 'final'? At least please try it in other methods
...
Conflicts:
source/de/anomic/tools/tarTools.java
2012-05-17 06:00:49 +02:00
Roland 'Quix0r' Haeder
fbb946f913
Made a method static (Eclipse suggested it), removed unused import, pk=null check does now output a warning in logfile
2012-05-17 05:55:44 +02:00
Michael Peter Christen
52d307c735
prevent that the snippet fectch process removes catchall entries
2012-05-17 05:18:52 +02:00
Michael Peter Christen
7eece0256f
moved yacy.logging to defaults according to request in
...
http://bugs.yacy.net/view.php?id=55
2012-05-17 04:26:03 +02:00
Michael Peter Christen
89142d1e8d
removed (not all) warnings
2012-05-16 13:42:32 +02:00
Michael Peter Christen
5deebd02ea
added serialization
2012-05-15 23:10:47 +02:00
reger
b2175ea4ef
Add possibility to set custom Solr field names for the YaCy default Solr attributes.
...
- Changing the format of YaCy's solr.key.list while maintainig backward compatibility
Federated index config screens adjusted accordingly
- modified the Solr update request to use a 3 min Solr autocommit intervall
2012-05-15 22:34:02 +02:00
Michael Peter Christen
15db703808
added missing serialization to remove all warnings
2012-05-15 13:13:07 +02:00
Michael Peter Christen
1795a7325b
made HandleSet serializable
2012-05-15 12:55:15 +02:00
Michael Peter Christen
e7e381d110
added configuration to switch off redirection following in crawler
2012-05-15 12:25:46 +02:00
Michael Peter Christen
2717c1b749
fixed bug in solr interface
2012-05-15 12:25:14 +02:00
Michael Peter Christen
f150bc218b
fixed bug in solr error document
2012-05-14 14:56:21 +02:00
Michael Peter Christen
cb54c1737b
solrj connector bugfix
2012-05-14 11:56:04 +02:00
Roland 'Quix0r' Haeder
a093ccf5eb
Now used synchronization in all close() methods to make sure all objects
...
are 'closed' in an ordered way
Conflicts:
source/de/anomic/http/server/ChunkedInputStream.java
source/de/anomic/http/server/ChunkedOutputStream.java
source/de/anomic/http/server/ContentLengthInputStream.java
source/net/yacy/cora/protocol/Domains.java
source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java
source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java
source/net/yacy/document/content/dao/PhpBB3Dao.java
source/net/yacy/document/parser/html/AbstractTransformer.java
source/net/yacy/kelondro/blob/BEncodedHeap.java
source/net/yacy/kelondro/blob/HeapReader.java
source/net/yacy/kelondro/index/RAMIndexCluster.java
source/net/yacy/kelondro/io/ByteCountInputStream.java
source/net/yacy/kelondro/logging/ConsoleOutErrHandler.java
source/net/yacy/kelondro/table/SQLTable.java
2012-05-14 07:41:55 +02:00
Michael Peter Christen
49cab2b85f
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2012-05-13 09:51:06 +02:00
Michael Peter Christen
0d58fea210
made multiple connector default
2012-05-12 10:39:01 +02:00
Michael Peter Christen
7740c02c56
- enhanced the solr connector
...
- added new multiple connector (to replace singleConnector)
2012-05-12 10:32:42 +02:00
Michael Peter Christen
0cf3d36eae
more tolerance in case of corrupted file
2012-05-11 20:46:50 +02:00
Michael Peter Christen
acc6db28ff
added missing classes for solr interface
2012-05-09 23:43:12 +02:00
Michael Peter Christen
adeb33bb36
better abstraction for solr objects
2012-05-09 17:21:19 +02:00
Michael Peter Christen
8864141872
more abstraction in solr connection classes
2012-05-09 17:00:56 +02:00
Michael Peter Christen
c00efc2717
made the solr connection more generic
2012-05-09 16:46:45 +02:00
Michael Peter Christen
ea2bd43b28
patch for broken configurations
2012-05-09 12:29:07 +02:00