Michael Peter Christen
240045cf7c
fix for bad distance computation
2012-06-04 16:33:16 +02:00
Michael Peter Christen
e0d8643226
- performance hacks
...
- added log warnings in case that search processes run into time-out
situations
- better concurrency for Integer formatter (used a non-synchronized
formatter before)
- bugfix for search termination (a poison pill was missing)
- added timeout parameters for search (again) -> target is, that they
are never reached.
2012-06-04 15:37:39 +02:00
Michael Peter Christen
7a329465b3
using pre-compile pattern in blacklist; should enhance search speed
2012-06-04 15:34:53 +02:00
Michael Peter Christen
6e83b02b83
- bugfix for surrogate file reader
...
- bugfix for location search: suppress empty search
2012-06-01 00:08:31 +02:00
Michael Peter Christen
9b4c699526
ehanced location search:
...
- search request are now made using a map boundary
- search results are only computed for the map boundary
- the number of results is adopted to the results in the visible range
- added a double-buffering for the search result markers
- added a search query option for the search results:
/radius/<lat>/<lon>/<radius>
2012-05-31 22:39:53 +02:00
Michael Peter Christen
834dc6b263
store more data from interface access
2012-05-31 00:47:07 +02:00
Michael Peter Christen
1f48d1528b
performance hacks
2012-05-31 00:46:30 +02:00
Michael Peter Christen
c70aaccdc9
better location to generate a guid for rss messages
2012-05-30 17:14:25 +02:00
Michael Peter Christen
10da7335ea
performance hack: use a hash cache for all hashes that are computed by a
...
byte array. If this hash is used in a HashMap (which is very often the
case) then this hack eliminates a lot of re-computations of the same
hash.
2012-05-30 16:59:13 +02:00
Michael Peter Christen
f8a0cf6d7c
RSSMessages do not need a concurrent hash map -> removed overhead
2012-05-30 16:44:03 +02:00
Michael Peter Christen
07ca7e4dd1
enhanced RSS parsing by ensuring that it is parsed with a buffered input
...
stream
2012-05-30 16:40:37 +02:00
Michael Peter Christen
7c1feefb28
introduced a default 10 second time-out in rwi normalization time
...
uring search process to prevent endless deadlocks after a very long
running search
2012-05-30 16:26:05 +02:00
Michael Peter Christen
8d997d55b6
better logging
2012-05-30 15:47:35 +02:00
Michael Peter Christen
65d37e6a20
only ASCII needed in seed bitflags
2012-05-30 15:42:28 +02:00
Michael Peter Christen
0f82fb3628
using double instead float for a better release ordering
2012-05-30 15:28:20 +02:00
Michael Peter Christen
43c2c6e588
better logging
2012-05-30 15:27:45 +02:00
sixcooler
56087c1f23
bump to httpclient- httpcore-, httpmime- 4.2
2012-05-30 14:46:21 +02:00
Michael Peter Christen
71c3163f3d
- fixes to node identification
...
- added link to node in network list
- added marking of portal search node peers
2012-05-29 01:38:54 +02:00
Michael Peter Christen
4d3cc02168
replaced old bzip2 library against better documented commons-compress
...
package from http://commons.apache.org/compress/
2012-05-28 23:53:48 +02:00
Michael Peter Christen
ad222be7f8
added node state icon in network list
2012-05-25 17:29:54 +02:00
Michael Peter Christen
3c2bec681f
added a root node flag: identifies peers with short ping time
2012-05-25 15:33:02 +02:00
Michael Peter Christen
c846e9ca14
redesign of the crawler monitor page: show crawled pages instead of
...
queue of urls that shall be crawled
2012-05-25 01:45:38 +02:00
Michael Peter Christen
c15fcde1c8
add-on to latest commit
2012-05-21 17:52:30 +02:00
Michael Peter Christen
cf47d94888
performance hack to parse numbers inside of substrings without actually
...
generating a substring. This avoids the allocation of a String object
ech time a substring is parsed. Should affect CPU load during RWI
transmission.
2012-05-21 13:40:46 +02:00
Michael Peter Christen
7e0ddbd275
added a "fromCache" flag in Response object to omit one cache.has()
...
check during snippet generation. This should cause less blockings
2012-05-21 03:03:47 +02:00
Michael Peter Christen
81737dcb18
removed stack trace from swf parser since we cant do anything there
2012-05-21 02:27:06 +02:00
Michael Peter Christen
7bf421b9dd
- fixed image search page navigation
...
- removed some deadlocks and ConcurrentModificationExceptions during
DidYouMean collection
2012-05-21 01:58:29 +02:00
Michael Peter Christen
c6a09eab0b
synchronization needed
2012-05-21 00:58:29 +02:00
Michael Peter Christen
fb94b47b1a
changed queue sizes to have less memory occupied during indexing
2012-05-21 00:19:03 +02:00
Michael Peter Christen
76157dc2c3
bugfix for http://bugs.yacy.net/view.php?id=173
2012-05-21 00:18:00 +02:00
reger
6696cb1313
bugfix: lookup of peernames no result for active peer in page IndexControlRWIs_p.html -> Transfer RWI to other Peer
...
SeedDB.lookupByName searche for lowercase peerNames, while MapColumnIndex.getIndex uses peername as is in the keyset.
Changed the index init to insert lowercase peer names as key
2012-05-20 05:25:16 +02:00
Michael Peter Christen
c6558cba08
more classification bugs
2012-05-20 02:59:47 +02:00
Michael Peter Christen
082831b9d6
search contentdom was checked in wrong way - fixed
2012-05-20 01:23:02 +02:00
reger
ee553d971e
correct typo in scripts_txt comment
2012-05-19 02:09:16 +02:00
Michael Peter Christen
f294f2e295
bugfix to http://bugs.yacy.net/view.php?id=181
...
tried to make a bit less 'noise' to dns server
also included: less processes in snippet fetch to reduce load during
search on small computers
2012-05-19 01:06:33 +02:00
Michael Peter Christen
acf8d521a2
fix for http://bugs.yacy.net/view.php?id=126
2012-05-19 00:21:03 +02:00
Michael Peter Christen
bb88878b4d
the last commit was incomplete..
2012-05-18 22:33:16 +02:00
Michael Peter Christen
d320a31ae1
bugfix for http://bugs.yacy.net/view.php?id=186
2012-05-18 22:18:47 +02:00
Michael Peter Christen
fa735f4f04
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2012-05-17 23:40:08 +02:00
Michael Peter Christen
3e1bc9477f
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2012-05-17 13:58:09 +02:00
Michael Peter Christen
6f8a2fef1f
small speed enhancement using a column factory
2012-05-17 11:08:48 +02:00
Roland 'Quix0r' Haeder
d10627d591
More sync in close() methods
...
Conflicts:
source/net/yacy/kelondro/logging/GuiHandler.java
source/net/yacy/kelondro/workflow/InstantBusyThread.java
2012-05-17 06:03:18 +02:00
Roland 'Quix0r' Haeder
b3ae2aa41f
With or without 'final'? At least please try it in other methods
...
Conflicts:
source/de/anomic/tools/tarTools.java
2012-05-17 06:00:49 +02:00
Roland 'Quix0r' Haeder
fbb946f913
Made a method static (Eclipse suggested it), removed unused import, pk=null check does now output a warning in logfile
2012-05-17 05:55:44 +02:00
Michael Peter Christen
52d307c735
prevent that the snippet fectch process removes catchall entries
2012-05-17 05:18:52 +02:00
Michael Peter Christen
7eece0256f
moved yacy.logging to defaults according to request in
...
http://bugs.yacy.net/view.php?id=55
2012-05-17 04:26:03 +02:00
Michael Peter Christen
89142d1e8d
removed (not all) warnings
2012-05-16 13:42:32 +02:00
Michael Peter Christen
5deebd02ea
added serialization
2012-05-15 23:10:47 +02:00
reger
b2175ea4ef
Add possibility to set custom Solr field names for the YaCy default Solr attributes.
...
- Changing the format of YaCy's solr.key.list while maintainig backward compatibility
Federated index config screens adjusted accordingly
- modified the Solr update request to use a 3 min Solr autocommit intervall
2012-05-15 22:34:02 +02:00
Michael Peter Christen
15db703808
added missing serialization to remove all warnings
2012-05-15 13:13:07 +02:00