yacy_search_server/source/net/yacy/document
orbiter 3d5104d357 - fixed a bug in crawl start with file name (npe in new url)
- added deletion of solr index in IndexControlRWIs
- added asynchronous adding of large url lists (happens when crawls are startet with file)
- fixed npe in Image display
- replaced language warning with fine logging
- added a domain name cache in Domains that helps to speed up the isLocal property (less DNS lookups)
- added a new storage class for this new cache: KeyList. The domain key list is stored in DATA/WORK/globalhosts.list
- added concurrent solr updates and chunked transfers (50 documents until a commit is done) for high-speed feeding (> 40000 ppm)
- fixed a bug in content scraper that chopped off large parts of crawl lists (using crawl start from file)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7666 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-04-18 16:11:16 +00:00
..
content enhanced the surrogate parser: better reading of UTF-8 characters 2011-04-01 11:05:42 +00:00
geolocalization replaced more appearance of double values by float values 2011-02-02 00:06:29 +00:00
importer enhanced location search: 2011-04-15 15:54:19 +00:00
language *) cleaning up the code a little bit 2010-12-27 17:07:21 +00:00
parser - fixed a bug in crawl start with file name (npe in new url) 2011-04-18 16:11:16 +00:00
AbstractParser.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
Classification.java *) added SID file (Commodore 64) sound file parser 2010-12-28 12:06:04 +00:00
Condenser.java enhanced speed for OrderedScoreMap inc method and size comparisment in concurrent environments 2011-04-13 22:04:23 +00:00
Document.java enhanced location search: 2011-04-15 15:54:19 +00:00
ImageParser.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
LargeNumberCache.java more performance hacks 2010-10-09 08:55:57 +00:00
LibraryProvider.java - fixed document number limitation for crawls that restrict the number of documents per domain 2011-02-12 00:01:40 +00:00
Parser.java *) added SID file (Commodore 64) sound file parser 2010-12-28 12:06:04 +00:00
Phrase.java more performance hacks 2010-10-09 08:55:57 +00:00
SentenceReader.java *) set SVN properties 2011-03-08 01:51:51 +00:00
SnippetExtractor.java always try to guess the size of a StringBuilder to prevent too many memory re-allocations 2011-03-09 09:29:05 +00:00
TextParser.java *) added SID file (Commodore 64) sound file parser 2010-12-28 12:06:04 +00:00
WordCache.java enhanced speed for OrderedScoreMap inc method and size comparisment in concurrent environments 2011-04-13 22:04:23 +00:00
WordTokenizer.java - replaced more direct string-based UTF-8 conversions by predefined UTF-8 conversion 2011-03-10 23:25:07 +00:00