yacy_search_server/source/net/yacy/document
Michael Peter Christen 788288eb9e added the generation of 50 (!!) new solr field in the core 'webgraph'.
The default schema uses only some of them and the resting search index
has now the following properties:
- webgraph size will have about 40 times as much entries as default
index
- the complete index size will increase and may be about the double size
of current amount
As testing showed, not much indexing performance is lost. The default
index will be smaller (moved fields out of it); thus searching
can be faster.
The new index will cause that some old parts in YaCy can be removed,
i.e. specialized webgraph data and the noload crawler. The new index
will make it possible to:
- search within link texts of linked but not indexed documents (about 20
times of document index in size!!)
- get a very detailed link graph
- enhance ranking using a complete link graph

To get the full access to the new index, the API to solr has now two
access points: one with attribute core=collection1 for the default
search index and core=webgraph to the new webgraph search index. This is
also avaiable for p2p operation but client access is not yet
implemented.
2013-02-22 15:45:15 +01:00
..
content removed the option to prevent removal of & parts inside of the 2012-10-10 11:46:22 +02:00
importer removed the option to prevent removal of & parts inside of the 2012-10-10 11:46:22 +02:00
language added changes from copperdust (submitted by email): 2012-02-22 12:21:27 +01:00
parser added the generation of 50 (!!) new solr field in the core 'webgraph'. 2013-02-22 15:45:15 +01:00
AbstractParser.java - added new solr fields: 2012-08-31 10:30:43 +02:00
Condenser.java added the generation of 50 (!!) new solr field in the core 'webgraph'. 2013-02-22 15:45:15 +01:00
Document.java added the generation of 50 (!!) new solr field in the core 'webgraph'. 2013-02-22 15:45:15 +01:00
ImageParser.java - enhanced description on search front page 2011-11-26 13:40:33 +00:00
LargeNumberCache.java more performance hacks 2010-10-09 08:55:57 +00:00
LibraryProvider.java added an url rewriter which can be used to remove session ids from urls 2012-10-09 11:24:48 +02:00
Parser.java removed the option to prevent removal of & parts inside of the 2012-10-10 11:46:22 +02:00
Phrase.java more performance hacks 2010-10-09 08:55:57 +00:00
SentenceReader.java fix for url camel case parser and sentence reader 2012-07-08 16:48:09 +02:00
SnippetExtractor.java Abstraction of HandleMap and HandleSet 2012-07-27 12:13:53 +02:00
TextParser.java added more logging to get info which url causes performance problems 2012-12-02 16:52:12 +01:00
WordTokenizer.java refactoring 2012-09-21 16:46:57 +02:00