yacy_search_server/source/de/anomic/search
orbiter b6fb239e74 redesign of parser interface:
some file types are containers for several files. These containers had been parsed in such a way that the set of resulting parsed content was merged into one single document before parsing. Using this parser infrastructure it is not possible to parse document containers that contain individual files. An example is a rss file where the rss messages can be treated as individual documents with their own url reference. Another example is a surrogate file which was treated with a special operation outside of the parser infrastructure.
This commit introduces a redesigned parser interface and a new abstract parser implementation. The new parser interface has now only one entry point and returns always a set of parsed documents. In case of single documents the parser method returns a set of one documents.
To be compliant with the new interface, the zip and tar parser had been also completely redesigned. All parsers are now much more simple and cleaner in its structure. The switchboard operations had been extended to operate with sets of parsed files, not single parsed files.
additionally, parsing of jar manifest files had been added.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6955 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-29 19:20:45 +00:00
..
blockrank continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790 2010-04-15 13:22:59 +00:00
ContentDomain.java
DocumentIndex.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
IndexAbstracts.java
MediaSnippet.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
MetadataRepository.java - more abstraction (HashMap -> Map) 2010-06-01 13:02:11 +00:00
Navigator.java - added a new Wiki Namespace Navigator 2010-03-05 21:25:49 +00:00
QueryParams.java allow words with length >= 2 (you can't search for 'wm' with 3-letter words...) 2010-06-26 16:31:26 +00:00
RankingProcess.java more abstraction for access of LoaderDispatcher and cache 2010-06-22 12:28:53 +00:00
RankingProfile.java - more abstraction (HashMap -> Map) 2010-06-01 13:02:11 +00:00
ReferenceOrder.java added a configuration page for search heuristics. currently you can switch on there: 2010-06-27 21:38:16 +00:00
ResultEntry.java - added new protocol loader for 'file'-type URLs 2010-05-25 12:54:57 +00:00
ResultFetcher.java more abstraction of the htcache when using the LoaderDispatcher: 2010-06-21 14:54:54 +00:00
SearchEvent.java added a configuration page for search heuristics. currently you can switch on there: 2010-06-27 21:38:16 +00:00
SearchEventCache.java enhanced remove operation in search consequences (which are triggered when the snippet fetch proves that the word has disappeared from the page that was stored in the index) 2010-04-20 13:45:22 +00:00
Segment.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
Segments.java added a fascinating new way to search _and_ start a web crawl at the same time: 2010-06-23 11:19:32 +00:00
Switchboard.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
SwitchboardConstants.java allow global search if res. observer disabled index transmission 2010-02-09 17:14:16 +00:00
TextSnippet.java redesign of parser interface: 2010-06-29 19:20:45 +00:00