yacy_search_server/htroot/yacy
orbiter b6fb239e74 redesign of parser interface:
some file types are containers for several files. These containers had been parsed in such a way that the set of resulting parsed content was merged into one single document before parsing. Using this parser infrastructure it is not possible to parse document containers that contain individual files. An example is a rss file where the rss messages can be treated as individual documents with their own url reference. Another example is a surrogate file which was treated with a special operation outside of the parser infrastructure.
This commit introduces a redesigned parser interface and a new abstract parser implementation. The new parser interface has now only one entry point and returns always a set of parsed documents. In case of single documents the parser method returns a set of one documents.
To be compliant with the new interface, the zip and tar parser had been also completely redesigned. All parsers are now much more simple and cleaner in its structure. The switchboard operations had been extended to operate with sets of parsed files, not single parsed files.
additionally, parsing of jar manifest files had been added.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6955 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-29 19:20:45 +00:00
..
ui fixes for embedded search / search widget 2010-06-01 22:09:17 +00:00
crawlReceipt.html
crawlReceipt.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 2010-04-08 00:11:32 +00:00
hello.html fix for peer-ping in case that remote peer does not respond with valid values 2007-09-11 15:27:01 +00:00
hello.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 2009-11-05 20:28:37 +00:00
list.html re-added list interface (blacklist imports need them) 2008-02-13 22:37:37 +00:00
list.java better performance for list api (blacklist transfer) 2009-11-18 15:11:52 +00:00
message.html
message.java more PMD recommendations 2010-01-12 20:53:19 +00:00
profile.html
profile.java refactoring 2009-10-11 21:29:18 +00:00
query.html
query.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 2009-11-05 20:28:37 +00:00
search.html changes towards better join-search 2006-09-10 22:36:47 +00:00
search.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
transfer.html added missing files for last commit 2005-11-11 08:02:46 +00:00
transfer.java applied code changes that are recommended by PMD 2010-01-10 23:09:48 +00:00
transferRWI.html added a busy-time estimation at DHT/RWI-Receive 2006-05-19 14:52:00 +00:00
transferRWI.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
transferURL.html
transferURL.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
urls.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 2010-04-08 00:11:32 +00:00
urls.xml added referrer to remote crawl url list 2007-11-29 13:58:00 +00:00