yacy_search_server/htroot/api
orbiter b6fb239e74 redesign of parser interface:
some file types are containers for several files. These containers had been parsed in such a way that the set of resulting parsed content was merged into one single document before parsing. Using this parser infrastructure it is not possible to parse document containers that contain individual files. An example is a rss file where the rss messages can be treated as individual documents with their own url reference. Another example is a surrogate file which was treated with a special operation outside of the parser infrastructure.
This commit introduces a redesigned parser interface and a new abstract parser implementation. The new parser interface has now only one entry point and returns always a set of parsed documents. In case of single documents the parser method returns a set of one documents.
To be compliant with the new interface, the zip and tar parser had been also completely redesigned. All parsers are now much more simple and cleaner in its structure. The switchboard operations had been extended to operate with sets of parsed files, not single parsed files.
additionally, parsing of jar manifest files had been added.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6955 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-29 19:20:45 +00:00
..
bookmarks - extended news size from 512 to 1024 characters 2010-06-15 10:43:47 +00:00
util more abstraction for access of LoaderDispatcher and cache 2010-06-22 12:28:53 +00:00
blacklists_p.java applied code changes that are recommended by PMD 2010-01-10 23:09:48 +00:00
blacklists_p.xml moved all servlets from htroot/xml to htroot/api 2009-01-15 23:52:58 +00:00
blacklists.java applied code changes that are recommended by PMD 2010-01-10 23:09:48 +00:00
blacklists.xml moved all servlets from htroot/xml to htroot/api 2009-01-15 23:52:58 +00:00
config_p.java refactoring 2009-10-11 21:29:18 +00:00
config_p.xml moved all servlets from htroot/xml to htroot/api 2009-01-15 23:52:58 +00:00
feed.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
feed.rss moved all servlets from htroot/xml to htroot/api 2009-01-15 23:52:58 +00:00
latency_p.java refactoring 2009-10-11 21:29:18 +00:00
latency_p.xml svn attributes added 2009-03-20 11:21:32 +00:00
queues_p.java fixed dates in metadata 2010-05-08 22:09:36 +00:00
queues_p.xml removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency. 2009-07-17 13:59:21 +00:00
status_p.java - cleanup, removed unused imports 2010-04-27 21:47:41 +00:00
status_p.xml - cleanup, removed unused imports 2010-04-27 21:47:41 +00:00
table_p.html Fixes for (X)HTML compatibility. 2010-05-05 21:12:58 +00:00
table_p.java moved table row/column matching method from front-end to back-end 2010-03-26 10:01:27 +00:00
table_p.xml added a robots.txt monitor in the crawler monitor submenu 2010-03-09 11:31:15 +00:00
timeline.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790 2010-04-15 13:22:59 +00:00
timeline.xml added experimental timeline api 2009-03-06 16:01:29 +00:00
trail_p.java refactoring 2009-10-11 21:29:18 +00:00
trail_p.json added new cybertag-tracking feature that was inspired by itgrl 2009-02-06 15:06:19 +00:00
version.java refactoring 2009-10-11 21:29:18 +00:00
version.xml improvments to debianpackage: 2009-07-11 17:03:22 +00:00
webstructure.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 2010-04-08 00:11:32 +00:00
webstructure.xml added evaluation of incoming links in webstructure api 2009-04-03 07:59:49 +00:00
yacydoc.html bugfixes 2010-06-16 15:11:21 +00:00
yacydoc.java This is a large bugfix and enhancement commit to support a better location detection for data 2010-05-11 11:14:05 +00:00
yacydoc.xml fixes for metadata retrieval and presentation 2010-05-05 22:45:54 +00:00