7 Commits

Author	SHA1	Message	Date
theli	b6c7b91582	*) Parser now throws an ParserException instead of returning null on parsing errors (e.g. needed by snippet fetcher) ... *) better logging of parser failures *) simplified usage of plasmaparser through switchboard *) restructuring of crawler - crawler now returns an error message if it is used in sync mode (e.g. by snippet fetcher) *) snippet-fetcher: more verbose error messages *) serverByteBuffer.java: adding new function append(String,encoding) *) serverFileUtils.java: adding functions to copy only a given number of bytes between streams git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2641 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-20 12:25:07 +00:00
theli	74c3e7cf29	*) storing document charset into plasmaParserDocument object (is needed later by the condenser) ... *) htmlFilterContentScraper.java: using proper charset for document title *) serverByteBuffer.java: adding new toString which allows to specify the charset for byte encoding git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2593 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-15 13:18:12 +00:00
theli	d0a5a53789	*) changes needed for multi-language support ... - parsers may need to know the charset of the byte stream git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2591 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-15 12:52:46 +00:00
theli	f3ac4dbbb9	*) better handling of server shutdown ... See: e.g. http://www.yacy-forum.de/viewtopic.php?t=2584 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2468 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-03 14:59:00 +00:00
orbiter	3879a0ecd0	replaced java.net.URL usage by use of new class de.anomic.net.URL ... This shall be seen as an experiment to exclude all cases where there could be a DNS lookup during URL comparisment. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2290 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-07-13 01:21:53 +00:00
orbiter	015d044c25	tried to fix some problems with latest changes to httpc ... very experimental! git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2078 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-05-10 16:01:14 +00:00
theli	8ed0aaae8d	*) Adding content Parser for RPM Files ... - at the moment only the metadata is extracted git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1147 6c8d7289-2bf4-0310-a012-ef5d649a1542	2005-12-01 10:47:00 +00:00