5 Commits

Author	SHA1	Message	Date
orbiter	cf43bdc87e	This is a large bugfix and enhancement commit to support a better location detection for data ... - fixes to http file server session handling - fixes and enhancements to metadata date/time handling - added dc:publisher metadata field and updated all document parser - fixed bug in metdata read procedure - enhanced dublin core and rss parser to understand more fields more properly - enhanced url selection in case that multiple urls are given in surrogates - fix for condenser; failure when last word does not end with termination symbol git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6863 6c8d7289-2bf4-0310-a012-ef5d649a1542	2010-05-11 11:14:05 +00:00
orbiter	f204076d25	removed usage of temporary files: causes too much IO ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6813 6c8d7289-2bf4-0310-a012-ef5d649a1542	2010-04-14 22:17:18 +00:00
orbiter	54af9e6b49	- added parsing of robots meta-tag in html headers to detect a noindexing request ... - added evaluation and indexing prevention in case that a noindexing is given in a html file git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6709 6c8d7289-2bf4-0310-a012-ef5d649a1542	2010-03-03 23:32:56 +00:00
orbiter	3528b970d6	- refactoring ... - added new experimental (not-yet-working) image parser - added new test image git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6431 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-10-19 22:34:44 +00:00
orbiter	b79f4f062f	refactoring of yacy documents and parsers: they depend now only on the kelondro classes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6426 6c8d7289-2bf4-0310-a012-ef5d649a1542	2009-10-18 00:53:43 +00:00