orbiter 54af9e6b49 - added parsing of robots meta-tag in html headers to detect a noindexing request ... - added evaluation and indexing prevention in case that a noindexing is given in a html file git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6709 6c8d7289-2bf4-0310-a012-ef5d649a1542		2010-03-03 23:32:56 +00:00
..
ai	update to yacy/ai (just more testing)	2010-01-21 22:07:32 +00:00
document	- added parsing of robots meta-tag in html headers to detect a noindexing request	2010-03-03 23:32:56 +00:00
kelondro	next try for for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2703	2010-02-23 15:59:58 +00:00
repository	more PMD recommendations	2010-01-12 20:53:19 +00:00
visualization	added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/	2009-11-05 20:28:37 +00:00
dbtest.java	applied code changes that are recommended by PMD	2010-01-10 23:09:48 +00:00
migration.java	more PMD recommendations	2010-01-12 20:53:19 +00:00
screenshot.java	- shifted main classes to new package net.yacy	2009-10-18 01:38:07 +00:00
yacy.java	added an api recording function: it shall be possible to record	2010-01-21 22:06:03 +00:00