Michael Peter Christen 2de159719b added an option to set 'obey nofollow' for links with rel="nofollow" ... attribute in the <a> tag for each crawl. This introduces a lot of changes because it extends the usage of the AnchorURL Object type which now also has a different toString method that the underlying DigestURL.toString. It is therefore not advised to use .toString at all for urls, just just toNormalform(false) instead.		2014-07-18 12:43:01 +02:00
..
net/yacy	added an option to set 'obey nofollow' for links with rel="nofollow"	2014-07-18 12:43:01 +02:00
parsertest	- refactoring	2009-10-19 22:34:44 +00:00
words	- moved test data from /bin to /test/words	2010-02-22 20:14:16 +00:00