Michael Peter Christen 2de159719b added an option to set 'obey nofollow' for links with rel="nofollow" ... attribute in the <a> tag for each crawl. This introduces a lot of changes because it extends the usage of the AnchorURL Object type which now also has a different toString method that the underlying DigestURL.toString. It is therefore not advised to use .toString at all for urls, just just toNormalform(false) instead.		2014-07-18 12:43:01 +02:00
..
content	added missing @Override annotation	2014-03-28 13:48:37 +01:00
importer	fixed generics warnings for generic array instantiation that appeared	2014-05-20 21:50:16 +02:00
language	added missing @Override annotation	2014-03-28 13:48:37 +01:00
parser	added an option to set 'obey nofollow' for links with rel="nofollow"	2014-07-18 12:43:01 +02:00
AbstractParser.java	fix AbstractParser.singleList not adding null strings	2014-06-26 02:56:45 +02:00
Condenser.java	fix NPE in Condenser,	2014-07-06 13:24:36 +02:00
Document.java	added an option to set 'obey nofollow' for links with rel="nofollow"	2014-07-18 12:43:01 +02:00
ImageParser.java	Added 'final' for all exception blocks as this helps the Java compiler	2013-07-17 18:31:30 +02:00
LargeNumberCache.java	more performance hacks	2010-10-09 08:55:57 +00:00
LibraryProvider.java	removed jena library and all code that depended on jena. When jena was	2014-02-07 01:20:06 +01:00
Parser.java	- replaced the properties object in AnchorURL with distinct variables	2013-09-15 23:27:04 +02:00
Phrase.java	more performance hacks	2010-10-09 08:55:57 +00:00
SentenceReader.java	hacks to prevent storage of data longer than necessary during search and	2013-10-25 15:05:30 +02:00
SnippetExtractor.java	Added 'final' for all exception blocks as this helps the Java compiler	2013-07-17 18:31:30 +02:00
TextParser.java	added linkScraperParser, a parser which ignores the text like the	2014-07-07 13:37:17 +02:00
WordTokenizer.java	hacks to prevent storage of data longer than necessary during search and	2013-10-25 15:05:30 +02:00