Michael Peter Christen 57ffdfad4c added a crawl option to obey html-meta-robots-noindex. This is on by ... default.		2013-07-03 14:50:06 +02:00
..
MonitoredReader.java
TablesRowComparator.java
YMarkAutoTagger.java	added url_file_name_s in default collection schema for the file name	2013-06-25 16:27:20 +02:00
YMarkCrawlStart.java	added a crawl option to obey html-meta-robots-noindex. This is on by	2013-07-03 14:50:06 +02:00
YMarkDate.java
YMarkDMOZImporter.java
YMarkEntry.java
YMarkHTMLImporter.java
YMarkImporter.java
YMarkJSONImporter.java
YMarkMetadata.java	reduced locking situation in crawler: shifted synchronized location and	2013-05-20 22:05:28 +02:00
YMarkRDF.java
YMarkTables.java	removed the option to prevent removal of & parts inside of the	2012-10-10 11:46:22 +02:00
YMarkTag.java
YMarkUtil.java
YMarkXBELImporter.java