Michael Peter Christen 659178942f - Redesigned crawler and parser to accept embedded links from the NOLOAD ... queue and not from virtual documents generated by the parser. - The parser now generates nice description texts for NOLOAD entries which shall make it possible to find media content using the search index and not using the media prefetch algorithm during search (which was costly) - Removed the media-search prefetch process from image search		2012-04-24 16:07:03 +02:00
..
Blacklist.java	Blacklist loadList() remove duplicates by using Set	2012-01-09 01:18:01 +01:00
BlacklistFile.java	*) set SVN properties	2011-03-08 01:51:51 +00:00
FilterEngine.java	some last-minute performance hacks	2011-11-25 11:23:52 +00:00
LoaderDispatcher.java	- Redesigned crawler and parser to accept embedded links from the NOLOAD	2012-04-24 16:07:03 +02:00
RegexHelper.java	*) Invalid crawl profiles (containing invalid mustmatch/mustnotmatch filters) will be moved from active crawls to invalid crawls (new file: DATA/INDEX/freeworld/QUEUES/crawlProfilesInvalid.heap). This file can not be edited yet, but it shoudl be easy to extend the CrawlProfileEditor accordingly.	2011-07-03 23:55:55 +00:00