Michael Peter Christen 2602be8d1e - removed ZURL data structure; removed also the ZURL data file ... - replaced load failure logging by information which is stored in Solr - fixed a bug with crawling of feeds: added must-match pattern application to feed urls to filter out such urls which shall not be in a wanted domain - delegatedURLs, which also used ZURLs are now temporary objects in memory		2013-09-17 15:27:02 +02:00
..
Cache.java	- the webgraph shall store all links which appear on a web page and not	2013-09-15 00:30:23 +02:00
CrawlProfile.java	- the webgraph shall store all links which appear on a web page and not	2013-09-15 00:30:23 +02:00
CrawlQueues.java	- removed ZURL data structure; removed also the ZURL data file	2013-09-17 15:27:02 +02:00
Latency.java	- the webgraph shall store all links which appear on a web page and not	2013-09-15 00:30:23 +02:00
NoticedURL.java	Redesign of crawler identification and robots steering. A non-p2p user	2013-08-22 14:23:47 +02:00
ResultImages.java	- replaced the properties object in AnchorURL with distinct variables	2013-09-15 23:27:04 +02:00
ResultURLs.java	migrated the index export methods from the old metadata to solr. Now	2013-01-24 12:39:19 +01:00