yacy_search_server/source/net/yacy/crawler/retrieval
Michael Peter Christen 2602be8d1e - removed ZURL data structure; removed also the ZURL data file
- replaced load failure logging by information which is stored in Solr
- fixed a bug with crawling of feeds: added must-match pattern
application to feed urls to filter out such urls which shall not be in a
wanted domain
- delegatedURLs, which also used ZURLs are now temporary objects in
memory
2013-09-17 15:27:02 +02:00
..
FileLoader.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
FTPLoader.java - removed ZURL data structure; removed also the ZURL data file 2013-09-17 15:27:02 +02:00
HTTPLoader.java - removed ZURL data structure; removed also the ZURL data file 2013-09-17 15:27:02 +02:00
ImporterException.java
Request.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
Response.java - replaced the properties object in AnchorURL with distinct variables 2013-09-15 23:27:04 +02:00
RSSLoader.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
SitemapImporter.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
SMBLoader.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
URLRewriterLibrary.java Added 'final' for all exception blocks as this helps the Java compiler 2013-07-17 18:31:30 +02:00