yacy_search_server/source/net/yacy/crawler/retrieval
Michael Peter Christen eca9380e3d bugfix for crawler double-check: if an url is redirected, the
redirect-target was not double-checked. This is now done by replacing
the redirect-URL on the crawl queue again (where it is double-checked)
2014-08-06 12:35:12 +02:00
..
FileLoader.java fix for file urls 2014-07-23 17:54:31 +02:00
FTPLoader.java added crawl depth for failed documents 2014-04-17 13:21:43 +02:00
HTTPLoader.java bugfix for crawler double-check: if an url is redirected, the 2014-08-06 12:35:12 +02:00
ImporterException.java
Request.java added an option to set 'obey nofollow' for links with rel="nofollow" 2014-07-18 12:43:01 +02:00
Response.java bugfix for image search 2014-06-26 12:56:33 +02:00
RSSLoader.java better error handling for remote solr queries and exists-checks 2014-08-01 11:00:10 +02:00
SitemapImporter.java better error handling for remote solr queries and exists-checks 2014-08-01 11:00:10 +02:00
SMBLoader.java use configured admin-username for api calls 2014-01-07 21:26:50 +01:00
URLRewriterLibrary.java Added 'final' for all exception blocks as this helps the Java compiler 2013-07-17 18:31:30 +02:00