yacy_search_server/source/net/yacy/crawler/retrieval
luccioman 5a646540cc Support parsing gzip files from servers with redundant headers.
Some web servers provide both 'Content-Encoding : "gzip"' and
'Content-Type : "application/x-gzip"' HTTP headers on their ".gz" files.
This was annoying to fail on such resources which are not so uncommon,
while non conforming (see RFC 7231 section 3.1.2.2 for
"Content-Encoding" header specification
https://tools.ietf.org/html/rfc7231#section-3.1.2.2)
2017-07-16 14:46:46 +02:00
..
FileLoader.java Finer control on bounded input streams with custom stream implementation 2017-07-12 00:13:24 +02:00
FTPLoader.java Improved consistency between loader openInputStream and load functions 2017-06-02 01:46:06 +02:00
HTTPLoader.java Finer control on bounded input streams with custom stream implementation 2017-07-12 00:13:24 +02:00
ImporterException.java refactoring 2012-09-21 15:48:16 +02:00
Request.java ! finish running crawls before applying ! 2015-08-03 00:49:24 +02:00
Response.java Distinguish response parsing failures from unexpected exceptions. 2017-07-16 14:39:53 +02:00
RSSLoader.java Customized name for Threads still using the default "Thread-n" pattern. 2016-10-22 17:17:21 +02:00
SitemapImporter.java Customized name for Threads still using the default "Thread-n" pattern. 2016-10-22 17:17:21 +02:00
SMBLoader.java Improved consistency between loader openInputStream and load functions 2017-06-02 01:46:06 +02:00
StreamResponse.java Support parsing gzip files from servers with redundant headers. 2017-07-16 14:46:46 +02:00
URLRewriterLibrary.java the LinkedBlockingQueue is much faster than the ArrayBlockingQueue 2015-01-27 16:53:09 +01:00