yacy_search_server/source/de/anomic/crawler/retrieval
2011-09-05 12:21:25 +00:00
..
FileLoader.java - added a 'add every media object linked in a html document as a new document' to the html parser. This causes that all image, app, video or audio file that is linked in a html file is added as document. In fact that means that parsing a single html document may cause that a number of documents is inserted into the search index. 2011-09-01 16:05:00 +00:00
FTPLoader.java Replaced a widely-used Property Object in the httpd with HashMap<String, Object> which is not synchronized like Properties 2011-05-26 16:34:35 +00:00
HTTPLoader.java stop loading via http at defined maximum of bytes - even size is unknown before loading 2011-08-01 23:28:23 +00:00
Request.java hack to reduce resource contention caused by massive UTF8 decodings which use java.nio resources: 2011-05-27 08:24:54 +00:00
Response.java fixes size of document in case the server doesn't give the size in the header 2011-09-05 12:21:25 +00:00
SMBLoader.java - added a 'add every media object linked in a html document as a new document' to the html parser. This causes that all image, app, video or audio file that is linked in a html file is added as document. In fact that means that parsing a single html document may cause that a number of documents is inserted into the search index. 2011-09-01 16:05:00 +00:00