yacy_search_server/source/de/anomic/crawler/retrieval
2010-12-28 02:15:22 +00:00
..
EventOrigin.java - added function to OAI-PMH reader that can pull all records from a server using an evaluation of the resumption token to get URL to retrieve remaining records 2009-11-02 11:53:14 +00:00
FileLoader.java - added CamelCase parser to MultiProtocolURI: generate better to-be-indexed words from urls 2010-12-15 00:03:19 +00:00
FTPLoader.java * fix filesize in ftp crawls 2010-12-28 02:15:22 +00:00
HTTPLoader.java * fix system update if urls are in blacklist (for example for very general blacklists like *.de) 2010-12-15 19:20:00 +00:00
Request.java enhanced crawler: 2010-12-11 00:31:57 +00:00
Response.java * fix filesize in ftp crawls 2010-12-28 02:15:22 +00:00
SMBLoader.java more fixes to smb crawling: better file names 2010-12-17 00:52:24 +00:00