yacy_search_server/source/de/anomic/crawler/retrieval
sixcooler 15e8c13526 ... migrating to HttpComponents-Client-4.x ...
(gzip decompression, httploader, robots, ...)

+ enable proxy-crawling while log is fine

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7001 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-07-27 01:16:26 +00:00
..
EventOrigin.java - added function to OAI-PMH reader that can pull all records from a server using an evaluation of the resumption token to get URL to retrieve remaining records 2009-11-02 11:53:14 +00:00
FileLoader.java migrated all my LGPL 3 -licensed files to the LGPL 2.1 because LGPL 3 is not compatible to the GPL 2 2010-06-28 16:25:14 +00:00
FTPLoader.java redesign of remote proxy settings 2010-05-26 00:01:16 +00:00
HTTPLoader.java ... migrating to HttpComponents-Client-4.x ... 2010-07-27 01:16:26 +00:00
Request.java This is a large bugfix and enhancement commit to support a better location detection for data 2010-05-11 11:14:05 +00:00
Response.java redesign of parser interface: 2010-06-29 19:20:45 +00:00
SMBLoader.java fixes to SMB crawler 2010-05-23 01:17:44 +00:00