yacy_search_server/source/de/anomic/crawler/retrieval
f1ori dca9e16f51 * don't index pages, which redirect, twice
* there fore auto-redirection of HTTPClient for crawling is disabled and the old code is reactivated

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7332 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-11-21 22:46:12 +00:00
..
EventOrigin.java - added function to OAI-PMH reader that can pull all records from a server using an evaluation of the resumption token to get URL to retrieve remaining records 2009-11-02 11:53:14 +00:00
FileLoader.java - enhanced intranet search speed 2010-10-08 10:54:13 +00:00
FTPLoader.java redesign of crawl profiles data structure. target will be: 2010-08-31 15:47:47 +00:00
HTTPLoader.java * don't index pages, which redirect, twice 2010-11-21 22:46:12 +00:00
Request.java This is a large bugfix and enhancement commit to support a better location detection for data 2010-05-11 11:14:05 +00:00
Response.java * add a bit documentation to DigestURI, use DigestURI(string) instead of DigestURI(string, null) 2010-10-26 16:10:20 +00:00
SMBLoader.java - enhanced intranet search speed 2010-10-08 10:54:13 +00:00