yacy_search_server/source/de/anomic/crawler/retrieval
orbiter 9b25a33fd9 - fixed numerous bugs
- better document names
- fixed problem with ftp crawling
- added automatic removal of search results from services that are not online according to the latest network scan: this does not delete the index but just does not show them. after the next network scan when the server is available again, the results are again showed.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7385 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-12-17 17:30:09 +00:00
..
EventOrigin.java - added function to OAI-PMH reader that can pull all records from a server using an evaluation of the resumption token to get URL to retrieve remaining records 2009-11-02 11:53:14 +00:00
FileLoader.java - added CamelCase parser to MultiProtocolURI: generate better to-be-indexed words from urls 2010-12-15 00:03:19 +00:00
FTPLoader.java - fixed numerous bugs 2010-12-17 17:30:09 +00:00
HTTPLoader.java * fix system update if urls are in blacklist (for example for very general blacklists like *.de) 2010-12-15 19:20:00 +00:00
Request.java enhanced crawler: 2010-12-11 00:31:57 +00:00
Response.java - added CamelCase parser to MultiProtocolURI: generate better to-be-indexed words from urls 2010-12-15 00:03:19 +00:00
SMBLoader.java more fixes to smb crawling: better file names 2010-12-17 00:52:24 +00:00