yacy_search_server/source/net/yacy
orbiter c36da90261 added a very fast ftp file list generator to site crawler:
- when a site-crawl for ftp sites is now started, then a special directory-tree harvester gets the complete directory structure of a ftp server at once
- the harvester runs concurrently and feeds into the normal crawl queue

also in this:
- fixed the 'start from file' crawl function
- added a link detector for the html parser. The html parser can now also extract links that are not included in <a> tags.
- this causes that a crawl start is now also possible from clear text link files

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7367 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-12-09 17:17:25 +00:00
..
ai removed warnings 2010-11-29 07:52:10 +00:00
cora added a very fast ftp file list generator to site crawler: 2010-12-09 17:17:25 +00:00
document added a very fast ftp file list generator to site crawler: 2010-12-09 17:17:25 +00:00
gui *) cleaner code 2010-11-21 03:39:53 +00:00
kelondro some redesign of the search-fail-response mechanism: 2010-12-06 14:34:58 +00:00
repository *) cleaning up the code a little bit 2010-11-28 02:57:31 +00:00
upnp static access to constants 2010-07-27 06:52:58 +00:00
visualization removed a mysterious image buffer 2010-08-20 23:13:59 +00:00
dbtest.java code cleanup 2010-08-21 00:08:36 +00:00
migration.java change in handling of the all-visible home path for storage in YaCy: 2010-09-02 19:24:22 +00:00
screenshot.java - shifted main classes to new package net.yacy 2009-10-18 01:38:07 +00:00
yacy.java removed unused CR accumulation and distribution process 2010-11-29 11:07:42 +00:00
YaCySearchClient.java added a directory-structure reader to ftp client 2010-12-02 08:08:01 +00:00