yacy_search_server/source
orbiter c36da90261 added a very fast ftp file list generator to site crawler:
- when a site-crawl for ftp sites is now started, then a special directory-tree harvester gets the complete directory structure of a ftp server at once
- the harvester runs concurrently and feeds into the normal crawl queue

also in this:
- fixed the 'start from file' crawl function
- added a link detector for the html parser. The html parser can now also extract links that are not included in <a> tags.
- this causes that a crawl start is now also possible from clear text link files

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7367 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-12-09 17:17:25 +00:00
..
de/anomic added a very fast ftp file list generator to site crawler: 2010-12-09 17:17:25 +00:00
net/yacy added a very fast ftp file list generator to site crawler: 2010-12-09 17:17:25 +00:00
org/apache/tools/tar applied code changes that are recommended by PMD 2010-01-10 23:09:48 +00:00
log4j.properties Collage.html: Fixed problem where the German translation broke the action that contained Collage in a form 2010-07-26 20:18:19 +00:00