5 Commits

Author	SHA1	Message	Date
theli	ab5a9bee66	*) adding some copyright headers ... *) next step of restructuring for new crawlers - adding first testversion of ftp crawler class -- does not create a htCache entry yet git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2483 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 14:38:29 +00:00
theli	4e2a950ac9	*) next step of restructuring for new crawlers ... - avoid using the http crawler class directly. Using the interface class instead git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2476 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 09:24:24 +00:00
theli	09b106eb04	*) next step of restructuring for new crawlers ... - adding interface class (plasma/crawler/plasmaCrawlWorker.java) for protocol specific crawl-worker threads - moving reusable code into abstract crawl-worker class AbstractCrawlWorker.java - the load method of the worker threads should not be called directly anymore (e.g. by the snippet fetcher) to crawl a page and wait for the result use function plasmaCrawlLoader.loadSync([...]) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2474 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 09:00:18 +00:00
theli	eb9b138986	*) next step of restructuring for new crawlers ... - conversion of the crawler pool into a keyed object pool - crawlers are now loaded based on the url protocol (of course works only for http now) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2473 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 06:52:55 +00:00
theli	1395aae742	*) starting restructuring which is needed to add crawlers for additional protocols ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2472 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-09-04 06:09:20 +00:00