yacy_search_server/source/de/anomic/crawler
orbiter 9bfb2641db - removed deprecated threads
- added automatic http client reset. this was necessary because excessive intranet crawling caused deadlocks. this hack solved the problem.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5768 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-01 20:13:57 +00:00
..
AbstractImporter.java refactoring of logging 2009-01-30 23:33:47 +00:00
Balancer.java - added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up. 2009-04-01 12:39:11 +00:00
CrawlEntry.java - added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up. 2009-04-01 12:39:11 +00:00
CrawlProfile.java - added migration class to go from index collections to the index cell data structure. 2009-03-30 15:31:25 +00:00
CrawlQueues.java - removed deprecated threads 2009-04-01 20:13:57 +00:00
CrawlStacker.java - removed deprecated threads 2009-04-01 20:13:57 +00:00
FTPLoader.java - added Latency control to the crawler: 2009-03-20 10:21:23 +00:00
HTTPLoader.java - added Latency control to the crawler: 2009-03-20 10:21:23 +00:00
Importer.java refactoring: 2008-05-06 13:44:38 +00:00
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java more memory leak fixing hacks 2009-02-11 13:31:10 +00:00
IndexingStack.java removed option to use different primary keys in kelondro tables 2009-03-13 16:52:31 +00:00
Latency.java - removed deprecated threads 2009-04-01 20:13:57 +00:00
LoaderMessage.java more refactoring of kelondro.text / deleted de.anomic.index 2009-03-02 11:04:13 +00:00
NoticedURL.java added new concurrent merger class for IndexCell RWI data 2009-03-20 14:54:37 +00:00
NoticeURLImporter.java - added migration class to go from index collections to the index cell data structure. 2009-03-30 15:31:25 +00:00
ProtocolLoader.java more refactoring of kelondro.text / deleted de.anomic.index 2009-03-02 11:04:13 +00:00
ResourceObserver.java refactoring of wordIndex class 2009-03-13 10:34:51 +00:00
ResultImages.java * refactoring 2008-08-02 13:57:00 +00:00
ResultURLs.java more refactoring of kelondro.text / deleted de.anomic.index 2009-03-02 11:04:13 +00:00
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 2008-12-18 15:35:41 +00:00
RobotsTxt.java - added migration class to go from index collections to the index cell data structure. 2009-03-30 15:31:25 +00:00
SitemapImporter.java more performance hacks 2008-12-04 12:54:16 +00:00
ZURL.java - added migration class to go from index collections to the index cell data structure. 2009-03-30 15:31:25 +00:00