yacy_search_server/source/de/anomic/crawler
2009-04-17 12:23:00 +00:00
..
AbstractImporter.java refactoring of logging 2009-01-30 23:33:47 +00:00
Balancer.java - added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up. 2009-04-01 12:39:11 +00:00
CrawlEntry.java - added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up. 2009-04-01 12:39:11 +00:00
CrawlProfile.java - added migration class to go from index collections to the index cell data structure. 2009-03-30 15:31:25 +00:00
CrawlQueues.java - less lines in rssTerminal 2009-04-15 23:07:51 +00:00
CrawlStacker.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
FTPLoader.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
HTTPLoader.java fixed problem with not http client 2009-04-13 21:21:47 +00:00
Importer.java
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java more memory leak fixing hacks 2009-02-11 13:31:10 +00:00
IndexingStack.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
Latency.java - removed deprecated threads 2009-04-01 20:13:57 +00:00
LoaderMessage.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
NoticedURL.java added new concurrent merger class for IndexCell RWI data 2009-03-20 14:54:37 +00:00
NoticeURLImporter.java - added migration class to go from index collections to the index cell data structure. 2009-03-30 15:31:25 +00:00
ProtocolLoader.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
ResourceObserver.java refactoring of wordIndex class 2009-03-13 10:34:51 +00:00
ResultImages.java * refactoring 2008-08-02 13:57:00 +00:00
ResultURLs.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 2008-12-18 15:35:41 +00:00
RobotsTxt.java Robots.txt is now reused after one day. See forum-topic: 2009-04-02 15:29:36 +00:00
SitemapImporter.java more performance hacks 2008-12-04 12:54:16 +00:00
Surrogate.java corrections in dublin core syntax 2009-04-17 12:23:00 +00:00
ZURL.java - added migration class to go from index collections to the index cell data structure. 2009-03-30 15:31:25 +00:00