..
AbstractImporter.java
refactoring of logging
2009-01-30 23:33:47 +00:00
Balancer.java
- added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up.
2009-04-01 12:39:11 +00:00
CrawlEntry.java
- added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up.
2009-04-01 12:39:11 +00:00
CrawlProfile.java
- added migration class to go from index collections to the index cell data structure.
2009-03-30 15:31:25 +00:00
CrawlQueues.java
- removed deprecated threads
2009-04-01 20:13:57 +00:00
CrawlStacker.java
- removed deprecated threads
2009-04-01 20:13:57 +00:00
FTPLoader.java
- added Latency control to the crawler:
2009-03-20 10:21:23 +00:00
HTTPLoader.java
- added Latency control to the crawler:
2009-03-20 10:21:23 +00:00
Importer.java
refactoring:
2008-05-06 13:44:38 +00:00
ImporterException.java
added final where possible
2008-08-02 12:12:04 +00:00
ImporterManager.java
more memory leak fixing hacks
2009-02-11 13:31:10 +00:00
IndexingStack.java
removed option to use different primary keys in kelondro tables
2009-03-13 16:52:31 +00:00
Latency.java
- removed deprecated threads
2009-04-01 20:13:57 +00:00
LoaderMessage.java
more refactoring of kelondro.text / deleted de.anomic.index
2009-03-02 11:04:13 +00:00
NoticedURL.java
added new concurrent merger class for IndexCell RWI data
2009-03-20 14:54:37 +00:00
NoticeURLImporter.java
- added migration class to go from index collections to the index cell data structure.
2009-03-30 15:31:25 +00:00
ProtocolLoader.java
more refactoring of kelondro.text / deleted de.anomic.index
2009-03-02 11:04:13 +00:00
ResourceObserver.java
refactoring of wordIndex class
2009-03-13 10:34:51 +00:00
ResultImages.java
* refactoring
2008-08-02 13:57:00 +00:00
ResultURLs.java
more refactoring of kelondro.text / deleted de.anomic.index
2009-03-02 11:04:13 +00:00
robotsParser.java
* Robots.txt: don't interpret Crawl-Delays for other robots
2008-12-18 15:35:41 +00:00
RobotsTxt.java
- added migration class to go from index collections to the index cell data structure.
2009-03-30 15:31:25 +00:00
SitemapImporter.java
more performance hacks
2008-12-04 12:54:16 +00:00
ZURL.java
- added migration class to go from index collections to the index cell data structure.
2009-03-30 15:31:25 +00:00