yacy_search_server/source/de/anomic/crawler
orbiter 3d4b826ca5 migration of all databases that use the deprecated BLOBTree format into the BLOBHeap format. Old databases are migrated automatically.
This removes the last very IO-intensive data structures which were still used for Wiki, Blog and Bookmarks. Old database files will still remain in the DATA subdirectory but can be deleted manually if no major bugs appear during migration. There is no need for any user action, all migration is done automatically.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5986 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-27 15:04:04 +00:00
..
AbstractImporter.java refactoring of logging 2009-01-30 23:33:47 +00:00
Balancer.java - removed useCell option: the indexCell data structure is now the default index structure; old collection data is still migrated 2009-04-22 22:39:12 +00:00
CrawlEntry.java - added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up. 2009-04-01 12:39:11 +00:00
CrawlProfile.java migration of all databases that use the deprecated BLOBTree format into the BLOBHeap format. Old databases are migrated automatically. 2009-05-27 15:04:04 +00:00
CrawlQueues.java - refactoring: added new content package, which will contain connector classes for different types of data sources to import texts into the YaCy index 2009-05-26 07:44:22 +00:00
CrawlStacker.java code-split 2009-04-20 13:28:28 +00:00
FTPLoader.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
HTTPLoader.java fixed problem with not http client 2009-04-13 21:21:47 +00:00
Importer.java
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java more memory leak fixing hacks 2009-02-11 13:31:10 +00:00
IndexingStack.java - fixed possible bugs in Stack (may affect Crawler reset) and RandomAccess handling 2009-05-02 01:40:03 +00:00
Latency.java - removed deprecated threads 2009-04-01 20:13:57 +00:00
LoaderMessage.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
NoticedURL.java - removed useCell option: the indexCell data structure is now the default index structure; old collection data is still migrated 2009-04-22 22:39:12 +00:00
NoticeURLImporter.java - added migration class to go from index collections to the index cell data structure. 2009-03-30 15:31:25 +00:00
ProtocolLoader.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
ResourceObserver.java simplified code, removed one unused method in all implementing classes 2009-05-21 23:53:01 +00:00
ResultImages.java * refactoring 2008-08-02 13:57:00 +00:00
ResultURLs.java refactoring: better abstraction of reference and metadata prototypes. 2009-04-03 13:23:45 +00:00
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 2008-12-18 15:35:41 +00:00
RobotsTxt.java migration of all databases that use the deprecated BLOBTree format into the BLOBHeap format. Old databases are migrated automatically. 2009-05-27 15:04:04 +00:00
SitemapImporter.java more performance hacks 2008-12-04 12:54:16 +00:00
ZURL.java - added migration class to go from index collections to the index cell data structure. 2009-03-30 15:31:25 +00:00