yacy_search_server/source/de/anomic/crawler
orbiter 1779c3c507 - added a read cache to the RAFile interface to RandomAccessFile
- added a write buffer to BLOBHeap
- modified the BLOBBuffer (is now only to buffer non-compressed content)
- added content compression to the HTCache
The new read cache will decrease the start/initialization time of BLOB files,
like the HTCache, RobotsTxt and other BLOBHeap structures.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5386 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-12-10 11:15:19 +00:00
..
AbstractImporter.java added final where possible 2008-08-02 12:12:04 +00:00
Balancer.java fix for deadlock-like behavior in balancer 2008-11-22 11:25:01 +00:00
CrawlEntry.java fix for bug introduced in SVN 5281: parameters were switched 2008-10-17 12:14:57 +00:00
CrawlProfile.java - added a read cache to the RAFile interface to RandomAccessFile 2008-12-10 11:15:19 +00:00
CrawlQueues.java extended crawling constraints: 2008-11-14 09:58:56 +00:00
CrawlStacker.java extended crawling constraints: 2008-11-14 09:58:56 +00:00
FTPLoader.java performance hacks 2008-12-03 15:38:29 +00:00
HTTPLoader.java added more exception handling during crawling 2008-11-22 00:40:18 +00:00
Importer.java refactoring: 2008-05-06 13:44:38 +00:00
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java added final where possible 2008-08-02 12:12:04 +00:00
IndexingStack.java refactoring and new architecture to store the files of the web cache: 2008-10-16 21:24:09 +00:00
LoaderMessage.java modifications towards a single database operation to read/write http header and cached file at once: 2008-08-25 18:11:47 +00:00
NoticedURL.java performance hacks 2008-12-03 15:38:29 +00:00
NoticeURLImporter.java more performance hacks 2008-12-04 12:54:16 +00:00
ProtocolLoader.java different handling of error cases that occur during loading files with http or ftp: 2008-11-11 21:33:40 +00:00
ResourceObserver.java javadoc 2008-11-01 08:56:58 +00:00
ResultImages.java * refactoring 2008-08-02 13:57:00 +00:00
ResultURLs.java fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1351&p=9242#p9242 2008-09-14 20:03:59 +00:00
robotsParser.java * with r5137 robotParser didn't work at all -> fix 2008-09-12 09:06:38 +00:00
RobotsTxt.java - added a read cache to the RAFile interface to RandomAccessFile 2008-12-10 11:15:19 +00:00
SitemapImporter.java more performance hacks 2008-12-04 12:54:16 +00:00
ZURL.java - more space in error db to store larger error messages 2008-11-11 21:42:12 +00:00