Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
9e65e9141c
yacy_search_server/source/de/anomic/crawler
History
orbiter 826ca79735 refactoring and new architecture to store the files of the web cache: 
- files are not stored any more as individual files
- a new database structure using BLOBHeap files stores many cache entries in common files
- all file-writing procedures had been migrated to generate byte[] objects which are written with the new database methods

this is only an intermediate step to the final architecture, where cached files are written together with their metadata in one single database structure.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5276 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-10-16 21:24:09 +00:00
..
AbstractImporter.java added final where possible 2008-08-02 12:12:04 +00:00
Balancer.java fix for problem with balancer and lost crawl profiles: 2008-10-08 18:26:36 +00:00
CrawlEntry.java update to the crawl balancer: better organization and better crawl delay prediction 2008-09-17 21:45:21 +00:00
CrawlProfile.java - fix of bug in iterator in kelondroBLOBHeap which caused bug in crawl profile listing 2008-10-10 08:39:11 +00:00
CrawlQueues.java - fix for bug in new profile handling 2008-10-09 22:31:43 +00:00
CrawlStacker.java fix for problem with balancer and lost crawl profiles: 2008-10-08 18:26:36 +00:00
ErrorURL.java - removed superfluous copyright statement 2008-07-20 17:14:51 +00:00
FTPLoader.java refactoring and new architecture to store the files of the web cache: 2008-10-16 21:24:09 +00:00
HTTPLoader.java refactoring and new architecture to store the files of the web cache: 2008-10-16 21:24:09 +00:00
Importer.java refactoring: 2008-05-06 13:44:38 +00:00
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java added final where possible 2008-08-02 12:12:04 +00:00
IndexingStack.java refactoring and new architecture to store the files of the web cache: 2008-10-16 21:24:09 +00:00
LoaderMessage.java modifications towards a single database operation to read/write http header and cached file at once: 2008-08-25 18:11:47 +00:00
NoticedURL.java - fix for bug in new profile handling 2008-10-09 22:31:43 +00:00
NoticeURLImporter.java - fix of bug in iterator in kelondroBLOBHeap which caused bug in crawl profile listing 2008-10-10 08:39:11 +00:00
ProtocolLoader.java modifications towards a single database operation to read/write http header and cached file at once: 2008-08-25 18:11:47 +00:00
ResourceObserver.java configurable free disk space via disk.free 2008-09-15 17:33:06 +00:00
ResultImages.java * refactoring 2008-08-02 13:57:00 +00:00
ResultURLs.java fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1351&p=9242#p9242 2008-09-14 20:03:59 +00:00
robotsParser.java * with r5137 robotParser didn't work at all -> fix 2008-09-12 09:06:38 +00:00
RobotsTxt.java - fix of bug in iterator in kelondroBLOBHeap which caused bug in crawl profile listing 2008-10-10 08:39:11 +00:00
SitemapImporter.java added final where possible 2008-08-02 12:12:04 +00:00
ZURL.java - fixed a bug in performance setting (did not work with german translation) 2008-09-16 23:04:24 +00:00