yacy_search_server/source/de/anomic/crawler
orbiter 91af105373 last changes before release
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5493 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-01-13 23:49:08 +00:00
..
AbstractImporter.java added final where possible 2008-08-02 12:12:04 +00:00
Balancer.java fix for deadlock-like behavior in balancer 2008-11-22 11:25:01 +00:00
CrawlEntry.java removed active profiling in kelondroRowSet 2009-01-02 12:33:06 +00:00
CrawlProfile.java - added fast fingerprint computation for files (any). Will be used in new index dump method 2008-12-29 12:22:13 +00:00
CrawlQueues.java - refactoring of CrawlEntry and CrawlStacker 2008-12-17 22:53:06 +00:00
CrawlStacker.java fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1516&p=10545#p10545 2009-01-11 19:02:50 +00:00
FTPLoader.java fix for npe 2009-01-13 00:10:42 +00:00
HTTPLoader.java added more exception handling during crawling 2008-11-22 00:40:18 +00:00
Importer.java
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java added final where possible 2008-08-02 12:12:04 +00:00
IndexingStack.java refactoring and new architecture to store the files of the web cache: 2008-10-16 21:24:09 +00:00
LoaderMessage.java modifications towards a single database operation to read/write http header and cached file at once: 2008-08-25 18:11:47 +00:00
NoticedURL.java performance hacks 2008-12-03 15:38:29 +00:00
NoticeURLImporter.java more performance hacks 2008-12-04 12:54:16 +00:00
ProtocolLoader.java last changes before release 2009-01-13 23:49:08 +00:00
ResourceObserver.java javadoc 2008-11-01 08:56:58 +00:00
ResultImages.java * refactoring 2008-08-02 13:57:00 +00:00
ResultURLs.java fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1351&p=9242#p9242 2008-09-14 20:03:59 +00:00
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 2008-12-18 15:35:41 +00:00
RobotsTxt.java removed unnecessary usage of kelondroBLOBTree 2008-12-18 00:18:37 +00:00
SitemapImporter.java more performance hacks 2008-12-04 12:54:16 +00:00
ZURL.java - more space in error db to store larger error messages 2008-11-11 21:42:12 +00:00