yacy_search_server/source/de/anomic/crawler
orbiter 1400cdc91e - refactoring of resourceObserver (moved it to crawler)
- partly redesign of diskUsage: little bit more functional behavior, less side effects, better error case handling
- the resourceObserver can now show a error message if the diskUsage is 'out of order'

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4973 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-07 00:03:37 +00:00
..
AbstractImporter.java refactoring: 2008-05-06 13:44:38 +00:00
Balancer.java - refactoring of robots parser 2008-07-05 00:35:20 +00:00
CrawlEntry.java fix for npe in crawler 2008-05-08 20:16:19 +00:00
CrawlProfile.java - WatchCrawler shows status without JavaScript 2008-06-14 10:24:58 +00:00
CrawlQueues.java - refactoring of robots parser 2008-07-05 00:35:20 +00:00
CrawlStacker.java - refactoring of robots parser 2008-07-05 00:35:20 +00:00
ErrorURL.java refactoring: moved all crawler classes into their own package 2008-05-06 00:32:41 +00:00
FTPLoader.java - added option to switch between yacy networks, especially between the two default networks (freeworld and intranet), 2008-05-14 21:36:02 +00:00
HTTPLoader.java added many missing user-agent declarations for yacy http client connections. 2008-07-04 11:03:03 +00:00
Importer.java refactoring: 2008-05-06 13:44:38 +00:00
ImporterException.java refactoring: 2008-05-06 13:44:38 +00:00
ImporterManager.java - organize imports 2008-06-06 16:01:27 +00:00
IndexingStack.java added options to configure the 'corporate identity'-icons, the home page link and the greeting line from 2008-07-03 23:37:04 +00:00
LoaderMessage.java refactoring: moved all crawler classes into their own package 2008-05-06 00:32:41 +00:00
NoticedURL.java - modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order 2008-07-03 13:08:37 +00:00
NoticeURLImporter.java - added option to switch between yacy networks, especially between the two default networks (freeworld and intranet), 2008-05-14 21:36:02 +00:00
ProtocolLoader.java more protection against remote shutdown attacks: prevent loading using the crawler 2008-05-19 23:05:19 +00:00
ResourceObserver.java - refactoring of resourceObserver (moved it to crawler) 2008-07-07 00:03:37 +00:00
ResultImages.java refactoring: moved all crawler classes into their own package 2008-05-06 00:32:41 +00:00
ResultURLs.java some code-cleanup and possible speed enhancements in different core methods 2008-06-17 23:56:39 +00:00
robotsParser.java - refactoring of robots parser 2008-07-05 00:35:20 +00:00
RobotsTxt.java - refactoring of robots parser 2008-07-05 00:35:20 +00:00
SitemapImporter.java refactoring: 2008-05-06 13:44:38 +00:00
ZURL.java - refactoring of robots parser 2008-07-05 00:35:20 +00:00