..
AbstractImporter.java
refactoring:
2008-05-06 13:44:38 +00:00
Balancer.java
- refactoring of robots parser
2008-07-05 00:35:20 +00:00
CrawlEntry.java
fix for npe in crawler
2008-05-08 20:16:19 +00:00
CrawlProfile.java
- WatchCrawler shows status without JavaScript
2008-06-14 10:24:58 +00:00
CrawlQueues.java
- refactoring of robots parser
2008-07-05 00:35:20 +00:00
CrawlStacker.java
- refactoring of robots parser
2008-07-05 00:35:20 +00:00
ErrorURL.java
refactoring: moved all crawler classes into their own package
2008-05-06 00:32:41 +00:00
FTPLoader.java
- added option to switch between yacy networks, especially between the two default networks (freeworld and intranet),
2008-05-14 21:36:02 +00:00
HTTPLoader.java
added many missing user-agent declarations for yacy http client connections.
2008-07-04 11:03:03 +00:00
Importer.java
refactoring:
2008-05-06 13:44:38 +00:00
ImporterException.java
refactoring:
2008-05-06 13:44:38 +00:00
ImporterManager.java
- organize imports
2008-06-06 16:01:27 +00:00
IndexingStack.java
added options to configure the 'corporate identity'-icons, the home page link and the greeting line from
2008-07-03 23:37:04 +00:00
LoaderMessage.java
refactoring: moved all crawler classes into their own package
2008-05-06 00:32:41 +00:00
NoticedURL.java
- modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order
2008-07-03 13:08:37 +00:00
NoticeURLImporter.java
- added option to switch between yacy networks, especially between the two default networks (freeworld and intranet),
2008-05-14 21:36:02 +00:00
ProtocolLoader.java
more protection against remote shutdown attacks: prevent loading using the crawler
2008-05-19 23:05:19 +00:00
ResourceObserver.java
- refactoring of resourceObserver (moved it to crawler)
2008-07-07 00:03:37 +00:00
ResultImages.java
refactoring: moved all crawler classes into their own package
2008-05-06 00:32:41 +00:00
ResultURLs.java
some code-cleanup and possible speed enhancements in different core methods
2008-06-17 23:56:39 +00:00
robotsParser.java
- refactoring of robots parser
2008-07-05 00:35:20 +00:00
RobotsTxt.java
- refactoring of robots parser
2008-07-05 00:35:20 +00:00
SitemapImporter.java
refactoring:
2008-05-06 13:44:38 +00:00
ZURL.java
- refactoring of robots parser
2008-07-05 00:35:20 +00:00