yacy_search_server/source/de/anomic/crawler
orbiter a3b8b7b5c5 some redesign of the main menu structure:
- moved all index generation servlets to it's own main menu item, including proxy indexing
- removed external index import because this operation is not recommended any more. Joining an index can simply be done by moving the index files from one peer to the other peer; they will be merged automatically
- fix to prevent endless loops when disconnecting http sessions
- fix to prevent application of bad blacklist entries that can cause a 'Dangling meta character' exception

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6558 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-10 00:10:43 +00:00
..
retrieval some patches to get the torrent parser working 2010-01-07 00:42:12 +00:00
AbstractImporter.java start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root 2009-10-09 23:13:30 +00:00
Balancer.java added extensive memory protection logic to avoid out of memory errors that may be caused by the RowCollection memory allocation function 2009-12-09 23:27:26 +00:00
CrawlProfile.java added extensive memory protection logic to avoid out of memory errors that may be caused by the RowCollection memory allocation function 2009-12-09 23:27:26 +00:00
CrawlQueues.java replaced _all_ size() == 0 with isEmpty() and all size() > 0 with !isEmpty(). The isEmpty() method is much faster in some cases, especially when used to access badly balanced hashtables where an size() operation becomes a large iteration. 2009-12-02 00:37:59 +00:00
CrawlStacker.java replaced _all_ size() == 0 with isEmpty() and all size() > 0 with !isEmpty(). The isEmpty() method is much faster in some cases, especially when used to access badly balanced hashtables where an size() operation becomes a large iteration. 2009-12-02 00:37:59 +00:00
CrawlSwitchboard.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 2009-11-05 20:28:37 +00:00
Importer.java
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root 2009-10-09 23:13:30 +00:00
Latency.java refactoring 2009-10-11 00:12:19 +00:00
LoaderMessage.java - refactoring 2009-10-19 22:34:44 +00:00
NoticedURL.java added extensive memory protection logic to avoid out of memory errors that may be caused by the RowCollection memory allocation function 2009-12-09 23:27:26 +00:00
ResourceObserver.java option to disable dht by memory limit: 2009-11-06 19:13:30 +00:00
ResultImages.java refactoring of yacy documents and parsers: they depend now only on the kelondro classes 2009-10-18 00:53:43 +00:00
ResultURLs.java preset of proper HashMap dimensions: should prevent re-hashing and increase performance 2009-12-02 14:01:19 +00:00
RobotsEntry.java preset of proper HashMap dimensions: should prevent re-hashing and increase performance 2009-12-02 14:01:19 +00:00
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 2008-12-18 15:35:41 +00:00
RobotsTxt.java added extensive memory protection logic to avoid out of memory errors that may be caused by the RowCollection memory allocation function 2009-12-09 23:27:26 +00:00
SitemapImporter.java refactoring 2009-10-11 00:12:19 +00:00
ZURL.java fix for http://forum.yacy-websuche.de/viewtopic.php?p=18500#p18500 2010-01-09 00:08:16 +00:00