yacy_search_server/source/de/anomic/crawler
orbiter 64f29f990e a collection of performance hacks and code cleanup:
- removed usage of URL-Caches which could have been a memory leak
- removed unused classes and methods
- removed not necessary synchronizations
- added synchronization hacks where possible
- fine-tuned crawling speed to prevent IO of balancer
- fixed a bug in IODispatcher that may have caused that no merges were done
- reduced number of parameters in very often called methods (compare methods)
- reduced complexity of data structures of now massively used HandleSet class
- reduction of new String() and getBytes() usage / new methods to support this transition

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6820 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-19 16:42:37 +00:00
..
retrieval continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 2010-04-08 00:11:32 +00:00
AbstractImporter.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790 2010-04-15 13:22:59 +00:00
Balancer.java reduced IO-load and synchronization/blocking 2010-04-18 21:55:20 +00:00
CrawlProfile.java a collection of performance hacks and code cleanup: 2010-04-19 16:42:37 +00:00
CrawlQueues.java performance hacks 2010-04-13 23:29:55 +00:00
CrawlStacker.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790 2010-04-15 13:22:59 +00:00
CrawlSwitchboard.java *) some minor changes for better code readability 2010-04-05 12:37:33 +00:00
Importer.java
ImporterException.java
ImporterManager.java *) some minor changes for better code readability 2010-04-05 12:37:33 +00:00
Latency.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 2010-04-08 00:11:32 +00:00
NoticedURL.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790 2010-04-15 13:22:59 +00:00
ResourceObserver.java allow global search if res. observer disabled index transmission 2010-02-09 17:14:16 +00:00
ResultImages.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 2010-04-08 00:11:32 +00:00
ResultURLs.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790 2010-04-15 13:22:59 +00:00
RobotsEntry.java *) some minor changes for better code readability 2010-04-05 12:37:33 +00:00
robotsParser.java - fixed a bug in robots.txt parser 2010-03-04 11:58:07 +00:00
RobotsTxt.java only load robots.txt for http and http protocol 2010-03-20 10:15:11 +00:00
SitemapImporter.java applied code changes that are recommended by PMD 2010-01-10 23:09:48 +00:00
ZURL.java a collection of performance hacks and code cleanup: 2010-04-19 16:42:37 +00:00