yacy_search_server/source/de/anomic/crawler
orbiter 2a8f70f0ca - fix for caching of OSM tiles. if you want that this fix applies to your peer, please delete the crawl profiles
- fix for initial generation of crawl profiles (one more reason to remove your crawl profiles)
- more String -> byte[] migration
- more logging for cache store/hit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6874 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-14 23:50:07 +00:00
..
retrieval - removed download-limit that can be given for the crawler for non-crawler download tasks. This was necessary because the same procedure was used for other downloads like for the download of dictionary files where a limit is not useful. The limit still stays for the indexer 2010-05-14 18:30:11 +00:00
AbstractImporter.java - cleanup, removed unused imports 2010-04-27 21:47:41 +00:00
Balancer.java - removed download-limit that can be given for the crawler for non-crawler download tasks. This was necessary because the same procedure was used for other downloads like for the download of dictionary files where a limit is not useful. The limit still stays for the indexer 2010-05-14 18:30:11 +00:00
CrawlProfile.java - fix for caching of OSM tiles. if you want that this fix applies to your peer, please delete the crawl profiles 2010-05-14 23:50:07 +00:00
CrawlQueues.java - removed download-limit that can be given for the crawler for non-crawler download tasks. This was necessary because the same procedure was used for other downloads like for the download of dictionary files where a limit is not useful. The limit still stays for the indexer 2010-05-14 18:30:11 +00:00
CrawlStacker.java fixed dates in metadata 2010-05-08 22:09:36 +00:00
CrawlSwitchboard.java - fix for caching of OSM tiles. if you want that this fix applies to your peer, please delete the crawl profiles 2010-05-14 23:50:07 +00:00
Importer.java refactoring: 2008-05-06 13:44:38 +00:00
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java *) some minor changes for better code readability 2010-04-05 12:37:33 +00:00
Latency.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 2010-04-08 00:11:32 +00:00
NoticedURL.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790 2010-04-15 13:22:59 +00:00
ResourceObserver.java allow global search if res. observer disabled index transmission 2010-02-09 17:14:16 +00:00
ResultImages.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 2010-04-08 00:11:32 +00:00
ResultURLs.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790 2010-04-15 13:22:59 +00:00
RobotsEntry.java *) some minor changes for better code readability 2010-04-05 12:37:33 +00:00
robotsParser.java - fixed a bug in robots.txt parser 2010-03-04 11:58:07 +00:00
RobotsTxt.java only load robots.txt for http and http protocol 2010-03-20 10:15:11 +00:00
SitemapImporter.java applied code changes that are recommended by PMD 2010-01-10 23:09:48 +00:00
ZURL.java possible fix for ZURL.list counter 2010-04-23 08:46:47 +00:00