orbiter f183d3822c added a default accept header in http requests since some http fraud detection functions check that this header field exist ... see also: http://bad-behavior.ioerror.us/ in source file browser.inc.php git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8048 6c8d7289-2bf4-0310-a012-ef5d649a1542		2011-11-16 15:27:43 +00:00
..
retrieval	added a default accept header in http requests since some http fraud detection functions check that this header field exist	2011-11-16 15:27:43 +00:00
Balancer.java	fix for http://bugs.yacy.net/view.php?id=62	2011-10-26 10:07:16 +00:00
CrawlProfile.java	- added a cache for active crawl profiles to the crawl switchboard	2011-11-08 15:38:08 +00:00
CrawlQueues.java	refactoring	2011-10-04 09:06:24 +00:00
CrawlStacker.java	- added a cache for active crawl profiles to the crawl switchboard	2011-11-08 15:38:08 +00:00
CrawlSwitchboard.java	- added a cache for active crawl profiles to the crawl switchboard	2011-11-08 15:38:08 +00:00
ImporterException.java	added final where possible	2008-08-02 12:12:04 +00:00
Latency.java	another performance hack: re-use of known host addresses for isLocal property; avoids look-up in local hash	2011-09-30 08:26:31 +00:00
NoticedURL.java	fix for http://bugs.yacy.net/view.php?id=62	2011-10-26 10:07:16 +00:00
ResourceObserver.java	refactoring:	2011-09-25 16:59:06 +00:00
ResultImages.java	- fixed a bug in crawl start with file name (npe in new url)	2011-04-18 16:11:16 +00:00
ResultURLs.java	fixed urls to media content during indexing	2011-11-09 15:40:14 +00:00
RobotsTxt.java	more logging	2011-11-16 14:09:50 +00:00
RobotsTxtEntry.java	- enhanced logging in robots.txt parser for remote debugging	2011-11-16 01:03:49 +00:00
RobotsTxtParser.java	fix for robot parser	2011-11-16 13:12:46 +00:00
RSSLoader.java	refactoring:	2011-09-25 16:59:06 +00:00
SitemapImporter.java	refactoring:	2011-09-25 16:59:06 +00:00
ZURL.java	typo	2011-11-10 11:57:26 +00:00