orbiter e81be7d4f2 added many missing user-agent declarations for yacy http client connections. ... the most important fix was the addition of the yacybot user-agent for robots.txt loading, because web masters look for that access to see if the crawler behaves correctly. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4968 6c8d7289-2bf4-0310-a012-ef5d649a1542		2008-07-04 11:03:03 +00:00
..
bookmarks	- organize imports	2008-06-06 16:01:27 +00:00
util	added many missing user-agent declarations for yacy http client connections.	2008-07-04 11:03:03 +00:00
blacklists_p.java	- organize imports	2008-06-06 16:01:27 +00:00
blacklists_p.xml
config_p.java	- organize imports	2008-06-06 16:01:27 +00:00
config_p.xml
feed.java	xss protection	2008-05-07 16:37:13 +00:00
feed.rss	added very rudimentary peer news as rss feed. An example can be retrieved with	2008-04-24 23:30:13 +00:00
queues_p.java	- modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order	2008-07-03 13:08:37 +00:00
queues_p.xml
status_p.java	- fixed at least two causes for a NPE after a use case switch.	2008-06-04 21:34:57 +00:00
status_p.xml
version.java	refactoring of switchboard queueing	2008-03-22 01:28:37 +00:00
version.xml
webstructure.java	updated terminal and dynamic webstructure applet: can now change when crawl is running	2008-05-09 00:01:47 +00:00
webstructure.xml