theli 915812f597 *) Undoing robots parser policy changes from svn rev. 1421 ... - crawling is not allowed if server returned a 403 statuscode (according to rfc) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1864 6c8d7289-2bf4-0310-a012-ef5d649a1542		2006-03-09 10:17:37 +00:00
..
data	*) Undoing robots parser policy changes from svn rev. 1421	2006-03-09 10:17:37 +00:00
htmlFilter	added refresh parser to htmlFilterContentScraper	2006-02-15 21:55:15 +00:00
http	added IOException for httpc client error	2006-03-07 19:38:10 +00:00
icap	code cleanup	2005-12-06 23:51:29 +00:00
kelondro	added two new kelondro classes that will handle the new index data structures (not used yet)	2006-03-01 00:25:02 +00:00
net	static IP is proper	2006-02-28 08:57:20 +00:00
plasma	added DBCleaner from Hydrox	2006-03-08 22:06:11 +00:00
server	bugfix for staticIP	2006-03-03 16:24:21 +00:00
soap	fixed soap service: index.soap -> yacysearch.soap	2006-03-05 15:28:40 +00:00
tools	added some UTF-8 handling.	2006-01-10 16:48:59 +00:00
urlRedirector	*) Allow crawling of dynamic urls if configured	2006-01-09 10:31:06 +00:00
yacy	*) adding possibility to configure the server port for seed uploading via scp.	2006-03-08 16:34:05 +00:00
ymage	code cleanup	2005-12-06 23:51:29 +00:00