3 Commits

Author	SHA1	Message	Date
reger	365f77ea8c	make internal page links relative to ease any future development for context aware servlets ... note also http://bugs.yacy.net/view.php?id=106	2014-02-10 21:40:42 +01:00
Michael Peter Christen	4c4e0eece2	added new submenu 'Target Analysis' with three servlets which are useful ... to analyse the target servers: robots.txt table, mass target analysis and a regex tester	2012-11-07 21:26:01 +01:00
Michael Peter Christen	abebb3b124	added a crawl start checker which makes a simple analysis on the list of ... all given urls: shows if the url can be loaded and if there is a robots and/or a sitemap.	2012-10-10 02:02:17 +02:00