Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
9,336 Commits 1 Branch 20 Tags 836 MiB
c95a84103a
Commit Graph

2 Commits

Author SHA1 Message Date
Michael Peter Christen
4c4e0eece2 added new submenu 'Target Analysis' with three servlets which are useful 
to analyse the target servers: robots.txt table, mass target analysis
and a regex tester
 2012-11-07 21:26:01 +01:00
Michael Peter Christen
abebb3b124 added a crawl start checker which makes a simple analysis on the list of 
all given urls: shows if the url can be loaded and if there is a robots
and/or a sitemap.
 2012-10-10 02:02:17 +02:00