mirror of
https://github.com/yacy/yacy_search_server.git
synced 2024-09-21 00:00:13 +02:00
4c4e0eece2
to analyse the target servers: robots.txt table, mass target analysis and a regex tester
9 lines
362 B
Plaintext
9 lines
362 B
Plaintext
<div class="SubMenu">
|
|
<h3>Target Analysis</h3>
|
|
<ul class="SubMenu">
|
|
<li><a href="/Tables_p.html?table=robots&count=100" class="MenuItemLink lock">Robots.txt Database</a></li>
|
|
<li><a href="/CrawlCheck_p.html" class="MenuItemLink lock">Mass Crawl Check</a></li>
|
|
<li><a href="/RegexTest.html" class="MenuItemLink">Regex Test</a></li>
|
|
</ul>
|
|
</div>
|