mirror of
https://github.com/yacy/yacy_search_server.git
synced 2024-09-19 00:01:41 +02:00
Merge pull request #46 from reelsense/patch-1
Grammar fix - ConfigRobotsTxt_p.html
This commit is contained in:
commit
be0b09552c
|
@ -10,7 +10,7 @@
|
|||
<h2>Exclude Web-Spiders</h2>
|
||||
<p>
|
||||
Here you can set up a robots.txt for all webcrawlers that try to access the webinterface of your peer.
|
||||
<span class="tt">robots.txt</span> is a volunteer agreement most search-engines (including YaCy) follow.
|
||||
<span class="tt">robots.txt</span> is a voluntary agreement most search-engines (including YaCy) follow.
|
||||
It disallows crawlers to access webpages or even entire domains.
|
||||
</p>
|
||||
#(error)#
|
||||
|
@ -50,4 +50,4 @@
|
|||
</form>
|
||||
#%env/templates/footer.template%#
|
||||
</body>
|
||||
</html>
|
||||
</html>
|
||||
|
|
Loading…
Reference in New Issue
Block a user