mirror of
https://github.com/yacy/yacy_search_server.git
synced 2024-09-19 00:01:41 +02:00
31920385f7
contains a robots:nofollow or if the http header contains a "X-Robots-Tag: nofollow" |
||
---|---|---|
.. | ||
net/yacy | ||
org/apache/tools/tar | ||
log4j.properties |