Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
57ffdfad4c
yacy_search_server/source/net
History
Michael Peter Christen 57ffdfad4c added a crawl option to obey html-meta-robots-noindex. This is on by 
default.
2013-07-03 14:50:06 +02:00
..
yacy added a crawl option to obey html-meta-robots-noindex. This is on by 2013-07-03 14:50:06 +02:00