Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
9a4375b115
yacy_search_server/source/de
History
theli 9a4375b115 *) robots.txt: adding support for crawl-delay 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3737 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-18 13:00:42 +00:00
..
anomic *) robots.txt: adding support for crawl-delay 2007-05-18 13:00:42 +00:00