Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
98f45c9032
yacy_search_server/source/net/yacy/crawler/robots
History
Michael Peter Christen 6e1dc444c3 added a snippet test function in ViewFile: you can now search for a 
specific word on the document; the servlet returns the snippet in the
same way as it would be shown in a search result.
2014-07-24 14:59:37 +02:00
..
RobotsTxt.java added a snippet test function in ViewFile: you can now search for a 2014-07-24 14:59:37 +02:00
RobotsTxtEntry.java support for multiple sitemaps in robots.txt 2014-03-14 13:33:23 +01:00
RobotsTxtParser.java support for multiple sitemaps in robots.txt 2014-03-14 13:33:23 +01:00