Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
2d9e577ad0
yacy_search_server/source/net/yacy/crawler
History
Michael Peter Christen 2d9e577ad0 replaced the custom robots.txt loader by the standard http loader
2012-10-28 22:48:11 +01:00
..
data replaced the custom robots.txt loader by the standard http loader 2012-10-28 22:48:11 +01:00
retrieval replaced the custom robots.txt loader by the standard http loader 2012-10-28 22:48:11 +01:00
robots replaced the custom robots.txt loader by the standard http loader 2012-10-28 22:48:11 +01:00
Balancer.java replaced the custom robots.txt loader by the standard http loader 2012-10-28 22:48:11 +01:00
CrawlStacker.java - removed unnecessary synchronized and deadlock in crawler 2012-10-28 19:56:02 +01:00
CrawlSwitchboard.java replaced the custom robots.txt loader by the standard http loader 2012-10-28 22:48:11 +01:00