Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
26366596d9
yacy_search_server/source/net/yacy/crawler
History
orbiter 26366596d9 fix for a problem which ocurres when a site is crawled where the start 
url is redirected.
2013-09-04 16:00:47 +02:00
..
data fix for a problem which ocurres when a site is crawled where the start 2013-09-04 16:00:47 +02:00
retrieval fix for a problem which ocurres when a site is crawled where the start 2013-09-04 16:00:47 +02:00
robots Redesign of crawler identification and robots steering. A non-p2p user 2013-08-22 14:23:47 +02:00
Balancer.java Redesign of crawler identification and robots steering. A non-p2p user 2013-08-22 14:23:47 +02:00
CrawlQueue.java Redesign of crawler identification and robots steering. A non-p2p user 2013-08-22 14:23:47 +02:00
CrawlStacker.java added an option to put image links to the crawl queue and handle these 2013-09-03 11:13:45 +02:00
CrawlSwitchboard.java Redesign of crawler identification and robots steering. A non-p2p user 2013-08-22 14:23:47 +02:00
HarvestProcess.java fix for wrong display of error urls in HostBrowser 2012-12-07 00:31:10 +01:00