yacy_search_server/source/net/yacy/crawler
Michael Peter Christen 9fcd8f1bda added canonical filter
attention: this is on by default!
(it should do the right thing)
2023-01-16 14:50:30 +01:00
..
data added canonical filter 2023-01-16 14:50:30 +01:00
retrieval added canonical filter 2023-01-16 14:50:30 +01:00
robots Various javadoc fixes 2022-01-26 11:22:43 +01:00
Balancer.java Various javadoc fixes 2022-01-26 11:22:43 +01:00
CrawlStacker.java added canonical filter 2023-01-16 14:50:30 +01:00
CrawlStarterFromScraper.java adding SPDX license and copyright headers 2021-03-11 12:17:11 +01:00
CrawlSwitchboard.java added canonical filter 2023-01-16 14:50:30 +01:00
FileCrawlStarterTask.java adding SPDX license and copyright headers 2021-03-11 12:17:11 +01:00
HarvestProcess.java adding SPDX license and copyright headers 2021-03-11 12:17:11 +01:00
HostBalancer.java addressing/fixing some concurrency issues from 2022-09-30 08:01:13 +02:00
HostQueue.java addressing/fixing some concurrency issues from 2022-09-30 08:01:13 +02:00
IllegalCrawlProfileException.java adding SPDX license and copyright headers 2021-03-11 12:17:11 +01:00
LegacyBalancer.java fixed missing thread name revert after balancer waiting 2021-12-22 01:46:18 +01:00
RecrawlBusyThread.java added canonical filter 2023-01-16 14:50:30 +01:00