Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
0769517129
yacy_search_server/source/de/anomic/crawler
History
orbiter b88f5fbb4b slightly changed crawling policy 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6723 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-03-07 01:46:08 +00:00
..
retrieval added an api recording function: it shall be possible to record 2010-01-21 22:06:03 +00:00
AbstractImporter.java start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root 2009-10-09 23:13:30 +00:00
Balancer.java better look-ahead into the crawl queue: show more on crawl monitor 2010-02-24 23:11:58 +00:00
CrawlProfile.java - added BEncoder class 2010-01-13 16:21:37 +00:00
CrawlQueues.java slightly changed crawling policy 2010-03-07 01:46:08 +00:00
CrawlStacker.java slightly changed crawling policy 2010-03-07 01:46:08 +00:00
CrawlSwitchboard.java added some modifications recommended by PMD for better performance 2010-01-10 01:40:26 +00:00
Importer.java
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
ImporterManager.java start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root 2009-10-09 23:13:30 +00:00
Latency.java - clean-up of robots.txt parser 2010-01-11 16:36:30 +00:00
NoticedURL.java added extensive memory protection logic to avoid out of memory errors that may be caused by the RowCollection memory allocation function 2009-12-09 23:27:26 +00:00
ResourceObserver.java allow global search if res. observer disabled index transmission 2010-02-09 17:14:16 +00:00
ResultImages.java refactoring of yacy documents and parsers: they depend now only on the kelondro classes 2009-10-18 00:53:43 +00:00
ResultURLs.java redesign of CrawlResult data structures because of OOM occurrences during URL deletion processes. 2010-02-16 23:06:04 +00:00
RobotsEntry.java - fixed a bug in robots.txt parser 2010-03-04 11:58:07 +00:00
robotsParser.java - fixed a bug in robots.txt parser 2010-03-04 11:58:07 +00:00
RobotsTxt.java - fixed a bug in robots.txt parser 2010-03-04 11:58:07 +00:00
SitemapImporter.java applied code changes that are recommended by PMD 2010-01-10 23:09:48 +00:00
ZURL.java slightly changed crawling policy 2010-03-07 01:46:08 +00:00