Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
441035f1f4
yacy_search_server/source/de/anomic/crawler
History
orbiter 6fa439c82b - refactoring of robots 
- added option to crawler to send error-URLs to solr
- changed solr scheme slightly (no multi-value fields where no multi values are)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7693 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-05-02 14:05:51 +00:00
..
retrieval - refactoring of robots 2011-05-02 14:05:51 +00:00
Balancer.java Added federated index storage to solr. 2011-04-14 20:05:04 +00:00
CrawlProfile.java enhanced location search: 2011-04-15 15:54:19 +00:00
CrawlQueues.java - refactoring of robots 2011-05-02 14:05:51 +00:00
CrawlStacker.java - refactoring of robots 2011-05-02 14:05:51 +00:00
CrawlSwitchboard.java more UTF8 getBytes() performance hacks 2011-04-12 05:02:36 +00:00
ImporterException.java added final where possible 2008-08-02 12:12:04 +00:00
Latency.java - refactoring of robots 2011-05-02 14:05:51 +00:00
NoticedURL.java added a handling of appearances of yacy bot entries in robots.txt if this entry addresses the yacy peer 2011-04-03 23:39:45 +00:00
ResourceObserver.java more UTF8 getBytes() performance hacks 2011-04-12 05:02:36 +00:00
ResultImages.java - fixed a bug in crawl start with file name (npe in new url) 2011-04-18 16:11:16 +00:00
ResultURLs.java more UTF8 getBytes() performance hacks 2011-04-12 05:02:36 +00:00
RobotsTxt.java - refactoring of robots 2011-05-02 14:05:51 +00:00
RobotsTxtEntry.java - refactoring of robots 2011-05-02 14:05:51 +00:00
RobotsTxtParser.java - refactoring of robots 2011-05-02 14:05:51 +00:00
RSSLoader.java more UTF8 getBytes() performance hacks 2011-04-12 05:02:36 +00:00
SitemapImporter.java more UTF8 getBytes() performance hacks 2011-04-12 05:02:36 +00:00
ZURL.java - refactoring of robots 2011-05-02 14:05:51 +00:00