yacy_search_server/source/net/yacy/peers
Michael Peter Christen 0a879c98e7 added new 'firstSeen' database table and necessary data structures which
hold a date for each URL to record when a url was first seen. This is
then used to overwrite the modification date for urls upon recrawl in
case that the first-seen date is before the latest document date. This
behaviour is necessary due to the common behaviour of content management
systems which attach always the current date to all documents. Using the
firstSeen database it is possible to approximate a real first document
creation date in case that the crawler starts frequently for the same
domain. As a result the search results ordered by date have a much
better quality and the usage of YaCy as search agent for latest news has
a better quality.
2014-11-13 00:58:58 +01:00
..
graphics enhanced graphics computation (avoiding long string parsing for colours) 2014-10-15 10:31:24 +02:00
operation use CRLF in generated bat command scripts for windows 2014-07-20 00:06:22 +02:00
Accessible.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
DHTSelection.java large IPv6 redesign of peer ping methods! 2014-09-30 14:53:52 +02:00
Dispatcher.java Renamed the transmission cloud to buffer in dispatcher since the name 2014-07-11 04:04:09 +02:00
EventChannel.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
Network.java more ipv6 bugfixes 2014-10-08 12:38:56 +02:00
NewsDB.java npe fix 2014-04-02 02:34:55 +02:00
NewsPool.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
NewsQueue.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
PeerActions.java more IPv6 bugfixes 2014-10-06 17:44:27 +02:00
Protocol.java added new 'firstSeen' database table and necessary data structures which 2014-11-13 00:58:58 +01:00
RemoteSearch.java fix for search in case where local peer has no local seed address in 2014-11-02 21:16:51 +01:00
Seed.java IPv6 fix 2014-10-28 15:36:13 +01:00
SeedDB.java more ipv6 fixes 2014-10-11 00:34:07 +02:00
Transmission.java more IPv6 bugfixes 2014-10-06 17:44:27 +02:00