yacy_search_server/source/net/yacy
Michael Peter Christen 31920385f7 set anchor rel attribute of all links to "nofollow" if the html meta
contains a robots:nofollow or if the http header contains a
"X-Robots-Tag: nofollow"
2013-09-16 16:14:56 +02:00
..
contentcontrol - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
cora - replaced the properties object in AnchorURL with distinct variables 2013-09-15 23:27:04 +02:00
crawler - replaced the properties object in AnchorURL with distinct variables 2013-09-15 23:27:04 +02:00
data - replaced the properties object in AnchorURL with distinct variables 2013-09-15 23:27:04 +02:00
document set anchor rel attribute of all links to "nofollow" if the html meta 2013-09-16 16:14:56 +02:00
gui Added 'final' for all exception blocks as this helps the Java compiler 2013-07-17 18:31:30 +02:00
interaction - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
kelondro - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
peers - replaced the properties object in AnchorURL with distinct variables 2013-09-15 23:27:04 +02:00
repository - replaced the properties object in AnchorURL with distinct variables 2013-09-15 23:27:04 +02:00
search set anchor rel attribute of all links to "nofollow" if the html meta 2013-09-16 16:14:56 +02:00
server - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
upnp replaced StringBuffer with StringBuilder 2013-07-23 12:21:27 +02:00
utils - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
visualization added tools to visualize image generation (i.e. during testing) 2013-09-09 12:58:26 +02:00
dbtest.java - the webgraph shall store all links which appear on a web page and not 2013-09-15 00:30:23 +02:00
migration.java FieldReIndex: omit active vocabulary fields from reindex detection 2013-08-14 00:00:30 +02:00
yacy.java Redesign of crawler identification and robots steering. A non-p2p user 2013-08-22 14:23:47 +02:00
YaCySearchClient.java Added 'final' for all exception blocks as this helps the Java compiler 2013-07-17 18:31:30 +02:00