yacy_search_server/source/de/anomic/http
orbiter 33ad0c8246 added a web structure computation and logging:
- all web page parsing operations will now increase a web structure file
- the file is computed in memory and dumped at shutdown-time to PLASMASB/webStructure.map in readable form (not a database)
- the file can be used externally to analyse the link structure of the crawled pages
- the web structure can also be retrieved using a xml-interface at http://localhost:8080/xml/webstructure.xml
- the short-term purpose is the computation of a link-graph image (before linuxtag!)
- a long-term purpose could be a decentralized computation of the citation rank



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3746 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-22 08:13:48 +00:00
..
httpc.java reverting svn 3691+3692 2007-05-09 19:31:40 +00:00
httpChunkedInputStream.java * applied many compiler warning recommendations 2006-08-16 19:49:31 +00:00
httpChunkedOutputStream.java *) soap handler 2006-10-28 12:31:48 +00:00
httpContentLengthInputStream.java *) Bugfix: calling close must not close the wrapped input stream, otherwise 2006-10-24 06:09:38 +00:00
httpd.java added a web structure computation and logging: 2007-05-22 08:13:48 +00:00
httpdAbstractHandler.java
httpdBoundedSizeOutputStream.java *) bugfix for wrong proxy traffic accounting 2007-03-16 13:52:48 +00:00
httpdByteCountInputStream.java *) bugfix for wrong proxy traffic accounting 2007-03-16 13:52:48 +00:00
httpdByteCountOutputStream.java *) bugfix for wrong proxy traffic accounting 2007-03-16 13:52:48 +00:00
httpdFileHandler.java *) bugfix: setting mimeType properly for dir listing with e.g. "?format=xml" 2007-03-23 05:37:19 +00:00
httpdHandler.java
httpdLimitExceededException.java added option to see ranking scores in surftipps 2006-09-30 23:28:03 +00:00
httpdProxyHandler.java avoid division by zero if search is done for no words 2007-05-09 22:10:12 +00:00
httpdRobotsTxtConfig.java - improved version of robots.txt (delete your old htroot/robots.txt before updating): 2007-03-02 01:19:38 +00:00
httpdSwitchboard.java
httpHeader.java reverting svn 3691+3692 2007-05-09 19:31:40 +00:00
httpRemoteProxyConfig.java replaced some toString() 2007-02-06 16:26:56 +00:00
httpTemplate.java - fix for http://www.yacy-forum.de/viewtopic.php?t=3369 2007-01-12 00:52:38 +00:00