yacy_search_server/htroot/xml/webstructure.xml

<?xml version="1.0"?>
<webstructure>
<domains reference="forward" count="#[domains]#" maxref="#[maxref]#">
#{domains}#
<domain host="#[domain]#" id="#[hash]#" date="#[date]#">
#{citations}#
  <citation host="#[refdom]#" id="#[refhash]#" count="#[refcount]#" />
#{/citations}#
</domain>
#{/domains}#
</domains>
</webstructure>
added a web structure computation and logging: - all web page parsing operations will now increase a web structure file - the file is computed in memory and dumped at shutdown-time to PLASMASB/webStructure.map in readable form (not a database) - the file can be used externally to analyse the link structure of the crawled pages - the web structure can also be retrieved using a xml-interface at http://localhost:8080/xml/webstructure.xml - the short-term purpose is the computation of a link-graph image (before linuxtag!) - a long-term purpose could be a decentralized computation of the citation rank git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3746 6c8d7289-2bf4-0310-a012-ef5d649a1542 2007-05-22 10:13:48 +02:00			`<?xml version="1.0"?>`
			`<webstructure>`
added web structure image see http://localhost:8080/WatchWebStructure_p.html git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3747 6c8d7289-2bf4-0310-a012-ef5d649a1542 2007-05-22 17:20:50 +02:00			`<domains reference="forward" count="#[domains]#" maxref="#[maxref]#">`
added a web structure computation and logging: - all web page parsing operations will now increase a web structure file - the file is computed in memory and dumped at shutdown-time to PLASMASB/webStructure.map in readable form (not a database) - the file can be used externally to analyse the link structure of the crawled pages - the web structure can also be retrieved using a xml-interface at http://localhost:8080/xml/webstructure.xml - the short-term purpose is the computation of a link-graph image (before linuxtag!) - a long-term purpose could be a decentralized computation of the citation rank git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3746 6c8d7289-2bf4-0310-a012-ef5d649a1542 2007-05-22 10:13:48 +02:00			`#{domains}#`
			`<domain host="#[domain]#" id="#[hash]#" date="#[date]#">`
			`#{citations}#`
			`<citation host="#[refdom]#" id="#[refhash]#" count="#[refcount]#" />`
			`#{/citations}#`
			`</domain>`
			`#{/domains}#`
			`</domains>`
			`</webstructure>`