2005-04-07 21:19:42 +02:00
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" "http://www.w3.org/TR/REC-html40/loose.dtd">
< html >
< head >
< title > YaCy: Index Monitor< / title >
#[metas]#
< / head >
< body marginheight = "0" marginwidth = "0" leftmargin = "0" topmargin = "0" >
#[header]#
< table width = "100%" border = "0" cellpadding = "0" cellspacing = "0" class = "SubMenu" >
< tr height = "10" > < td colspan = "13" class = "MenuHeader" > Index Monitor Menu< / td > < / tr >
< tr height = "2" > < td colspan = "13" > < / td > < / tr >
< tr class = "TableHeader" >
< td width = "16%" class = "MenuSubItem" > < a href = "/IndexMonitor.html" class = "MenuItemLink" > Index Monitor Overview< / a > < / td >
< td class = "MenuSubSpacer" > < / td >
< td width = "14%" class = "MenuSubItem" > < a href = "/IndexMonitor.html?process=1" class = "MenuItemLink" > (1) < img border = "0" src = "/env/grafics/lock.gif" align = "top" > Receipts< / a > < / td >
< td class = "MenuSubSpacer" > < / td >
< td width = "14%" class = "MenuSubItem" > < a href = "/IndexMonitor.html?process=2" class = "MenuItemLink" > (2) < img border = "0" src = "/env/grafics/lock.gif" align = "top" > Queries< / a > < / td >
< td class = "MenuSubSpacer" > < / td >
< td width = "14%" class = "MenuSubItem" > < a href = "/IndexMonitor.html?process=3" class = "MenuItemLink" > (3) < img border = "0" src = "/env/grafics/lock.gif" align = "top" > DHT Transfer< / a > < / td >
< td class = "MenuSubSpacer" > < / td >
< td width = "14%" class = "MenuSubItem" > < a href = "/IndexMonitor.html?process=4" class = "MenuItemLink" > (4) < img border = "0" src = "/env/grafics/lock.gif" align = "top" > Proxy Use< / a > < / td >
< td class = "MenuSubSpacer" > < / td >
< td width = "14%" class = "MenuSubItem" > < a href = "/IndexMonitor.html?process=5" class = "MenuItemLink" > (5) < img border = "0" src = "/env/grafics/lock.gif" align = "top" > Local Crawling< / a > < / td >
< td class = "MenuSubSpacer" > < / td >
< td width = "14%" class = "MenuSubItem" > < a href = "/IndexMonitor.html?process=6" class = "MenuItemLink" > (6) Global Crawling< / a > < / td >
< / tr >
< / table >
< br >
#(process)#
< h2 > Indexing Queues Monitor Overview< / h2 >
< p > These are monitoring pages for the different indexing queues.< p >
2005-04-09 12:49:03 +02:00
< p > YaCy knows 5 different ways to acquire web indexes. The details of these processes (1-5) are described within the submenu's listed
2005-04-07 21:19:42 +02:00
above which also will show you a table with indexing results so far. The information in these tables is considered as private,
so you need to log-in with your administration password.< / p >
2005-04-09 12:49:03 +02:00
< p > Case (6) is a monitor of the local receipt-generator, the opposed case of (1). It contains also an indexing result monitor but is not considered private
2005-04-07 21:19:42 +02:00
since it shows crawl requests from other peers.
< / p >
< p > < img src = "/env/grafics/indexmonitor.gif" > < / p >
2005-04-09 12:49:03 +02:00
< p > The image above illustrates the data flow initiated by web index acquisition.
2005-04-07 21:19:42 +02:00
Some processes occur double to document the complex index migration structure.
< / p >
::
< h2 > (1) Index Monitor of Remote Crawl Receipts< / h2 >
< p > This is the list of web pages that this peer initiated to crawl,
but had been crawled by < i > other< / i > peers.
This is the 'mirror'-case of process (6).
< / p >
< p > < i > Use Case:< / i > You get entries here, if you start a local crawl on the 'Index Creation'-Page and check the
'Do Remote Indexing'-flag. Every page that a remote peer indexes upon this peer's request
is reported back and can be monitored here.< p >
::
< h2 > (2) Index Monitor for Result of Search Queries< / h2 >
< p > This index transfer was initiated by your peer by doing a search query.
The index was crawled and contributed by other peers.< / p >
< p > < i > Use Case:< / i > This list fills up if you do a search query on the 'Search Page'< / p >
::
< h2 > (3) Index Monitor for Index Transfer.< / h2 >
< p > The url fetch was initiated and executed by other peers.
2005-04-09 12:49:03 +02:00
These links here have been transmitted to you because your peer is the most appropriate for storage according to
2005-04-07 21:19:42 +02:00
the logic of the Global Distributed Hash Table.< / p >
< p > < i > Use Case:< / i > This list may fill if you check the 'Index Receive'-flag on the 'Index Control' page< / p >
::
< h2 > (4) Index Monitor for Proxy Indexing< / h2 >
< p > These web pages had been indexed as result of your proxy usage.
< b > No personal or protected page is indexed< / b > ;
such pages are detected by Cookie-Use or POST-Parameters (either in URL or as HTTP protocol)
and automatically excluded from indexing.< / p >
< p > < i > Use Case:< / i > You must use YaCy as proxy to fill up this table.
2005-04-09 12:49:03 +02:00
Set the proxy settings of your browser to the same port as given
2005-04-07 21:19:42 +02:00
on the 'Settings'-page in the 'Proxy and Administration Port' field.< / p >
::
< h2 > (5) Index Monitor for Local Crawling.< / h2 >
< p > These web pages had been crawled by your own crawl task.< / p >
< p > < i > Use Case:< / i > start a crawl by setting a crawl start point on the 'Index Create' page.< / p >
::
< h2 > (6) Index Monitor for Global Crawling< / h2 >
< p > These pages had been indexed by your peer, but the crawl was initiated by a remote peer.
This is the 'mirror'-case of process (1).< / p >
< p > < i > Use Case:< / i > This list may fill if you check the 'Accept remote crawling requests'-flag on the 'Index Crate' page< / p >
#(/process)#
#(table)#
< p > < i > The stack is empty.< / i > < / p >
::
< p > < i >
#(size)#
Showing all #[all]# entries in this stack.
::
Showing latest #[count]# lines from a stack of #[all]# entries.
#(/size)#
< / i >
< table border = "0" cellpadding = "2" cellspacing = "1" width = "100%" >
< tr class = "TableHeader" >
< td class = "small" > < form action = "#[feedbackpage]#" method = "post" enctype = "multipart/form-data" >
< input type = "hidden" name = "process" value = "#[tabletype]#" >
< input type = "submit" name = "clearlist" value = "clear list" > < / form > < / td >
#(showInit)#::< td class = "small" > < b > Initiator< / b > < / td > #(/showInit)#
#(showExec)#::< td class = "small" > < b > Executor< / b > < / td > #(/showExec)#
< td class = "small" > < b > Modified Date< / b > < / td >
< td class = "small" > < b > #Words< / b > < / td >
< td class = "small" > < b > Title< / b > < / td >
< td class = "small" > < b > URL< / b > < / td >
< / tr >
#{indexed}#
< tr class = "TableCell#(dark)#Light::Dark#(/dark)#" class = "small" >
< td width = "30" class = "small" >
< form action = "#[feedbackpage]#" method = "post" enctype = "multipart/form-data" >
< input type = "hidden" name = "process" value = "#[tabletype]#" >
< input type = "hidden" name = "hash" value = "#[urlhash]#" >
< input type = "submit" name = "deleteentry" value = "delete" class = "small" >
< / form > < / td >
#(showInit)#::< td width = "60" class = "small" > #[initiatorSeed]#< / td > #(/showInit)#
#(showExec)#::< td width = "60" class = "small" > #[executorSeed]#< / td > #(/showExec)#
< td width = "80" class = "small" > #[moddate]#< / td >
< td width = "40" class = "small" > #[wordcount]#< / td >
< td width = "180" class = "small" > #[urldescr]#< / td >
< td class = "small" > #[url]#< / td >
< / tr >
#{/indexed}#
< / table > < br >
< / p >
::
#(/table)#
#[footer]#
< / body >
< / html >